Display device and screen projection mode switching method

Abstract

The application provides a display device and a screen projection mode switching method. The method can receive a switching instruction for switching a screen projection mode when a display displays a screen projection interface in a first screen projection mode. In the first screen projection mode, a play control container includes a play control, an interface component container includes a first interface component of the first screen projection mode, and the first interface component includes an interactive control associated with the first screen projection mode. In response to the switching instruction, the first interface component is removed from the interface component container, a second interface component of a second screen projection mode is created, an interactive control associated with the second screen projection mode is created in the second interface component, and the second interface component is added to the interface component container. The method can logically implement layering on a view control, separate the play control and the interactive control, and implement switching of multiple screen projection modes while maintaining play of existing screen projection content.

Description

A display device and a method for switching projection modes Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for switching projection modes. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, communication terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] Display devices can also establish screen mirroring connections with terminal devices via communication methods such as wireless LAN, and obtain screen mirroring data from the terminal devices based on specific screen mirroring protocols to display the screen mirrored content from the terminal devices. The screen mirroring function of the display device is implemented based on Activity components, with each screen mirroring function corresponding to an independent Activity. When an Activity exits the foreground or is destroyed, the playback controls that depend on the Activity are destroyed, resulting in interrupted playback content and a degraded user experience. Summary of the Invention

[0004] This application provides a display device and a method for switching projection modes to solve the problem of interrupted playback of projection content when switching projection modes.

[0005] In a first aspect, this application provides a display device, including a display, a communicator, and a controller. The display is configured to display a projection interface, which includes a playback control container and an interface component container, wherein the display layer of the interface component container is higher than that of the playback control container. The communicator is configured to establish a projection connection with a terminal device. The controller is configured to execute the following program steps:

[0006] When the display shows the screen projection interface in the first screen projection mode, a switching command for switching the screen projection mode is received; in the first screen projection mode, the playback control container includes a playback control, which is used to play the screen projection data; the interface component container includes a first interface component of the first screen projection mode, which includes an interactive control associated with the first screen projection mode, and the interactive control is used to perform playback control on the screen projection data.

[0007] In response to the switching instruction, the first interface component is removed from the interface component container;

[0008] Create a second interface component for the second screen mirroring mode;

[0009] Create the interactive controls associated with the second screen mirroring mode in the second interface component;

[0010] Add the second interface component to the interface component container.

[0011] Secondly, this application provides a display device, including a display, a communicator, and a controller. The display is configured to display a projection interface. The communicator is configured to establish a projection connection with a terminal device. The controller is configured to execute the following program steps:

[0012] When the display shows the screen projection interface in the first screen projection mode, a switching command for switching the screen projection mode is received; in the first screen projection mode, the screen projection interface includes a playback control and an interactive control associated with the first screen projection mode, the playback control is used to play the screen projection data, the interactive control is used to perform playback control on the screen projection data, the playback control is located at a first display level, the interactive control is located at a second display level, and the second display level is higher than the first display level;

[0013] In response to the switching command, the interactive controls associated with the first projection mode are removed from the second display layer;

[0014] Create the interactive controls associated with the second projection mode in the second display layer.

[0015] Secondly, this application also provides a method for switching projection modes, applied to the aforementioned display device, the method comprising:

[0016] When the display shows the screen projection interface in the first screen projection mode, a switching instruction for switching the screen projection mode is received; in the first screen projection mode, the playback control container includes a playback control, which is used to play the screen projection data; the interface component container includes a first interface component of the first screen projection mode, which includes an interactive control associated with the first screen projection mode, and the interactive control is used to perform playback control on the screen projection data.

[0017] In response to the switching instruction, the first interface component is removed from the interface component container;

[0018] Create a second interface component for the second screen mirroring mode;

[0019] Create the interactive controls associated with the second screen mirroring mode in the second interface component;

[0020] Add the second interface component to the interface component container.

[0021] As can be seen from the above technical solutions, this application provides a display device and a method for switching projection modes. The method allows receiving a switching command for switching projection modes when the display shows the projection interface in a first projection mode. In the first projection mode, the playback control container includes playback controls, and the interface component container includes a first interface component for the first projection mode. The first interface component includes interactive controls associated with the first projection mode. In response to the switching command, the first interface component is removed from the interface component container, a second interface component for the second projection mode is created, interactive controls associated with the second projection mode are created in the second interface component, and the second interface component is added to the interface component container. This method can logically layer the view controls, separating the playback controls and interactive controls, and enabling the switching of multiple projection modes while maintaining the playback of existing projection content. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application;

[0024] Figure 2 is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0025] Figure 3 is a schematic diagram of the hardware configuration of the control device provided in some embodiments of this application;

[0026] Figure 4 is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0027] Figure 5 is a schematic diagram of screen mirroring provided in some embodiments of this application;

[0028] Figure 6 is a schematic diagram of push screen projection provided in some embodiments of this application;

[0029] Figure 7 is a schematic diagram of a multi-channel screen projection interface provided in some embodiments of this application;

[0030] Figure 8 is a schematic diagram of the screen projection interface provided in some embodiments of this application for single-channel push screen projection;

[0031] Figure 9 is a schematic diagram of the screen projection interface provided in some embodiments of this application for single-channel mirroring.

[0032] Figure 10 is a schematic diagram of the projection interface for dual-channel movie projection provided in some embodiments of this application;

[0033] Figure 11 is a schematic diagram of the screen mirroring interface for four-way game screen mirroring provided in some embodiments of this application;

[0034] Figure 12 is a schematic diagram of the HDMI conference projection interface provided in some embodiments of this application;

[0035] Figure 13 is a schematic diagram of the floating projection interface provided in some embodiments of this application;

[0036] Figure 14 is a schematic diagram of the Activity root layout for different screen mirroring modes provided in some embodiments of this application;

[0037] Figure 15 is a diagram of the Activity root layout architecture corresponding to the screen projection interface provided in some embodiments of this application;

[0038] Figure 16 is a schematic diagram of the Activity root layout when switching screen mirroring modes according to some embodiments of this application;

[0039] Figure 17 is a flowchart illustrating the display of the projection interface according to the first projection mode provided in some embodiments of this application;

[0040] Figure 18 is a flowchart illustrating the screen mirroring mode switching method provided in some embodiments of this application;

[0041] Figure 19 is a schematic diagram of the process of updating the playback control in the playback control container according to some embodiments of this application;

[0042] Figure 20 is a schematic diagram of the root layout of a single-path push screen projection Fragment provided in some embodiments of this application;

[0043] Figure 21 is a root layout diagram of removing a single-path push screen projection Fragment according to some embodiments of this application;

[0044] Figure 22 is a root layout diagram of adding a dual-channel movie projection Fragment according to some embodiments of this application;

[0045] Figure 23 is a root layout diagram of removing the screen casting guide view and adding playback controls according to some embodiments of this application;

[0046] Figure 24 is a root layout diagram of removing playback controls and adding a screen casting guide view provided in some embodiments of this application. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of the exemplary embodiments of this application clearer, the technical solutions in the exemplary embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0048] Based on the exemplary embodiments shown in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can constitute a complete technical solution on its own.

[0049] It should be understood that the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate, for example, to allow implementation in orders other than those given in the embodiments illustrated or described in this application.

[0050] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0051] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figures 1 and 2 show a specific implementation of the display device of this application.

[0052] Figure 1 is a schematic diagram of the operation scenario between the display device and the control device according to the embodiment. As shown in Figure 1, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0053] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0054] Figure 3 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in Figure 3, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0055] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0056] In some embodiments, the display device 200 may receive instructions not through the aforementioned smart device or control device, but through touch or gestures.

[0057] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0058] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0059] As shown in Figure 2, the display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a communication device interface 280.

[0060] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0061] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0062] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0063] The audio output interface 270 is used to output audio signals to other devices for audio playback. In some embodiments, the display device 200 has a built-in speaker, and the audio output interface 270 can input audio signals to the speaker for audio playback. In other embodiments, the display device 200 can connect to external audio devices such as amplifiers, speakers, or loudspeakers via the audio output interface 270, thereby inputting audio signals to the external audio devices for audio playback.

[0064] The audio output interface 270 may include, but is not limited to, one or more of the following: RCA port, clip-on port, SPDIF port, and headphone port. It may also be a composite output interface formed by multiple of the above interfaces.

[0065] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0066] The communication device interface 280 can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0067] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0068] Device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0069] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0070] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0071] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0072] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory), a ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc.

[0073] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0074] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0075] As shown in Figure 4, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Library Layer"), and the kernel layer.

[0076] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0077] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0078] As shown in Figure 4, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services for system services or applications; PackageManager, which retrieves various information related to application packages currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0079] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0080] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0081] In some embodiments, the kernel layer is a layer between hardware and software. As shown in Figure 4, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0082] After establishing a communication connection with the terminal device 500, the aforementioned display device 200 can establish a projection connection channel and transmit projection data based on the projection connection, so that the display device 200 can display the projection screen of the terminal device 500. In some embodiments, in order to establish a projection connection, the user can send a projection connection request through the terminal device 500 and send the projection connection request to the display device 200 via a WiFi network. The display device 200 then completes the transmission protocol configuration according to the projection connection request, thereby establishing a transmission channel for projection data with the terminal device 500.

[0083] The display device 200 can also establish a projection connection with the terminal device 500 through different connection methods. For example, when the display device 200 and the terminal device 500 are connected to the same wireless local area network, a projection connection can be established based on the WiFi network. As another example, when both the display device 200 and the terminal device 500 are equipped with NFC (Near Field Communication) components, a projection connection can be established through the NFC components. Obviously, the display device 200 and the terminal device 500 can also use other wired or wireless connection methods to establish a projection connection, such as RF radio frequency connection, infrared connection, cellular network, and other connection methods that those skilled in the art can conceive of based on the connection methods provided in the above embodiments.

[0084] After establishing a screen mirroring connection, the display device 200 can receive screen mirroring-related data from the terminal device 500 through the screen mirroring data channel, thereby playing the screen mirroring-related content on the display device 200. Under different screen mirroring data transmission protocols, the form of screen mirroring data obtained by the display device 200 varies. For example, the display device 200 and the terminal device 500 can establish a screen mirroring connection through protocols such as the Digital Living Network Alliance (DLNA) protocol, Miracast protocol, AirPlay push protocol, WiDi screen mirroring, NFC mirroring, and LeBao screen mirroring.

[0085] DLNA is a protocol used to enable media resource sharing between devices. This protocol utilizes network technology (wired or wireless) to interconnect various devices, exchanging data through standard protocols to allow media resources to be shared between them. Based on the UPnP protocol, DLNA enables devices to discover and control each other, achieving seamless transmission and sharing of media resources. DLNA supports various devices, including televisions, audio equipment, mobile phones, and computers, allowing users to seamlessly switch and share media content across different devices.

[0086] The Miracast protocol is a wireless display standard developed by the Wi-Fi Alliance, based on Wi-Fi Direct. The Miracast screen mirroring protocol is compatible with Android devices, meaning Android devices can share video feeds via Miracast. Android smart devices running Android 5.0 and above have the Miracast protocol built-in, allowing for direct wireless screen mirroring between the mirroring device and the receiving device's Wi-Fi network card without installing any software. Furthermore, Miracast screen mirroring supports simultaneous audio and video transmission.

[0087] AirPlay is a wireless playback technology developed by Apple, suitable for wireless screen mirroring on iOS and Mac systems. Apple devices have built-in AirPlay mirroring functionality. When used with a screen mirroring device that supports AirPlay server service, the effect is clear and stable, and the protocol includes a built-in screen mirroring code. However, the Apple device and the screen mirroring device must be on the same local area network (same network segment) and cannot be used across network segments or VLANs.

[0088] WiDi screen mirroring is a wireless playback technology spearheaded by Intel, based on WiFi Direct technology. Windows 8 / 10 / 11 laptops natively support WiDi screen mirroring, allowing direct screen mirroring without installing any software, and also support USB reverse control functionality.

[0089] In some embodiments, after the display device 200 establishes a screen projection connection with the terminal device 500, screen projection data can be transmitted through mirroring mode and push mode. Mirroring mode refers to the display device 200 synchronously displaying the screen content displayed by the terminal device 500. For example, as shown in Figure 5, the display device 200 displays the main interface of the terminal device 500, and when the user performs an interactive operation on the terminal device 500, causing changes in the main interface content, the content displayed on the display device 200 also changes accordingly. Therefore, the terminal device 500 can generate a video-based screen projection data stream based on the displayed content and send the video-based data stream to the display device 200 for display.

[0090] Push mode refers to the display device 200 accessing a network link pushed by the terminal device 500 to obtain the corresponding screen projection. For example, as shown in Figure 6, when the terminal device 500 is playing video media, a screen projection control is provided in the upper right corner of the playback interface. After the user clicks the screen projection control and selects the display device 200 as the device to display the screen projection, the terminal device 500 can send the URL address of the currently playing video media to the display device 200. After receiving the URL address, the display device 200 accesses the URL address to obtain the video media data and plays the video media.

[0091] Among the screen mirroring protocols supported by display device 200 and terminal device 500, some protocols are based on mirroring mode, while others are based on push mode. For example, under the DLNA protocol, display device 200 can obtain the link address of a resource in terminal device 500 through the screen mirroring data channel, and then obtain media asset content data by accessing that link address, thereby playing the media asset data. Simultaneously, display device 200 can also obtain control commands sent by terminal device 500 through the screen mirroring data channel while playing media asset data, such as fast forward, pause, and stop screen mirroring. For example, after establishing a connection through the communication protocol, terminal device 500 (such as a mobile phone) and display device 200 will negotiate device functions and network conditions to select a suitable audio-visual transmission format. After establishing the audio-visual streaming connection protocol (Session), a series of Real-Time Streaming Protocol (RTSP) control commands are then used to control the playback and termination of the audio-visual streaming.

[0092] Under other screen mirroring protocols such as Miracast, AirPlay, NFC mirroring, and LeBao screen mirroring, display device 200 can directly obtain video data streams from terminal device 500. This video data stream can be the video data stream corresponding to the final display screen of the terminal device 500's display unit; that is, the video data stream includes media content, UI interface, and other video content that can be displayed on the display unit of the terminal device 500. Alternatively, the video data stream can simply be the video data that can be obtained from the terminal device 500, such as currently playing media video data. In this case, terminal device 500 can act as a signal source for display device 200. Display device 200 can continuously obtain video data through the screen mirroring data channel and display it in real time on monitor 260, achieving a synchronized display effect with terminal device 500.

[0093] It should be noted that the above-mentioned screen mirroring protocol can not only obtain the video data stream from the terminal device 500, but also the audio data stream from the terminal device 500, so that the video data and audio data can be sent to the display device 200 simultaneously, enabling the display device 200 to play the video and audio synchronously.

[0094] Terminal device 500 can obtain different screen mirroring data based on different screen mirroring protocols. For example, for system applications or screen mirroring directly at the system level, terminal device 500 can establish a screen mirroring data channel using Miracast, AirPlay, or WiDi screen mirroring protocols. Since the Miracast and AirPlay screen mirroring protocols require system-level application permissions, they are only applicable to system applications, or for display devices 200 and terminal device 500 from the same manufacturer to establish a screen mirroring connection directly through built-in rules in the operating system.

[0095] The display device 200 can establish a projection connection with the terminal device 500 based on any of the projection methods provided in the above embodiments. In some embodiments, the display device 200 can also establish projection connections with multiple communication terminals through one or more of the above projection methods. For example, the display device 200 can simultaneously establish projection connections with the first terminal device 510 and the second terminal device 520, and divide the display screen into display areas for displaying the projection screen shared by the first terminal device 510 and the second terminal device 520 respectively.

[0096] In order to display the shared projection screen of multiple terminal devices 500 on the display device 200, in some embodiments, when the display device 200 establishes a projection connection with multiple terminal devices 500, the display device 200 can display a multi-projection interface, which may include multiple projection windows. A projection window is used to display the projection screen of the corresponding terminal device 500 under a projection connection channel. For example, as shown in Figure 7, the multi-projection interface may include two projection windows, namely a first projection window and a second projection window. The first projection window is used to display the projection screen of the first terminal device 510; the second projection window is used to display the projection screen of the second terminal device 520.

[0097] In some embodiments, when displaying the projection interface, the display device 200 displays a playback view for playing projection data, which displays the projection content. It also displays a playback control interaction view in the projection interface, such as playback control buttons (full screen, fast forward, rewind, play / pause, mute / unmute, close), a progress bar, and a title. Users can perform interactive operations based on the playback control interaction view to input control commands and control the display device 200 to execute interactive responses.

[0098] In some embodiments, to meet different usage scenarios, the display device 200 supports multiple screen casting modes (screen casting functions), including single-channel push screen casting, four-channel game screen casting, HDMI conference screen casting, dual-channel movie screen casting, split-screen movie screen casting, floating screen casting, and single-channel mirror screen casting. For example, as shown in Figure 8, in the single-channel push screen casting mode, the display device 200 can receive a URL address sent by the terminal device 500, access the URL address to obtain video media data, and play the video media data. As shown in Figure 9, in the single-channel mirror screen casting mode, the display device 200 can receive and display the screen casting data stream sent by the terminal device 500. As shown in Figure 10, in the dual-channel movie screen casting mode, two terminal devices 500 can simultaneously cast video data to the display device 200 for split-screen display, allowing users to watch different videos or content simultaneously. As shown in Figure 11, in the four-way game projection mode, four terminal devices 500 can simultaneously project their game screens onto the display device 200, facilitating collaboration or competition among users. As shown in Figure 12, in the HDMI conference projection mode, terminal devices 500 can project their screen content onto the display device 200 via the HDMI interface for presentations or meetings. As shown in Figure 13, in the floating projection mode, terminal devices 500 can project fitness demonstrations or instructional videos onto the display device 200 screen as a floating window, allowing users to exercise while watching video content.

[0099] In some embodiments, the display device 200 can switch between multiple projection modes. For example, when a user wants to watch a movie, they can control the display device 200 to activate single-channel push projection mode based on a specific interaction strategy. In single-channel push projection mode, the user can project and operate the device, causing the display device 200 to play the movie. If the user also wants to watch an animated film, they can control the display device 200 to switch from single-channel push projection to dual-channel viewing projection mode. In dual-channel viewing projection mode, the user can project and operate the device, causing the display device 200 to play both the movie and the animated film simultaneously.

[0100] In some embodiments, the screen projection mode of the display device 200 is implemented based on Activity. Each screen projection mode corresponds to an independent Activity. Activity is a key component in the display device 200 system, used for interface display, user interaction and business logic processing. Various view controls, such as SurfaceView, TextureView and other playback controls for playing videos, playback control buttons, progress bars, titles and other interactive controls, are set in the root layout of the Activity to present the corresponding screen projection interface.

[0101] Playback controls depend on the Activity for their existence. When the Activity leaves the foreground or is destroyed, the playback controls will also be destroyed. In other words, when the Activity leaves the foreground or is destroyed, playback controls such as SurfaceView and TextureView created within the Activity will also be destroyed, causing playback content within the playback controls to be interrupted.

[0102] For example, as shown in Figure 14, the interface for single-channel push-to-cast corresponds to an Activity, whose root layout contains view controls such as a video playback control, title, and progress bar. The interface for dual-channel viewing-to-cast corresponds to an Activity, whose root layout contains view controls such as two video playback controls, guide information, and operation controls. When the display device 200 switches from single-channel push-to-cast to dual-channel viewing-to-cast, the Activity corresponding to single-channel push-to-cast will exit the foreground or be destroyed. The video playback control dependent on this Activity will be destroyed, and the player bound to the video playback control will also be released. This causes the video content to be unable to continue playing in the dual-channel viewing-to-cast interface and needs to be recast. The video will then be replayed based on the new video playback control in the Activity corresponding to dual-channel viewing-to-cast before it can be viewed in the dual-channel viewing-to-cast interface.

[0103] In some embodiments, this application provides an Activity root layout architecture for a screen mirroring interface, as shown in Figure 15, which is a diagram of the Activity root layout architecture corresponding to the screen mirroring interface provided in this application embodiment. In this embodiment, the Activity root layout is divided into two logical layers: a playback control container for placing playback controls, and a UI component container for placing UI components, i.e., Fragments. A Fragment is a UI fragment that can be embedded in an Activity, used to implement functional logic control and the layout of the playback control view. In terms of display hierarchy, the display hierarchy of the Fragment container is higher than that of the playback control container.

[0104] Based on the Activity root layout architecture in the above embodiments, each casting mode corresponds to a Fragment. The Activity can listen for the start or switch of casting modes through broadcasts (Intents), StartActivity, EventBus, etc. When a start or switch message is received, the Activity can create the Fragment corresponding to the casting mode and check whether the Fragment container already contains a Fragment. If a Fragment exists, the Fragment corresponding to the previous casting mode is removed from the Fragment container, and the Fragment corresponding to the current casting mode is added. If no Fragment exists, the Fragment corresponding to the current casting mode is directly added to the Fragment container.

[0105] When a Fragment is embedded within an Activity, the Activity can provide the Fragment with an interface to manipulate the layout of the playback controls within the playback control container. This allows the Fragment to perform operations on the playback controls, including retrieving, adding, and removing them, and setting their layout parameters (size, position, etc.). This is achieved by defining a playback control interface within the Activity, which includes methods for performing operations on the playback controls within the container. After embedding a Fragment within the Activity, the Activity can configure this playback control interface for the Fragment, allowing the Fragment to call the defined methods within the interface to perform operations such as querying, adding, deleting, and adjusting the layout parameters of the playback controls.

[0106] Figure 16 shows a schematic diagram of the Activity root layout during screen mirroring mode switching provided in this embodiment. After the Fragment is loaded and created, it creates the interactive controls required for the current screen mirroring mode, such as progress bars, titles, and playback control buttons, in the root layout of the Fragment according to the preset root layout data corresponding to the current screen mirroring mode. At the same time, it performs operations such as adding, deleting, and adjusting the layout parameters of the playback controls in the playback control container through the playback control interface provided by the Activity for manipulating playback controls. For example, it removes playback controls that are not needed in the current screen mirroring mode, adds playback controls that are needed in the current screen mirroring mode, and adjusts the display position of the playback controls. In other words, the Fragment does not remove the playback controls that need to be retained in the previous screen mirroring mode, and adjusts the layout of the playback controls and interactive controls according to its preset functional logic.

[0107] In the above embodiments, in the scenario of switching the screen casting mode, the display device 200 can logically layer the view controls, separate the playback controls and interactive controls, and move the interactive controls and logic to the Fragment. The screen casting mode can be switched through the Fragment without switching the Activity, and multiple screen casting modes can be switched while maintaining the existing screen casting playback.

[0108] Based on the Activity root layout architecture corresponding to the screen mirroring interface in the above embodiments, some embodiments of this application provide a screen mirroring mode switching method for switching between multiple screen mirroring modes while maintaining existing screen mirroring playback. This screen mirroring mode switching method can be applied to the display device 200 provided in the above embodiments. To satisfy the implementation of the screen mirroring mode switching method, the display device 200 should include at least a display 260, a communicator 220, and a controller 250. The display 260 is configured to display the screen mirroring interface. The communicator 220 is configured to establish a screen mirroring connection with the terminal device 500. The controller 250 is configured to execute the program steps corresponding to the screen mirroring mode switching method.

[0109] For ease of understanding, the screen mirroring mode before switching is referred to as the first screen mirroring mode, and the screen mirroring mode after switching is referred to as the second screen mirroring mode.

[0110] The display device 200 can display the projection interface according to the first projection mode. Figure 17 shows a flowchart illustrating the display of the projection interface according to the first projection mode provided in this embodiment, including the following steps:

[0111] S1701: In response to the first screen mirroring command, create a screen mirroring interface.

[0112] The display device 200 can respond to the first screen casting command and create a screen casting interface, that is, create an Activity corresponding to the screen casting interface to play screen casting related content in the screen casting interface.

[0113] In some embodiments, the first screen casting instruction may be input by the terminal device 500 or by the user, or it may be generated when the terminal device 500 sends screen casting data. That is, after the terminal device 500 and the display device 200 establish a screen casting connection, the display device 200 generates the first screen casting instruction when it receives the screen casting data sent by the terminal device 500 through the screen casting data channel.

[0114] S1702: Create a playback control container and a UI component container in the screen mirroring interface.

[0115] After creating the Activity for the corresponding screen mirroring interface, you can create a playback control container and a Fragment container in the root layout of the Activity. The playback control container is used to place the playback control, and the Fragment container is used to place the Fragment. The display layer of the Fragment container is higher than that of the playback control container, thus dividing the Activity's root layout into two logical layers.

[0116] S1703: Create the first interface component for the first screen mirroring mode and add the first interface component to the interface component container.

[0117] Once the Activity corresponding to the screen mirroring interface is created, the Activity can create the first interface component of the first screen mirroring mode, which is the Fragment corresponding to the first screen mirroring mode, and add the first interface component to the Fragment container.

[0118] In some embodiments, the first projection mode can be the current projection mode of the display device 200. That is, after the Activity corresponding to the projection interface is created, the Activity can detect the current projection mode and use the current projection mode as the first projection mode. The first projection mode can also be set according to the number of projection channels currently receiving projection data on the display device 200 or the media asset type of the received projection data. For example, if the display device 200 is currently projecting on one channel and the media asset type of the projection data is a video URL, then the projection mode is set to single-channel push projection.

[0119] S1704: Create the interactive control associated with the first screen projection mode in the first interface component.

[0120] After the first interface component is created, it can obtain the preset root layout data of the first interface component and create the interactive controls associated with the first projection mode in its own root layout based on the root layout data. The root layout data of the first interface component includes the playback control data of the interactive controls associated with the first projection mode, including the position coordinates and size of interactive controls such as progress bars and titles.

[0121] S1705: Create a playback control in the playback control container.

[0122] While creating interactive controls, the first interface component can also obtain the control layout data for the first projection mode and call the playback control interface provided by the Activity. It then calls the operation methods defined in the playback control interface for adding playback controls and setting their layout parameters. This controls the Activity to create a playback control within the playback control container based on the control layout data. The received projection data is then played through this playback control, thereby displaying the projection interface on the monitor 260 according to the first projection mode. The control layout data for the first projection mode includes the playback control data associated with the first projection mode, including the position coordinates and size of the playback control.

[0123] When the display 260 shows the projection interface in the first projection mode, the projection mode can be switched. Figure 18 shows a flowchart of the projection mode switching method provided in this embodiment, including the following steps:

[0124] S1801: When the display 260 displays the projection interface in the first projection mode, receive a switching command for switching projection modes.

[0125] In some embodiments, the switching command can be input by the terminal device 500 or by the user. For example, the user can invoke the screen mirroring mode menu options provided by the display device 200, which includes various different screen mirroring modes. The user can select any screen mirroring mode from the menu options through interactive methods such as touch screen or remote control to input a switching command for switching screen mirroring modes. The switching message can also be generated when certain functions are executed. For example, if the display device 200 is currently performing single-channel screen mirroring, when a connection event is received establishing a screen mirroring connection between the display device 200 and the terminal device 500, a switching operation from single-channel screen mirroring to dual-channel screen mirroring is triggered, thereby generating a screen mirroring mode switching message.

[0126] S1802: In response to the switching instruction, remove the first UI component from the UI component container.

[0127] The Activity corresponding to the screen mirroring interface can respond to the switching command used to switch screen mirroring modes, and remove the first interface component in the Fragment container. At this time, the related interactive controls created in the first interface component will also be removed.

[0128] S1803: Create a second interface component for the second screen mirroring mode and add the second interface component to the interface component container.

[0129] After removing the first interface component from the Fragment container, the Activity corresponding to the casting interface can create a second interface component for the second casting mode, that is, a Fragment corresponding to the second casting mode, and add the second interface component to the Fragment container.

[0130] S1804: Create interactive controls associated with the second screen mirroring mode in the second interface component.

[0131] After the second interface component is created, it can obtain the preset root layout data of the second interface component and create the interactive controls associated with the second projection mode in its own root layout based on the root layout data. The root layout data of the second interface component includes the playback control data of the interactive controls associated with the second projection mode, including the position coordinates and size of interactive controls such as guidance information and playback control buttons, thereby updating the relevant content of the interactive controls in the projection interface.

[0132] S1805: Update the playback control in the playback control container.

[0133] The second interface component can obtain the control layout data of the second screen casting mode and call the playback control interface provided by the Activity of the corresponding screen casting interface. It then calls the operation methods defined in the playback control interface for adding or removing playback controls, setting the layout parameters of the playback controls, etc., controlling the Activity to update the playback controls in the playback control container according to the control layout data, thereby updating the relevant content of the playback controls in the screen casting interface. The control layout data of the second screen casting mode includes the playback control data of the playback controls associated with the second screen casting mode.

[0134] Updating the playback controls within the playback control container includes updating the number of playback controls and updating the layout of the playback controls. Figure 19 shows a flowchart illustrating the process of updating playback controls within the playback control container according to an embodiment of this application, including the following steps:

[0135] S1901: Read the number of playback controls and the layout parameters of the playback controls in the control layout data for the second screen casting mode.

[0136] The layout parameters of the playback controls include their display size and position. The number of playback controls in the second casting mode indicates the number of casting paths supported by that mode. For example, dual-path movie casting corresponds to two playback controls, while single-path push casting corresponds to one playback control.

[0137] S1902: Detect the number of screen projection channels.

[0138] The number of projection channels refers to the number of channels through which the display device 200 currently receives projection data.

[0139] S1903: Compare the number of playback controls in the second screen casting mode with the number of screen casting channels. If the number of screen casting channels is greater than or equal to the number of playback controls, then execute steps S1904 and S1906. If the number of screen casting channels is less than the number of playback controls, then execute steps S1905 and S1906.

[0140] S1904: Remove or create playback controls in the playback control container based on the number of playback controls.

[0141] If the number of projection channels is greater than or equal to the number of playback controls in the control layout data, the second interface component can call the operation methods defined in the playback control interface for adding or removing playback controls, and remove or create playback controls in the playback control container according to the number of playback controls.

[0142] For example, if the projection mode of display device 200 is dual-channel projection, and one projection channel is interrupted, a projection mode switching operation is triggered to switch from dual-channel projection to single-channel push projection. When executing the above projection mode switching method, it will detect that the current projection channel number is 1, which is equal to the number of playback controls for single-channel push projection. Then, the playback control corresponding to the interrupted projection channel will be removed from the playback control container.

[0143] S1905: Determine the target position based on the layout parameters, and create a projection guide view at the target position in the second interface component.

[0144] If the number of casting channels is less than the number of playback controls in the control layout data, the second interface component can determine the target position based on the layout parameters and create casting guide views at the target position in the second interface component. The target position is the display position of the playback controls within the playback control container, the casting guide views are used to display casting guidance information, and the number of casting guide views is the difference between the number of playback controls and the number of casting channels.

[0145] S1906: Set the display size and position of the playback control in the playback control container according to the layout parameters.

[0146] After updating the number of playback controls or creating a projection guide view, the second interface component can call the operation methods defined in the playback control interface to set the layout parameters (size, position, etc.) of the playback controls. Based on the layout parameters, the display size and position of the playback controls in the playback control container are set, so that the layout of the playback controls in the playback control container meets the layout requirements of the second projection mode.

[0147] It is understood that in the above embodiments, for playback controls that are not removed from the playback control container after switching to the second screen casting mode, it is only necessary to change the display size and display position of the playback control to meet the layout requirements of the second screen casting mode while maintaining the existing screen casting to continue playing.

[0148] In some embodiments, for the projection interface presented after executing step S1905, upon receiving a second projection instruction, the second interface component can respond to the second projection instruction by removing the projection guide view located at the target position in the second interface component. Then, through the playback control interface provided by the Activity of the corresponding projection interface, the Activity is controlled to create a new playback control at the target position in the playback control container, and the newly received projection data is played through the new playback control.

[0149] The second screen mirroring instruction can be generated when screen mirroring data is received from the new terminal device 500, or it can be input by the new terminal device 500 or by the user.

[0150] In other words, when the number of projection channels on display device 200 is less than the number of playback controls corresponding to the second projection mode, a projection guide view is displayed in the display area used for playing projection data. When a new projection push is received, the projection guide view is removed, and playback controls are displayed in the display area used for playing projection data to play the projection data.

[0151] For example, if the projection mode of display device 200 is single-channel projection, the user can switch from single-channel to dual-channel projection via the projection mode menu option on display device 200. When executing the above projection mode switching method, it will detect that the number of projection channels is 1, which is less than the number of playback controls for two projection channels. Therefore, based on the control layout data, the display size and position of the existing playback controls are set in the playback control container, so that they are displayed in the display area of ​​the first projection channel. Simultaneously, based on the control layout data of the second projection mode, a projection guide view is created in the root layout of the second interface component, and the display size and position of this projection guide view are set, so that it is displayed in the display area of ​​the second projection channel.

[0152] When a new screen mirroring push is received, the screen mirroring guide view is removed from the second interface component, and a new playback control is created in the playback control container. The display size and display position of the playback control are set so that it is displayed in the display area of ​​the second screen mirroring.

[0153] In some embodiments, when the display 260 displays the projection interface in the second projection mode, the Activity corresponding to the projection interface can receive a full-screen instruction for the full-screen target playback control. This full-screen instruction triggers a projection switching operation to switch to the single-channel projection mode. The Activity can remove the second interface component from the Fragment container, create a single-channel interface component for the single-channel projection mode (i.e., a Fragment corresponding to the single-channel projection mode), and add the single-channel interface component to the Fragment container.

[0154] After the single-path UI component is created, interactive controls associated with the single-path projection mode are created in the root layout of the single-path UI component itself, based on the root layout data. Simultaneously, the playback control interface provided by Activity can be called to control the Activity to remove non-target playback controls from the playback control container, interrupt the projection corresponding to the non-target playback controls, and set the display size and position of the target playback control to control the target playback control to display in full screen, thus playing the projection data in full screen through the target playback control. Here, non-target playback controls refer to playback controls other than the target playback control.

[0155] The following describes the screen casting mode switching method provided in this application embodiment, taking the switching from single-channel push screen casting to dual-channel movie viewing screen casting as an example. The specific steps include the following:

[0156] When the display device 200 receives the projection data sent by the terminal device 500 through the projection data channel, it creates an Activity corresponding to the projection interface. When creating the Activity, a playback control container and a Fragment container can be created in the root layout of the Activity. The display layer of the Fragment container is higher than that of the playback control container, so as to construct the Activity root layout architecture diagram shown in Figure 15.

[0157] The Activity creates a Fragment for single-path push screen projection and loads it into the Fragment container.

[0158] When a single-path push screen projection Fragment is created, it loads interactive controls, such as the progress bar and title as shown in Figure 20, into its own root layout based on its own root layout data. At the same time, through the playback control interface provided by the Activity, the Activity is controlled to create a playback control in the playback control container, and the currently received screen projection data is rendered and played on that playback control.

[0159] As shown in Figure 21, when the Activity receives the switching message to switch to dual-channel movie projection, it removes the single-channel push projection Fragment from the Fragment container. At this time, the interactive controls created in the single-channel push projection Fragment will also be removed.

[0160] The Activity creates a Fragment for dual-channel movie projection and loads it into the Fragment container.

[0161] When a dual-channel movie casting Fragment is created, it loads interactive controls into its own root layout based on its own root layout data. Examples include the guide information and operation controls shown in Figure 22. Simultaneously, through the playback control interface provided by the Activity, the Activity is controlled to set the display size and position of the playback control created under single-channel push casting, moving the playback control to the playback position of the first channel in the dual-channel movie casting layout. At the playback position of the second channel, a second-channel casting guide view is created in the Fragment's root layout to guide the user through the second channel casting.

[0162] As shown in Figure 23, upon receiving the projection data from the second projection stream, the dual-stream projection Fragment uses the playback control interface provided by the Activity to control the Activity to create another playback control within the playback control container. This playback control is then used to render and play the projection data from the second projection stream. Simultaneously, the display size and position of this playback control are set, moving it to the playback position of the second projection stream. The second projection guide view, located at the playback position of the second projection stream, is then removed from the root layout of the Fragment. This achieves the switching from single-stream push projection to dual-stream projection.

[0163] As shown in Figure 24, in dual-channel movie casting, when the first channel finishes playing, the Fragment can use the playback control interface provided by the Activity to control the Activity to remove the corresponding playback control of the first channel in the playback control container, and create and display the casting guide view at the playback position of the first channel in the root layout of the Fragment.

[0164] In the dual-channel video projection setup shown in Figure 23, when a full-screen command is received for one of the projection channels, a switching operation to single-channel push projection is triggered. The Activity removes the dual-channel video projection Fragment from the Fragment container, creates a single-channel push projection Fragment, and loads it into the Fragment container. The single-channel push projection Fragment creates the interactive controls associated with single-channel push projection in its own root layout and controls the Activity to remove the playback controls corresponding to the non-full-screen projection from the playback control container, interrupting the non-full-screen projection. Simultaneously, it sets the display size and position of the playback controls for the full-screen projection to achieve full-screen display. The Activity's root layout is restored to the root layout architecture shown in Figure 20. This achieves the switching from dual-channel video projection to single-channel push projection.

[0165] In the above embodiments, the lifecycle of the casting mode is decoupled from the lifecycle of the Activity, thus removing the binding relationship between a casting mode and an Activity. By separating the playback control and managing it independently by the Activity, each casting mode becomes a functional component that can be loaded and removed independently by the Activity. Operations can be performed only through the interfaces provided by the Activity, ensuring that the Activity does not need to exit when switching casting modes, and guaranteeing that the playback control that depends on the Activity remains available.

[0166] It's important to note that layering the Activity's root layout and converting the casting mode into a Fragment component are one, but not the only, way to implement casting mode switching. Layering ensures that the playback controls are always displayed at a lower level than the interactive controls, preventing the playback content from obscuring the progress bar, title, or other interactive controls. Fragment components are used because they are reusable UI components supported by the native system and offer comprehensive support for various application interface capabilities. Alternatively, casting mode switching can be achieved by using custom views to represent different casting modes as components.

[0167] In some embodiments of this application, a screen mirroring mode switching method is provided, which can be applied to the display device 200 provided in the above embodiments. To implement the screen mirroring mode switching method, the display device 200 should include at least a display 260, a communicator 220, and a controller 250. The display 260 is configured to display a screen mirroring interface. The communicator 220 is configured to establish a screen mirroring connection with the terminal device 500. The controller 250 is configured to execute the program steps corresponding to the screen mirroring mode switching method, including the following:

[0168] In response to the first casting command, a casting interface is created, i.e., an Activity corresponding to the casting interface is created. When the display 260 is controlled to display the casting interface according to the first casting mode, the Activity of the corresponding casting interface can obtain the interface data associated with the first casting mode, and create the playback control and interactive control associated with the first casting mode in the Activity of the corresponding casting interface according to the interface data. The interface data includes the position coordinates and size of the playback control and interactive control associated with the casting mode. The playback control is used to play the casting data, and the interactive control is used to perform playback control on the casting data. The playback control is located at the first display level, and the interactive control is located at the second display level, which is higher than the first display level.

[0169] Upon receiving a switching command for switching the projection mode, in response to the switching command, interface data associated with the second projection mode can be obtained. Based on the interface data, interactive controls not associated with the second projection mode are removed from the second display layer, and interactive controls associated with the second projection mode are created in the second display layer. Additionally, playback controls not associated with the second projection mode are removed from the first display layer, and playback controls associated with the second projection mode are created in the first display layer, so that the display 260 displays the projection interface according to the second projection mode.

[0170] In this embodiment, the playback control and interactive controls are placed directly in the root layout of the Activity. The display layer of the interactive controls is set higher than that of the playback control. Through view control layer control, the display layer of the playback control is always lower than that of interactive controls such as the progress bar and title. When switching casting modes, view controls unrelated to the current casting mode are removed, and view controls related to the current casting mode are added.

[0171] Based on the screen projection mode switching method provided in the above embodiments, some embodiments of this application also provide a display device 200, which includes a display 260, a communicator 220, and a controller 250. The display 260 is configured to display a screen projection interface, which includes a playback control container and an interface component container. The display layer of the interface component container is higher than that of the playback control container. The communicator 220 is configured to establish a screen projection connection with the terminal device 500. The controller 250 is configured to execute the following program steps:

[0172] When the display shows the screen projection interface in the first screen projection mode, a switching command for switching the screen projection mode is received; in the first screen projection mode, the playback control container includes a playback control, which is used to play the screen projection data; the interface component container includes a first interface component of the first screen projection mode, which includes an interactive control associated with the first screen projection mode, and the interactive control is used to perform playback control on the screen projection data.

[0173] In response to the switching command, remove the first UI component from the UI component container.

[0174] Create a second interface component for the second screen mirroring mode.

[0175] Create interactive controls associated with the second screen mirroring mode in the second interface component.

[0176] Add the second interface component to the interface component container.

[0177] Based on the screen projection mode switching method provided in the above embodiments, some embodiments of this application also provide a display device 200, which includes a display 260, a communicator 220, and a controller 250. The display 260 is configured to display a screen projection interface; the communicator 220 is configured to establish a screen projection connection with a terminal device 500; and the controller 250 is configured to execute the following program steps:

[0178] When the display 260 shows the projection interface in the first projection mode, it receives a switching command for switching projection modes. In the first projection mode, the projection interface includes playback controls and interactive controls associated with the first projection mode. The playback controls are used to play projection data, and the interactive controls are used to perform playback control on the projection data. The playback controls are located at the first display level, and the interactive controls are located at the second display level, which is higher than the first display level.

[0179] In response to the switching command, the interactive controls associated with the first projection mode are removed in the second display layer.

[0180] Create interactive controls associated with the second projection mode in the second display layer.

[0181] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0182] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0183] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0184] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The display is configured to display a projection interface, which includes a playback control container and an interface component container, wherein the display layer of the interface component container is higher than that of the playback control container. A communicator is configured to establish a screen projection connection with a terminal device; a controller is configured to receive a switching instruction for switching screen projection modes when the display shows the screen projection interface in a first screen projection mode; in the first screen projection mode, the playback control container includes playback controls for playing screen projection data, and the interface component container includes a first interface component for the first screen projection mode, the first interface component including interactive controls associated with the first screen projection mode, the interactive controls for performing playback control on the screen projection data; In response to the switching instruction, the first interface component is removed from the interface component container; Create a second interface component for the second screen mirroring mode; Create an interactive control associated with the second projection mode in the second interface component; add the second interface component to the interface component container.

2. The display device according to claim 1, characterized in that, The controller is also configured to: create a screen projection interface in response to a first screen projection instruction, wherein the first screen projection instruction is generated upon receiving screen projection data sent by the terminal device, or the first screen projection instruction is input by the terminal device or by the user; and create a playback control container and an interface component container in the screen projection interface; Create a first interface component for the first screen mirroring mode; create an interactive control associated with the first screen mirroring mode in the first interface component; add the first interface component to the interface component container; create a playback control in the playback control container; and play the received screen mirroring data through the playback control.

3. The display device according to claim 1, characterized in that, The controller is configured to: create interactive controls associated with the second screen projection mode in the second interface component; obtain root layout data of the second interface component, the root layout data including playback control data of the interactive controls associated with the second screen projection mode; and create interactive controls associated with the second screen projection mode based on the root layout data.

4. The display device according to claim 1, characterized in that, The controller is further configured to: acquire control layout data of the second projection mode, the control layout data including playback control data of the playback control associated with the second projection mode; and update the playback control in the playback control container according to the control layout data.

5. The display device according to claim 4, characterized in that, The controller is configured to update the playback controls in the playback control container according to the control layout data, and is also configured to: read the number of playback controls in the second projection mode from the control layout data; remove or create playback controls in the playback control container according to the number of playback controls; read the layout parameters of the playback controls from the control layout data; and set the display size and display position of the playback controls in the playback control container according to the layout parameters.

6. The display device according to claim 5, characterized in that, The controller is also configured to: detect the number of projection channels, which is the number of channels currently receiving projection data on the display device; if the number of projection channels is greater than or equal to the number of playback controls, remove or create playback controls in the playback control container according to the number of playback controls. If the number of projection channels is less than the number of playback controls, a projection guide view is created at the target position in the second interface component. The number of projection guide views is the difference between the number of playback controls and the number of projection channels, and the target position is the display position of the playback controls in the playback control container.

7. The display device according to claim 6, characterized in that, The controller is further configured to: in response to a second casting command, remove the casting guide view located at the target position in the second interface component; the second casting command is generated when casting data is received from a new terminal device, or the second casting command is input by a new terminal device or by a user; create a new playback control at the target position in the playback control container; and play the received new casting data through the new playback control.

8. The display device according to claim 1, characterized in that, The controller is also configured to: remove the second interface component from the interface component container in response to a full-screen command for full-screen display of the target playback control; and create a single-channel interface component for single-channel projection mode; Create an interactive control associated with the single-channel projection mode in the single-channel interface component; add the single-channel interface component to the interface component container; remove non-target playback controls from the playback control container, where the non-target playback controls are playback controls other than the target playback control; and control the target playback control to display in full screen.

9. A display device, characterized in that, include: The monitor is configured to display the projection interface; The communicator is configured to establish a screen mirroring connection with the terminal device; The controller is configured to: receive a switching instruction for switching the projection mode when the display shows the projection interface in the first projection mode; in the first projection mode, the projection interface includes a playback control and an interactive control associated with the first projection mode, the playback control is used to play projection data, the interactive control is used to perform playback control on the projection data, the playback control is located at a first display level, the interactive control is located at a second display level, and the second display level is higher than the first display level; In response to the switching command, the interactive control associated with the first projection mode is removed in the second display layer; and the interactive control associated with the second projection mode is created in the second display layer.

10. A method for switching screen mirroring modes, characterized in that, The device is applicable to any one of claims 1-8, the display device comprising a display, a communicator, and a controller, the display being configured to display a projection interface, the projection interface comprising a playback control container and an interface component container, the display layer of the interface component container being higher than the display layer of the playback control container; The communicator is configured to establish a screen mirroring connection with a terminal device; the method includes: when the display shows a screen mirroring interface in a first screen mirroring mode, receiving a switching instruction for switching screen mirroring modes; in the first screen mirroring mode, the playback control container includes a playback control for playing screen mirroring data, the playback control is used to play screen mirroring data, the interface component container includes a first interface component for the first screen mirroring mode, the first interface component includes an interactive control associated with the first screen mirroring mode, the interactive control is used to perform playback control on the screen mirroring data; in response to the switching instruction, removing the first interface component from the interface component container; creating a second interface component for the second screen mirroring mode; creating an interactive control associated with the second screen mirroring mode in the second interface component; and adding the second interface component to the interface component container.

Images