Display equipment and screen projection mode switching method

Abstract

The invention provides a display device and a screen projection mode switching method, and the method comprises the steps: receiving a switching instruction for switching a screen projection mode when a display displays a screen projection interface according to a first screen projection mode; wherein in the first screen projection mode, the play control container comprises a play control, the interface component container comprises a first interface component of the first screen projection mode, and the first interface component comprises an interaction control associated with the first screen projection mode. And in response to the switching instruction, removing the first interface component in the interface component container, creating a second interface component in a second screen projection mode, creating an interaction control associated with the second screen projection mode in the second interface component, and adding the second interface component to the interface component container. According to the method, the view control can be logically layered, the playing control and the interaction control are separated, and switching of multiple screen projection modes is executed while playing of existing screen projection content is kept.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for switching screen projection modes. Background Art

[0002] Display devices refer to terminal devices that can output specific display images, which can be terminal devices such as smart TVs, communication terminals, smart advertising screens, projectors, etc. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] The display device can also establish a screen projection connection relationship with the terminal device through communication methods such as wireless LAN, and obtain the screen projection data of the terminal device based on a specific screen projection protocol to display the projection screen of the terminal device through the display device. The screen projection function of the display device is implemented based on the activity component (Activity), and the screen projection interface corresponding to each screen projection function is an independent Activity. When the Activity exits the foreground or is destroyed, the playback controls that depend on the Activity will be destroyed, which will cause the playback content in the playback controls to be interrupted, reducing the user experience. Summary of the invention

[0004] The present application provides a display device and a screen projection mode switching method to solve the problem of interruption of screen projection content playback when switching the screen projection mode.

[0005] In a first aspect, the present application provides a display device, including a display, a communicator, and a controller. The display is configured to display a screen projection interface, the screen projection interface includes a playback control container and an interface component container, and the display level of the interface component container is higher than the display level of the playback control container. The communicator is configured to establish a screen projection connection with a terminal device. The controller is configured to execute the following program steps:

[0006] When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the playback control container includes a playback control, and the playback control is used to play the projection data, and the interface component container includes a first interface component of the first projection mode, and the first interface component includes an interactive control associated with the first projection mode, and the interactive control is used to perform playback control on the projection data;

[0007] In response to the switching instruction, removing the first interface component from the interface component container;

[0008] Creating a second interface component of the second screen projection mode;

[0009] Creating an interactive control associated with the second screen projection mode in the second interface component;

[0010] Add the second interface component to the interface component container.

[0011] In a second aspect, the present application provides a display device, including a display, a communicator, and a controller. The display is configured to display a screen projection interface. The communicator is configured to establish a screen projection connection with a terminal device. The controller is configured to execute the following program steps:

[0012] When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the projection interface includes a playback control and an interactive control associated with the first projection mode, the playback control is used to play the projection data, and the interactive control is used to perform playback control on the projection data, the playback control is located at a first display level, and the interactive control is located at a second display level, and the second display level is higher than the first display level;

[0013] In response to the switching instruction, removing the interactive controls associated with the first projection mode in the second display level;

[0014] Create interactive controls associated with the second screen projection mode in the second display layer.

[0015] In a second aspect, the present application further provides a method for switching a screen projection mode, which is applied to the above-mentioned display device, and the method includes:

[0016] When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the playback control container includes a playback control, and the playback control is used to play the projection data, and the interface component container includes a first interface component of the first projection mode, and the first interface component includes an interactive control associated with the first projection mode, and the interactive control is used to perform playback control on the projection data;

[0017] In response to the switching instruction, removing the first interface component from the interface component container;

[0018] Creating a second interface component of the second screen projection mode;

[0019] Creating an interactive control associated with the second screen projection mode in the second interface component;

[0020] Add the second interface component to the interface component container.

[0021] It can be seen from the above technical solution that the present application provides a display device and a method for switching the projection mode, and the method can receive a switching instruction for switching the projection mode when the display displays the projection interface according to the first projection mode. Wherein, in the first projection mode, the playback control container includes playback controls, the interface component container includes the first interface component of the first projection mode, and the first interface component includes interactive controls associated with the first projection mode. In response to the switching instruction, the first interface component is removed from the interface component container, the second interface component of the second projection mode is created, the interactive controls associated with the second projection mode are created in the second interface component, and the second interface component is added to the interface component container. The method can logically layer the view controls, separate the playback controls and the interactive controls, and realize the switching of multiple projection modes while keeping the existing projection content playing. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0024] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0025] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0026] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0027] Figure 5 A schematic diagram of mirror screen projection provided in some embodiments of the present application;

[0028] Figure 6 A schematic diagram of push screen projection provided in some embodiments of the present application;

[0029] Figure 7 A schematic diagram of a multi-screen projection interface provided in some embodiments of the present application;

[0030] Figure 8 A schematic diagram of a screen projection interface for single-channel push screen projection provided in some embodiments of the present application;

[0031] Fig. 9 A schematic diagram of a screen projection interface for single-channel mirrored screen projection provided in some embodiments of the present application;

[0032] Fig.10 A schematic diagram of a screen projection interface for dual-channel movie viewing and projection provided in some embodiments of the present application;

[0033] Fig.11 A schematic diagram of a screen projection interface for four-way game projection provided in some embodiments of the present application;

[0034] Fig.12 A schematic diagram of a screen projection interface for HDMI conference screen projection provided in some embodiments of the present application;

[0035] Fig.13 A schematic diagram of a screen projection interface for floating screen projection provided in some embodiments of the present application;

[0036] Fig.14 A schematic diagram of the root layout of Activities for different screen projection modes provided in some embodiments of the present application;

[0037] Fig.15 An Activity root layout architecture diagram corresponding to the screen projection interface provided in some embodiments of the present application;

[0038] Fig.16 A schematic diagram of the root layout of an Activity when switching the screen projection mode provided in some embodiments of the present application;

[0039] Fig.17 A schematic diagram of a process for displaying a screen projection interface according to a first screen projection mode provided in some embodiments of the present application;

[0040] Fig.18 A schematic diagram of a flow chart of a screen projection mode switching method provided in some embodiments of the present application;

[0041] Fig.19 A schematic diagram of a process of updating a play control in a play control container provided in some embodiments of the present application;

[0042] Fig. 20 A schematic diagram of the root layout for adding a single-channel push screen projection fragment provided in some embodiments of the present application;

[0043] Fig.21 A schematic diagram of the root layout for removing a single-channel push screen projection fragment provided in some embodiments of the present application;

[0044] Fig. 22 A schematic diagram of the root layout of adding a dual-channel movie viewing and projection fragment provided in some embodiments of the present application;

[0045] Fig.23A schematic diagram of a root layout for removing the screen projection guide view and adding playback controls provided in some embodiments of the present application;

[0046] Fig.24 A schematic diagram of the root layout for removing playback controls and adding a screen projection guide view provided in some embodiments of the present application. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, not all of the embodiments.

[0048] Based on the exemplary embodiments shown in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of these disclosures can also constitute a complete technical solution separately.

[0049] It should be understood that the terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to an order other than those given in the diagrams or descriptions of the embodiments of this application.

[0050] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0051] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 2 This is a specific implementation of the display device of the present application.

[0052] Figure 1 FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0053] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0054] Figure 3 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200.

[0055] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.

[0056] In some embodiments, the display device 200 may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through touch or gestures.

[0057] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0058] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0059] like Figure 2 As shown, the display device 200 includes at least one of a tuner and demodulator 210 , a communicator 220 , a detector 230 , a device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a communication device interface 280 .

[0060] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0061] The display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from the controller, and display video content, image content, and menu control interface components and user control UI interface.

[0062] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0063] The audio output interface 270 is used to output the audio signal to other devices to play the audio. In some embodiments, the display device 200 has a built-in speaker, and the audio output interface 270 can input the audio signal to the speaker to play the audio through the speaker. In other embodiments, the display device 200 can be connected to an external audio device such as an amplifier, a speaker, or a loudspeaker through the audio output interface 270, and then the audio signal can be input to the external audio device to play the audio through the external audio device.

[0064] The audio output interface 270 may include, but is not limited to, any one or more of the following interfaces: an RCA port, a butterfly clip port, an SPDIF port, and a headphone port, etc. It may also be a composite output interface formed by the above multiple interfaces.

[0065] The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0066] The communication device interface 280 may be used to receive a control signal from the control device 100 (eg, an infrared remote controller, etc.).

[0067] The detector 230 is used to collect signals from the external environment or the external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0068] The device interface 240 may include, but is not limited to, any one or more of the following interfaces: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0069] The tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0070] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0071] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0072] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a RAM (Random Access Memory, RAM), a ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0073] The user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

[0074] "User interface" is the medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is the Graphical User Interface (GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0075] like Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0076] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0077] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0078] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0079] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).

[0080] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0081] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0082] After establishing a communication connection relationship with the terminal device 500, the display device 200 can establish a screen projection connection channel, and transmit the projection data based on the screen projection connection, so that the display device 200 can display the projection screen of the terminal device 500. In some embodiments, in order to establish a screen projection connection relationship, the user can send a screen projection connection request through the terminal device 500, and send the screen projection connection request to the display device 200 through the WiFi network. The display device 200 then completes the transmission protocol configuration according to the screen projection connection request, thereby establishing a transmission channel for the projection data with the terminal device 500.

[0083] The display device 200 can also achieve a screen projection connection with the terminal device 500 through different connection methods. For example, when the display device 200 and the terminal device 500 are connected to the same wireless local area network, a screen projection connection can be established based on a WiFi network. For another example, when both the display device 200 and the terminal device 500 are provided with NFC (Near Field Communication) components, a screen projection connection relationship can be established through the NFC component. Obviously, other wired or wireless connection methods can also be used between the display device 200 and the terminal device 500 to establish a screen projection connection relationship, such as RF radio frequency connection, infrared connection, cellular network, and other connection methods that can be associated with those skilled in the art based on the connection methods provided in the above embodiments.

[0084] After the screen projection connection is established, the display device 200 can receive the screen projection related data of the terminal device 500 through the screen projection data channel, so as to play the screen projection related content in the display device 200. Under different screen projection data transmission protocols, the screen projection data obtained by the display device 200 is in different forms. For example, the display device 200 and the terminal device 500 can establish a screen projection connection through the Digital Living Network Alliance (DLNA) protocol, Miracast protocol, AirPlay push protocol, WiDi screen projection, NFC mirror screen projection, LeBo screen projection and other protocols.

[0085] Among them, the DLNA protocol is a protocol for sharing media resources between devices. The protocol uses network technology (wired or wireless) to interconnect various devices and exchange data through standard protocols, so that media resources can be shared between devices. The DLNA protocol is based on the UPnP protocol, which enables devices to discover and control each other and achieve seamless transmission and sharing of media resources. The DLNA protocol supports a variety of devices, including TVs, speakers, mobile phones, computers, etc., allowing users to seamlessly switch and share media content between different devices.

[0086] Miracast protocol is a wireless display standard based on Wi-Fi direct connection and developed by the Wi-Fi Alliance. Miracast screen projection protocol is applicable to Android devices, that is, Android devices can share video images through Miracast screen projection. Smart devices with Android 5.0 or above have built-in Miracast protocol, so you can directly wirelessly project the screen through the WiFi P2P function between the projection device and the WiFi network card of the receiving device without installing any software. In addition, Miracast screen projection also supports synchronous transmission of audio and video.

[0087] Airplay protocol is a wireless playback technology launched by Apple, which is applicable to the wireless screen projection protocol of iOS and Mac systems. Apple devices have built-in Airplay screen projection function. When used with a screen projection device that supports AirPlay server service, the effect is clear and stable. The protocol comes with a screen projection code function. However, it is necessary to ensure that the Apple device and the screen projection device are used in the same LAN (same network segment), and cannot be used across network segments or VLANs.

[0088] WiDi screen projection is a wireless playback technology led by Intel, and is also based on WiFi Direct technology. Windows 8 / 10 / 11 laptops natively support WiDi screen projection, which can be directly projected without installing any software, and supports USB reverse control function.

[0089] In some embodiments, after the display device 200 establishes a screen projection connection with the terminal device 500, the screen projection data can be transmitted through the mirror mode and the push mode. Among them, the mirror mode means that the display device 200 synchronously displays the screen content displayed by the terminal device 500. For example, Figure 5 As shown, the display device 200 displays the main interface of the terminal device 500, and when the user performs an interactive operation on the terminal device 500, resulting in a change in the content of the main interface, the content displayed by the display device 200 also changes. To this end, the terminal device 500 can generate a screen projection data stream in the form of a video based on the displayed content, and send the screen projection data stream to the display device 200 for display.

[0090] The push mode means that the display device 200 accesses the network link according to the network link pushed by the terminal device 500 to obtain the corresponding projection screen. Figure 6 As shown, when the terminal device 500 plays the video media, a screen projection control is provided in the upper right corner of the play interface. After the user clicks the screen projection control and selects the display device 200 as the device for displaying the screen projection image, the terminal device 500 can send the URL address of the currently played video media to the display device 200. After receiving the URL address, the display device 200 accesses the URL address to obtain the video media data and plays the video media.

[0091] Among the screen projection protocols supported by the display device 200 and the terminal device 500, some protocols are based on the mirror mode, and some protocols are based on the push mode. For example, under the DLNA protocol, the display device 200 can obtain the link address of a resource in the terminal device 500 through the screen projection data channel, and obtain the media content data by accessing the link address, thereby playing the media data. At the same time, the display device 200 can also obtain control instructions sent by the terminal device 500 through the screen projection data channel when playing media data, such as fast forward, pause, stop screen projection, etc. For example, after establishing a connection through the communication protocol, the terminal device 500 such as a mobile phone and the display device 200 will negotiate the device functions and network conditions to select a suitable audio and video transmission format. After establishing the online protocol (Session) of the audio and video streaming, a series of real-time streaming protocol (RTSP) control commands are used to control the playback and termination of the audio and video streaming.

[0092] Under other screen projection connection protocols such as Miracast, Airplay, NFC mirroring, and LeTV, the display device 200 can directly obtain the video data stream from the terminal device 500. The video data stream can be the video data stream corresponding to the final display screen of the display unit of the terminal device 500, that is, the video data stream includes the media content screen, UI interface, and other video screen content that can be displayed in the display unit of the terminal device 500. The video data stream can also be only the video data that can be obtained in the terminal device 500, such as the media video data being played. At this time, the terminal device 500 can be used as a signal source for the display device 200, and the display device 200 can continuously obtain video data through the screen projection data channel, and display it in real time on the display 260, so as to achieve the effect of synchronous display with the terminal device 500.

[0093] It should be noted that the above-mentioned screen projection protocol can not only obtain the video data stream in the terminal device 500, but also obtain the audio data stream in the terminal device 500, so that the video data and audio data can be sent to the display device 200 synchronously, so that the display device 200 can play the video and audio synchronously.

[0094] The terminal device 500 can obtain different projection data according to different projection protocols. For example, for system applications or direct projection at the system level, the terminal device 500 can use Miracast projection, Airplay projection or WiDi projection protocol to establish a projection data channel. Since the above-mentioned Miracast projection protocol and Airplay projection protocol require system-level application permissions, the Miracast projection protocol and Airplay projection protocol are only applicable to system applications, or the display device 200 and the terminal device 500 of the same manufacturer directly establish a projection connection through the built-in rules of the operating system.

[0095] The display device 200 can establish a screen projection connection with the terminal device 500 based on any of the screen projection methods provided in the above embodiments. In some embodiments, the display device 200 can also establish a screen projection connection relationship with multiple communication terminals through one or more of the above screen projection methods. For example, the display device 200 can simultaneously establish a screen projection connection with the first terminal device 510 and the second terminal device 520, and divide the display area in the display screen to display the projection screen shared by the first terminal device 510 and the second terminal device 520 respectively.

[0096] In order to display the projection screen shared by multiple terminal devices 500 on the display device 200, in some embodiments, when the display device 200 establishes a projection connection with multiple terminal devices 500, the display device 200 can display a multi-channel projection interface, which can include multiple projection windows. The projection window is used to display the projection screen of the corresponding terminal device 500 under a projection connection channel. For example, Figure 7 As shown, the multi-channel screen projection interface may include two screen projection windows, namely a first screen projection window and a second screen projection window. The first screen projection window is used to display the projection screen of the first terminal device 510; the second screen projection window is used to display the projection screen of the second terminal device 520.

[0097] In some embodiments, when the display device 200 displays the screen projection interface, it will display a playback view (view) for playing the screen projection data to display the screen projection content. A playback control interaction view (view) will also be displayed in the screen projection interface, for example, full screen, fast forward, fast rewind, play / pause, mute / unmute, close and other playback control buttons, progress bar, title, etc. The user can perform interactive operations based on the playback control interaction view to input control instructions and control the display device 200 to perform interactive responses.

[0098] In some embodiments, in order to meet different usage scenarios, the display device 200 supports multiple screen projection modes (screen projection functions), including single-channel push screen projection, four-channel game screen projection, HDMI conference screen projection, two-channel movie projection, split-screen movie projection, floating screen projection, single-channel mirror screen projection, etc. For example, Figure 8 As shown, in the single-channel push screen projection mode, the display device 200 can receive the URL address sent by the terminal device 500, access the URL address to obtain the video media data, and play the video media. Fig. 9 As shown, in the single-channel mirror screen projection mode, the display device 200 can receive the screen projection data stream sent by the terminal device 500 for display. Fig.10As shown, in the dual-channel video projection mode, two terminal devices 500 can simultaneously project video data to the display device 200 and display them in a split-screen format, allowing users to watch different videos or content at the same time. Fig.11 As shown, in the four-way game projection mode, four terminal devices 500 can simultaneously project the game screen onto the display device 200, thereby facilitating user collaboration or competition. Fig.12 As shown, in the projection mode of HDMI conference projection, the terminal device 500 can project the screen content to the screen of the display device 200 through the HDMI interface for demonstration or conference. Fig.13 As shown, in the floating screen projection mode, the terminal device 500 can project fitness demonstration movements or teaching videos onto the screen of the display device 200 and display them in the form of a floating window, allowing the user to watch the video content while exercising.

[0099] In some embodiments, the display device 200 can switch between multiple projection modes. For example, when the user wants to watch a movie, the display device 200 can be controlled to start the single-channel push projection mode based on a specific interaction strategy, and the screen can be projected and operated in the single-channel push projection mode to make the display device 200 play the movie. At this time, the user also wants to watch cartoons, so the projection mode of the display device 200 can be controlled to switch from single-channel push projection to dual-channel movie projection, and the screen can be projected and operated in the dual-channel movie projection mode to make the display device 200 play movies and cartoons at the same time.

[0100] In some embodiments, the projection mode of the display device 200 is implemented based on Activity (active component). The projection interface corresponding to each projection mode is an independent Activity. Activity is a key component in the display device 200 system, which is used for interface display, user interaction and business logic processing. Various view controls are set in the root layout of the Activity, such as SurfaceView, TextureView, etc., for playing videos, play control buttons, progress bars, titles and other interactive controls, etc., so as to present the corresponding projection interface.

[0101] The playback controls depend on the Activity. When the Activity exits the foreground or is destroyed, the playback controls will be destroyed. In other words, when the Activity exits the foreground or is destroyed, the playback controls such as SurfaceView and TextureView created in the Activity will also be destroyed, which will cause the playback content in the playback controls to be interrupted.

[0102] For example, Fig.14As shown, the interface of the single-channel push screen projection corresponds to an Activity, and a video playback control, title, progress bar and other view controls are set in the root layout of the Activity. The interface of the dual-channel movie viewing and projection corresponds to an Activityit y, and two video playback controls, guide information, operation controls and other view controls are set in the root layout of the Activity. When the display device 200 switches from single-channel push screen projection to dual-channel movie viewing and projection, the Activity corresponding to the single-channel push screen projection will exit the foreground or be destroyed, the video playback control dependent on the Activity will be destroyed, and the player bound to the video playback control will also be released, resulting in the video content being unable to continue to play in the dual-channel movie viewing and projection interface. It needs to be re-projected and replayed based on the new video playback control in the Activity corresponding to the dual-channel movie viewing and projection before it can be viewed in the dual-channel movie viewing and projection interface.

[0103] In some embodiments, some embodiments of the present application provide an Activity root layout architecture for a projection interface, such as Fig.15 As shown, it is the Activity root layout architecture diagram corresponding to the projection interface provided in the embodiment of the present application. In this embodiment, two logical levels are divided in the Activity root layout, one is the playback control container, which is used to place the playback controls, and the other is the interface component container, which is used to place the interface components, namely, Fragment. Fragment is a UI fragment that can be embedded in Activity, which is used to implement functional logic control and playback control view (View) layout. In terms of display level, the display level of the Fragment container is higher than the display level of the playback control container.

[0104] Based on the Activity root layout architecture in the above embodiment, each projection mode will correspond to a Fragment. The Activity can listen to the start or switch messages of the projection mode through broadcasting (Intents), StartActivity survey, event bus (EventBus), etc. When receiving the start or switch message, it can create a Fragment corresponding to the projection mode and detect whether the Fragment already exists in the Fragment container. If the Fragment exists, remove the Fragment corresponding to the previous projection mode in the Fragment container and add the Fragment corresponding to the current projection mode. If the Fragment does not exist, directly add the Fragment corresponding to the current projection mode in the Fragment container.

[0105] When a Fragment is embedded in an Activity, the Activity can provide the Fragment with the interface capability to operate the layout of the playback controls in the playback control container, so that the Fragment can perform related operations on the playback controls in the playback control container, including obtaining playback controls, adding playback controls, removing playback controls, and setting the layout parameters (size, position, etc.) of playback controls. By defining a playback control interface in the Activity, the playback control interface includes operation methods for performing related operations on the playback controls in the playback control container. When a Fragment is embedded in an Activity, the Activity can configure the playback control interface to the Fragment, so that the Fragment can call the operation methods defined in the playback control interface to perform operations such as querying, adding, deleting, and adjusting layout parameters of playback controls.

[0106] like Fig.16 As shown, it is a schematic diagram of the root layout of the Activity when the projection mode is switched according to the embodiment of the present application. After the Fragment is loaded and created, it will create the interactive controls required for the current projection mode in the root layout of the Fragment, such as progress bar, title, play control button, etc., according to the preset root layout data corresponding to the current projection mode. At the same time, it will perform operations such as adding, deleting and adjusting layout parameters on the play controls in the play control container through the play control interface provided by the Activity for operating the play controls, such as removing the play controls not required for the current projection mode, adding the play controls required for the current projection mode, adjusting the display position of the play controls, etc. In other words, the Fragment does not remove the play controls that need to be retained in the previous projection mode, and adjusts the layout of the play controls and interactive controls according to its own preset functional logic.

[0107] In the above embodiment, in the scenario of switching the projection mode, the display device 200 can separate the playback controls and the interactive controls by logically layering the view controls, and move the interactive controls and logic to the Fragment. The projection mode can be switched by switching the Fragment without switching the Activity, thereby maintaining the existing projection playback while achieving switching between multiple projection modes.

[0108] Based on the Activity root layout architecture corresponding to the projection interface in the above-mentioned embodiments, some embodiments of the present application provide a projection mode switching method for switching between multiple projection modes while maintaining the existing projection playback. The projection mode switching method can be applied to the display device 200 provided in the above-mentioned embodiments. In order to meet the implementation of the projection mode switching method, the display device 200 should include at least a display 260, a communicator 220 and a controller 250. Among them, the display 260 is configured to display the projection interface. The communicator 220 is configured to establish a projection connection with the terminal device 500. The controller 250 is configured to execute the program steps corresponding to the projection mode switching method.

[0109] For ease of understanding, the projection mode before the projection mode is switched is called the first projection mode, and the projection mode after the projection mode is switched is called the second projection mode.

[0110] The display device 200 can display the screen projection interface according to the first screen projection mode. Fig.17 As shown, it is a schematic diagram of a process of displaying a screen projection interface according to a first screen projection mode provided in an embodiment of the present application, including the following steps:

[0111] S1701: In response to the first screen projection instruction, create a screen projection interface.

[0112] The display device 200 can create a screen projection interface in response to the first screen projection instruction, that is, create an Activity corresponding to the screen projection interface to play the screen projection related content in the screen projection interface.

[0113] In some embodiments, the first screen projection instruction may be input by the terminal device 500 or by a user, or may be generated when the screen projection data sent by the terminal device 500 is received, that is, after the terminal device 500 establishes a screen projection connection relationship with the display device 200, the display device 200 generates the first screen projection instruction when it receives the screen projection data sent by the terminal device 500 through the screen projection data channel.

[0114] S1702: Create a playback control container and an interface component container in the screen projection interface.

[0115] After creating the Activity corresponding to the projection interface, you can create a playback control container and a fragment container in the root layout of the Activity. The playback control container is used to place the playback controls, and the fragment container is used to place the fragment. The display level of the fragment container is higher than the display level of the playback control container, thereby dividing the Activity root layout of the projection interface into two logical levels.

[0116] S1703: Create a first interface component for the first screen projection mode, and add the first interface component to the interface component container.

[0117] After the Activity corresponding to the screen projection interface is created, the Activity can create the first interface component of the first screen projection mode, that is, the Fragment corresponding to the first screen projection mode, and add the first interface component to the Fragmen container.

[0118] In some embodiments, the first projection mode may be the current projection mode of the display device 200, that is, after the Activity corresponding to the projection interface is created, the Activity may detect the current projection mode and use the current projection mode as the first projection mode. The first projection mode may also be set according to the number of projection channels through which the display device 200 currently receives projection data or the type of media resources of the received projection data. For example, if the display device 200 is currently projecting one screen and the media resource type of the projection data is a video URL type, the projection mode is set to single-channel push projection.

[0119] S1704: Create an interactive control associated with the first screen projection mode in the first interface component.

[0120] After the first interface component is created, the first interface component can obtain the preset root layout data of the first interface component, and create the interactive controls associated with the first projection mode in the root layout of the first interface component itself according to the root layout data. The root layout data of the first interface component includes the broadcast control data of the interactive controls associated with the first projection mode, including the position coordinates, size, etc. of the interactive controls such as the progress bar and title.

[0121] S1705: Create a play control in the play control container.

[0122] While creating the interactive control, the first interface component can also obtain the control layout data of the first projection mode, and call the playback control interface provided by the Activity, call the operation methods defined in the playback control interface for adding playback controls, setting the layout parameters of playback controls, etc., control the Activity to create playback controls in the playback control container according to the control layout data, and play the received projection data through the playback control, so as to display the projection interface according to the first projection mode through the display 260. Among them, the control layout data of the first projection mode includes the playback control data of the playback control associated with the first projection mode, including the position coordinates, size, etc. of the playback control.

[0123] When the display 260 displays the projection interface in the first projection mode, the projection mode switching may be performed. Fig.18 , which is a flow chart of a method for switching screen projection modes provided in an embodiment of the present application, includes the following steps:

[0124] S1801: When the display 260 displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received.

[0125] In some embodiments, the switching instruction can be input by the terminal device 500 or by the user. For example, the user can call the projection mode menu option provided by the display device 200, and the projection mode menu option includes a variety of different projection modes. The user can select any projection mode in the menu option through interactive methods such as touching the screen and remote control to input a switching instruction for switching the projection mode. The switching message can also be triggered when executing some functions. For example, the display device 200 is currently projecting a single screen. When a connection event is received to establish a projection connection relationship between the display device 200 and the terminal device 500, the switching operation from single-channel projection to dual-channel projection is triggered, thereby generating a switching message for switching the screen mode.

[0126] S1802: In response to the switching instruction, remove the first interface component in the interface component container.

[0127] The Activity corresponding to the projection interface can respond to the switching instruction for switching the projection mode and remove the first interface component in the Fragmen container. At this time, the related interactive controls created in the first interface component will also be removed.

[0128] S1803: Create a second interface component for the second screen projection mode, and add the second interface component to the interface component container.

[0129] After removing the first interface component from the Fragmen container, the Activity corresponding to the projection interface can create a second interface component for the second projection mode, that is, a Fragment corresponding to the second projection mode, and add the second interface component to the Fragmen container.

[0130] S1804: Create an interactive control associated with the second screen projection mode in the second interface component.

[0131] After the second interface component is created, the second interface component can obtain the preset root layout data of the second interface component, and create the interactive controls associated with the second projection mode in the root layout of the second interface component itself according to the root layout data. Among them, the root layout data of the second interface component includes the broadcast control data of the interactive controls associated with the second projection mode, including the location coordinates and size of interactive controls such as guide information and broadcast control buttons, so as to update the relevant content of the interactive controls in the projection interface.

[0132] S1805: Update the play control in the play control container.

[0133] The second interface component can obtain the control layout data of the second projection screen mode, and call the playback control interface provided by the Activity of the corresponding projection screen interface, call the operation methods defined in the playback control interface for adding or removing playback controls, setting the layout parameters of playback controls, etc., and control the Activity to update the playback controls in the playback control container according to the control layout data, thereby updating the relevant content of the playback controls in the projection screen interface. Among them, the control layout data of the second projection screen mode includes the playback control data of the playback controls associated with the second projection screen mode.

[0134] The update of the play controls in the play control container includes the update of the number of play controls and the update of the layout of the play controls. Fig.19 As shown, it is a schematic diagram of a process of updating a play control in a play control container provided in an embodiment of the present application, comprising the following steps:

[0135] S1901: Read the number of playback controls and layout parameters of the playback controls for the second projection mode from the control layout data.

[0136] Among them, the layout parameters of the playback control include the display size and display position of the playback control. The number of playback controls in the second projection mode is used to characterize the number of projection channels supported by the second projection mode. For example, two-way movie projection corresponds to two playback controls, and one-way push projection corresponds to one playback control.

[0137] S1902: Detect the number of projection channels.

[0138] Among them, the number of screen projection channels is the number of channels through which the display device 200 currently receives screen projection data.

[0139] S1903: Compare the number of playback controls and the number of projection channels in the second projection mode. If the number of projection channels is greater than or equal to the number of playback controls, execute steps S1904 and S1906. If the number of projection channels is less than the number of playback controls, execute steps S1905 and S1906.

[0140] S1904: Remove or create a play control in the play control container according to the number of play controls.

[0141] If the number of projection channels is greater than or equal to the number of playback controls in the control layout data, the second interface component can call the operation method defined in the playback control interface for adding or removing playback controls, and remove or create playback controls in the playback control container according to the number of playback controls.

[0142] For example, the projection mode of the display device 200 is dual-channel movie projection. When one of the projection channels is interrupted, the projection mode switching operation of switching the dual-channel movie projection to single-channel push projection is triggered. When executing the steps of the above projection mode switching method, it is detected that the current number of projection channels is 1, which is equal to the number of playback controls for single-channel push projection. Then, the playback control corresponding to the interrupted projection channel is removed from the playback control container.

[0143] S1905: Determine the target position according to the layout parameters, and create a projection guide view at the target position in the second interface component.

[0144] If the number of projection channels is less than the number of playback controls in the control layout data, the second interface component can determine the target position according to the layout parameters, and create a projection guide view at the target position in the second interface component. The target position is the display position of the playback control in the playback control container, the projection guide view is used to display the projection guide information, and the number of projection guide views is the difference between the number of playback controls and the number of projection channels.

[0145] S1906: Setting the display size and display position of the play control in the play control container according to the layout parameters.

[0146] After updating the number of playback controls or creating a projection guide view, the second interface component can call the operation method defined in the playback control interface for setting the layout parameters (size, position, etc.) of the playback controls, and set the display size and display position of the playback controls in the playback control container according to the layout parameters, so that the layout of the playback controls in the playback control container meets the layout requirements of the second projection mode.

[0147] It can be understood that in the above embodiment, after switching to the second projection mode, for the playback controls that are not removed in the playback control container, it is only necessary to change the display size and display position of the playback controls, thereby meeting the layout requirements of the second projection mode while maintaining the existing projection and continuing to play.

[0148] In some embodiments, for the projection interface presented after executing step S1905, when receiving the second projection instruction, the second interface component can respond to the second projection instruction and remove the projection guide view located at the target position in the second interface component. And through the playback control interface provided by the Activity corresponding to the projection interface, control the Activity to create a new playback control at the target position in the playback control container, and play the received new projection data through the new playback control.

[0149] Among them, the second screen projection instruction can be generated when the screen projection data sent by the new terminal device 500 is received, and can also be input by the new terminal device 500 or by the user.

[0150] That is to say, when the number of projection channels of the display device 200 is less than the number of playback controls corresponding to the second projection mode, the projection guide view is displayed in the display area used to play the projection data. When a new projection push is received, the projection guide view is removed and the playback controls are displayed in the display area used to play the projection data to play the projection data.

[0151] For example, the projection mode of the display device 200 is single-channel movie projection, and the user switches the single-channel movie projection to dual-channel movie projection through the projection mode menu option of the display device 200. When executing the steps of the above-mentioned projection mode switching method, it will be detected that the number of projection channels is 1, which is less than the number of playback controls for two-way push projection. Then, the display size and display position of the existing playback controls are set in the playback control container according to the control layout data, so that they are displayed in the display area of ​​the first projection. At the same time, according to the control layout data of the second projection mode, a projection guide view is created in the root layout of the second interface component, and the display size and display position of the projection guide view are set so that it is displayed in the display area of ​​the second projection.

[0152] When a new screen projection push is received, the screen projection guide view is removed from the second interface component, and a new playback control is created in the playback control container, and the display size and display position of the playback control are set so that it is displayed in the display area of ​​the second screen projection.

[0153] In some embodiments, when the display 260 displays the projection interface according to the second projection mode, the Activity corresponding to the projection interface can receive a full-screen instruction for the full-screen target playback control, and the full-screen instruction triggers the projection switching operation to switch to the single-channel projection mode. The Activity can remove the second interface component in the Fragmen container, create a single-channel interface component of the single-channel projection mode, that is, a Fragment corresponding to the single-channel projection mode, and add the single-channel interface component to the Fragmen container.

[0154] After the single-channel interface component is created, the interactive controls associated with the single-channel projection mode are created in the root layout of the single-channel interface component itself according to the root layout data. At the same time, the playback control interface provided by the Activity can be called to control the Activity to remove non-target playback controls in the playback control container, interrupt the projection corresponding to the non-target playback controls, and set the display size and display position of the target playback control to control the full-screen display of the target playback control, and play the projection data in full screen through the target playback control. Among them, the non-target playback control is the playback control other than the target playback control.

[0155] Taking the switching from a single-channel push screen projection to a dual-channel movie viewing screen projection as an example, the screen projection mode switching method provided in the embodiment of the present application is described below, which specifically includes the following steps:

[0156] When the display device 200 receives the projection data sent by the terminal device 500 through the projection data channel, an Activity corresponding to the projection interface is created. When creating the Activity, a playback control container and a Fragment container can be created in the root layout of the Activity. The display level of the Fragment container is higher than the display level of the playback control container, so as to construct the following structure: Fig.15 The Activity root layout architecture diagram shown.

[0157] Activity creates a single-channel push and screen projection fragment and loads it into the fragment container.

[0158] When a single-channel push screen fragment is created, the interactive controls are loaded in the root layout of the fragment itself according to its own root layout data, for example Fig. 20 The progress bar, title, etc. are shown. At the same time, through the playback control interface provided by the Activity, the Activity is controlled to create a playback control in the playback control container, and the currently received screen projection data is rendered and played on the playback control.

[0159] like Fig.21 As shown, when the Activity receives a switching message to switch to dual-channel movie viewing and projection, the Fragment of the single-channel push and projection is removed from the Fragment container. At this time, the interactive controls created in the Fragment of the single-channel push and projection will also be removed.

[0160] Activity creates a fragment for dual-channel movie viewing and projection and loads it into the fragment container.

[0161] When a dual-channel movie-screen projection fragment is created, it will load interactive controls in its own root layout according to its own root layout data, for example Fig. 22 The guidance information, operation controls, etc. shown in the figure. At the same time, through the playback control interface provided by the Activity, control the Activity to set the display size and display position of the playback control created under the single-channel push screen projection, so that the playback control is moved to the playback position of the first channel of the dual-channel movie viewing screen projection layout. At the playback position of the second channel of the screen projection, create a second channel of the screen projection guidance view in the root layout of the Fragment to guide the user to perform the second channel of the screen projection.

[0162] like Fig.23As shown, when the projection data of the second projection is received, the dual-channel movie projection Fragment controls the Activity to create another playback control in the playback control container through the playback control interface provided by the Activity, so as to render and play the projection data of the second projection on the playback control. At the same time, the display size and display position of the playback control are set to move the playback control to the playback position of the second projection, and the second projection guide view located at the playback position of the second projection is removed from the root layout of the Fragment. In this way, the switch from single-channel push projection to dual-channel movie projection is realized.

[0163] like Fig.24 As shown, in the dual-channel movie projection, when the first channel of projection ends, the Fragment can control the Activity to remove the playback control corresponding to the first channel of projection in the playback control container through the playback control interface provided by the Activity, and create and display the projection guide view at the playback position of the first channel of projection in the root layout of the Fragment.

[0164] In such Fig.23 In the dual-channel movie projection shown, when a full-screen instruction is received for one channel of projection, the projection switching operation to single-channel push projection is triggered. The Activity removes the dual-channel movie projection Fragment in the Fragment container, creates a single-channel push projection Fragment, and loads it into the Fragment container. The single-channel push projection Fragment creates interactive controls associated with the single-channel push projection in the root layout of the Fragment itself, and controls the Activity to remove the playback controls corresponding to the non-full-screen projection in the playback control container, interrupt the non-full-screen projection, and set the display size and display position of the playback controls of the full-screen projection to display in full screen. The root layout of the Activity is restored to the root layout architecture shown in 20. In this way, the switch from dual-channel movie projection to single-channel push projection is realized.

[0165] In the above embodiment, the life cycle of the projection mode is untied from the life cycle of the Activity, and the binding relationship between a projection mode and an Activity is released. By separating the playback controls and managing them by the Activity, each projection mode is turned into a functional component that can be loaded and removed by the Activity alone, and only needs to be operated through the interface provided by the Activity, so that the Activity does not need to exit when the projection mode is switched, ensuring that the playback controls that depend on the Activity can continue to be available.

[0166] It should be noted that layering the root layout of the Activity and converting the projection mode into a Fragment component is one way to implement the projection mode switching operation, but it is not the only way. The purpose of layering is to ensure that the display level of the playback controls is always lower than the display level of the interactive controls, so that the playback content does not cover the interactive controls such as the progress bar and title. The Fragment component is used because it is a reusable UI component supported by the native system, and the interface capabilities required by various applications can be relatively completely supported. Without using the Fragment component, you can also use custom views to use each projection mode as a component to implement projection mode switching.

[0167] In some embodiments, a screen projection mode switching method is provided in some embodiments of the present application, and the screen projection mode switching method can be applied to the display device 200 provided in the above embodiments. In order to meet the implementation of the screen projection mode switching method, the display device 200 should at least include a display 260, a communicator 220 and a controller 250. Among them, the display 260 is configured to display the screen projection interface. The communicator 220 is configured to establish a screen projection connection with the terminal device 500. The controller 250 is configured to execute the program steps corresponding to the screen projection mode switching method, including the following contents:

[0168] In response to the first projection instruction, a projection interface is created, that is, an Activity corresponding to the projection interface is created. When the display 260 is controlled to display the projection interface according to the first projection mode, the Activity corresponding to the projection interface can obtain the interface data associated with the first projection mode, and create the playback controls and interactive controls associated with the first projection mode in the Activity corresponding to the projection interface according to the interface data. Among them, the interface data includes the position coordinates, size, etc. of the playback controls and interactive controls associated with the projection mode. The playback controls are used to play the projection data, and the interactive controls are used to perform playback control on the projection data. The playback controls are located at the first display level, and the interactive controls are located at the second display level. The second display level is higher than the first display level.

[0169] When a switching instruction for switching the projection mode is received. In response to the switching instruction, the interface data associated with the second projection mode can be obtained, and according to the interface data, the interactive controls not associated with the second projection mode are removed in the second display level, and the interactive controls associated with the second projection mode are created in the second display level. And the playback controls not associated with the second projection mode are removed in the first display level, and the playback controls associated with the second projection mode are created in the first display level, so that the display 260 displays the projection interface according to the second projection mode.

[0170] In this embodiment, the playback controls and interactive controls are placed directly in the root layout of the Activity, and the display level of the interactive controls is set higher than the display level of the playback controls. Through the hierarchical control of the view controls, the display level of the playback controls is always lower than the display level of interactive controls such as the progress bar and title. When switching the projection mode, the view controls that are not related to the current projection mode are removed, and the view controls related to the current projection mode are added.

[0171] Based on the screen projection mode switching method provided in the above embodiments, some embodiments of the present application further provide a display device 200, wherein the display device 200 includes a display 260, a communicator 220, and a controller 250, wherein the display 260 is configured to display a screen projection interface, wherein the screen projection interface includes a playback control container and an interface component container, wherein the display level of the interface component container is higher than the display level of the playback control container; the communicator 220 is configured to establish a screen projection connection with a terminal device 500; and the controller 250 is configured to execute the following program steps:

[0172] When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the playback control container includes a playback control, and the playback control is used to play the projection data, and the interface component container includes a first interface component of the first projection mode, and the first interface component includes an interactive control associated with the first projection mode, and the interactive control is used to perform playback control on the projection data;

[0173] In response to the switching instruction, the first interface component is removed from the interface component container.

[0174] Create a second interface component for the second screen projection mode.

[0175] Create interactive controls associated with the second projection mode in the second interface component.

[0176] Add the second interface component to the interface component container.

[0177] Based on the screen projection mode switching method provided in the above embodiments, some embodiments of the present application further provide a display device 200, wherein the display device 200 includes a display 260, a communicator 220, and a controller 250, wherein the display 260 is configured to display a screen projection interface; the communicator 220 is configured to establish a screen projection connection with the terminal device 500; and the controller 250 is configured to execute the following program steps:

[0178] When the display 260 displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received. In the first projection mode, the projection interface includes a playback control and an interactive control associated with the first projection mode, the playback control is used to play the projection data, and the interactive control is used to perform playback control on the projection data, the playback control is located at the first display level, and the interactive control is located at the second display level, and the second display level is higher than the first display level.

[0179] In response to the switching instruction, the interactive controls associated with the first projection mode are removed in the second display level.

[0180] Create interactive controls associated with the second projection mode in the second display layer.

[0181] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0182] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0183] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0184] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display configured to display a screen projection interface, wherein the screen projection interface includes a playback control container and an interface component container, wherein a display level of the interface component container is higher than a display level of the playback control container; A communicator is configured to establish a screen projection connection with a terminal device; The controller is configured as: When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the playback control container includes a playback control, and the playback control is used to play the projection data, and the interface component container includes a first interface component of the first projection mode, and the first interface component includes an interactive control associated with the first projection mode, and the interactive control is used to perform playback control on the projection data; In response to the switching instruction, removing the first interface component from the interface component container; Creating a second interface component of the second screen projection mode; Creating an interactive control associated with the second screen projection mode in the second interface component; Add the second interface component to the interface component container.

2. The display device according to claim 1, characterized in that The controller is also configured to: In response to a first screen projection instruction, creating a screen projection interface, wherein the first screen projection instruction is generated when screen projection data sent by the terminal device is received, or the first screen projection instruction is input by the terminal device or by a user; Creating a playback control container and an interface component container in the screen projection interface; Create a first interface component for a first projection mode; Creating an interactive control associated with the first screen projection mode in the first interface component; Adding the first interface component to the interface component container; Creating a playback control in the playback control container; The received screen projection data is played through the playback control.

3. The display device according to claim 1, characterized in that The controller executes creating an interactive control associated with the second screen projection mode in the second interface component, and is further configured to: Obtain root layout data of the second interface component, where the root layout data includes broadcast control data of interactive controls associated with the second projection mode; Create an interactive control associated with the second projection mode according to the root layout data.

4. The display device according to claim 1, characterized in that The controller is also configured to: Acquire control layout data of the second screen projection mode, where the control layout data includes playback control data of playback controls associated with the second screen projection mode; The playback controls in the playback control container are updated according to the control layout data.

5. The display device according to claim 4, characterized in that The controller executes updating the playback control in the playback control container according to the control layout data, and is further configured to: Reading the number of playback controls for the second screen projection mode from the control layout data; According to the number of the play controls, remove or create play controls in the play control container; Reading layout parameters of the playback control in the control layout data; The display size and display position of the play control in the play control container are set according to the layout parameters.

6. The display device according to claim 5, characterized in that The controller is also configured to: Detect the number of screen projection channels, where the number of screen projection channels is the number of channels through which the display device currently receives screen projection data; If the number of screen projection channels is greater than or equal to the number of playback controls, remove or create playback controls in the playback control container according to the number of playback controls; If the number of projection channels is less than the number of playback controls, a projection guide view is created at the target position in the second interface component, the number of projection guide views is the difference between the number of playback controls and the number of projection channels, and the target position is the display position of the playback control in the playback control container.

7. The display device according to claim 6, characterized in that The controller is also configured to: In response to a second screen projection instruction, the screen projection guide view located at the target position is removed in the second interface component; the second screen projection instruction is generated when the screen projection data sent by the new terminal device is received, or the second screen projection instruction is input by the new terminal device or by the user; Creating a new playback control at a target location in the playback control container; The received new projection data is played through the new playback control.

8. The display device according to claim 1, characterized in that The controller is also configured to: In response to a full-screen instruction for displaying a target playback control in full screen, removing the second interface component from the interface component container; Create a single-channel interface component for single-channel projection mode; Creating an interactive control associated with the single-channel screen projection mode in the single-channel interface component; adding the single-channel interface component to the interface component container; Removing non-target playback controls in the playback control container, wherein the non-target playback controls are playback controls other than the target playback control; Control the target playback control to display in full screen.

9. A display device, characterized in that: include: A display configured to display a screen projection interface; A communicator is configured to establish a screen projection connection with a terminal device; The controller is configured as: When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the projection interface includes a playback control and an interactive control associated with the first projection mode, the playback control is used to play the projection data, and the interactive control is used to perform playback control on the projection data, the playback control is located at a first display level, and the interactive control is located at a second display level, and the second display level is higher than the first display level; In response to the switching instruction, removing the interactive controls associated with the first projection mode in the second display level; Create interactive controls associated with the second screen projection mode in the second display layer.

10. A method for switching screen projection mode, characterized in that: The display device applied to any one of claims 1 to 8, the display device comprising a display, a communicator and a controller, the display being configured to display a screen projection interface, the screen projection interface comprising a playback control container and an interface component container, the display level of the interface component container being higher than the display level of the playback control container; The communicator is configured to establish a screen projection connection with a terminal device; the method comprises: When the display displays the projection interface according to the first projection mode, a switching instruction for switching the projection mode is received; in the first projection mode, the playback control container includes a playback control, and the playback control is used to play the projection data, and the interface component container includes a first interface component of the first projection mode, and the first interface component includes an interactive control associated with the first projection mode, and the interactive control is used to perform playback control on the projection data; In response to the switching instruction, removing the first interface component from the interface component container; Creating a second interface component of the second screen projection mode; Creating an interactive control associated with the second screen projection mode in the second interface component; Add the second interface component to the interface component container.

Images