Display device and screen projection display method based on dynamic content

Abstract

The embodiment of the invention provides a display device and a screen projection display method based on dynamic content, and the method can detect an invalid picture area of a picture frame in screen projection data, and calculate a target display parameter of a screen projection picture according to the invalid picture area. Wherein the target display parameter is used for setting a central point of an effective picture area in the picture frame at a reference central point of the user interface, and meanwhile, the display proportion of the effective picture area in the user interface is maximized. And in the target time period, when the invalid picture region is changed, detecting whether the invalid picture region is centrosymmetric about the reference center point or not. If the invalid picture area is centrosymmetric about the reference center point, displaying the screen projection picture according to the target display parameter; otherwise, discarding the target display parameter to maintain the display parameter of the projection screen. According to the method, the problem of frequent switching of the screen projection picture is improved when the invalid picture area displayed by the screen projection picture is reduced, and the watching experience of a user can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a screen projection display method based on dynamic content. BACKGROUND

[0002] A display device is an intelligent device capable of presenting a user interface and supporting user interaction. Taking a smart television as an example, a smart television is a television product based on Internet application technology, having an open operating system and a chip, and possessing an open application platform, and capable of realizing bidirectional man-machine interaction, and integrating audio, video, entertainment, data and other functions, for meeting the diversified and personalized needs of users. The display device can establish a communication connection with a terminal device such as a mobile phone, and based on a specific screen projection protocol, obtain screen projection data of the terminal device, to display the screen projection picture of the terminal device through the display device.

[0003] In the process of establishing screen projection by the display device and the terminal device, the terminal device can record the picture content displayed by itself, to form screen projection data in the form of a video stream, and then send the screen projection data to the display device for display. However, in some scenarios, when the terminal device projects to the display device, there can be invalid picture areas in the picture displayed by the terminal device, such as black color areas without display content. For example, when the terminal device switches from a horizontal screen state to a vertical screen state, black areas can appear at the top and bottom of the screen of the terminal device. Or, the media played in the terminal device can itself have invalid picture areas. In this way, when the display device displays the screen projection picture corresponding to the screen projection data, the invalid picture areas included in the screen projection data are also completely displayed in the display device, resulting in the display space of the display device being wasted, and affecting the user's viewing experience. SUMMARY

[0004] The present application provides a display device and a screen projection display method based on picture content, to solve the problem of low display space utilization when a terminal device projects to a display device.

[0005] In a first aspect, some embodiments of the present application provide a display device, comprising a display, a communicator and a controller. The display is configured to display a user interface, the user interface comprising a screen projection picture of a terminal device. The communicator is configured to establish a communication connection with the terminal device, and receive screen projection data sent by the terminal device. The screen projection data comprises picture frames used to form the screen projection picture, and the picture frames comprise valid picture areas and invalid picture areas. The controller is configured to perform the following program steps:

[0006] detecting the invalid picture areas of the picture frames;

[0007] calculate a target display parameter of the screen mirroring picture according to the invalid picture area; the target display parameter is used to set a center point of the valid picture area at a reference center point of the user interface and to maximize a display proportion of the valid picture area on the user interface;

[0008] detect whether the invalid picture area is centrosymmetric with the reference center point when the invalid picture area changes in a target time period;

[0009] if the invalid picture area is centrosymmetric with the reference center point, control the display to display the screen mirroring picture according to the target display parameter;

[0010] if the invalid picture area is not centrosymmetric with the reference center point, discard the target display parameter so that the display maintains a display parameter of the screen mirroring picture.

[0011] In the second aspect, some embodiments of the present application further provide a screen mirroring display method based on dynamic content, applied to the display device provided in the first aspect, the display device comprising a display, a communicator and a controller; wherein the display is configured to display a user interface, the user interface comprising a screen mirroring picture of a terminal device; the communicator is configured to establish a communication connection with the terminal device and receive screen mirroring data sent by the terminal device; the screen mirroring data comprises picture frames used to form the screen mirroring picture, the picture frames comprising a valid picture area and an invalid picture area; the method comprises:

[0012] detect the invalid picture area of the picture frames;

[0013] calculate a target display parameter of the screen mirroring picture according to the invalid picture area; the target display parameter is used to set a center point of the valid picture area at a reference center point of the user interface and to maximize a display proportion of the valid picture area on the user interface;

[0014] detect whether the invalid picture area is centrosymmetric with the reference center point when the invalid picture area changes in a target time period;

[0015] if the invalid picture area is centrosymmetric with the reference center point, control the display to display the screen mirroring picture according to the target display parameter;

[0016] if the invalid picture area is not centrosymmetric with the reference center point, discard the target display parameter so that the display maintains a display parameter of the screen mirroring picture.

[0017] According to the technical solution, the display device and the screen projection display method based on dynamic content provided by some embodiments of the present application can detect the invalid picture area of the picture frame in the screen projection data, and calculate the target display parameter of the screen projection picture according to the invalid picture area. The target display parameter is used to set the center point of the effective picture area in the picture frame to the reference center point of the user interface, and at the same time, make the display proportion of the effective picture area in the user interface maximum. In the target time period, when the invalid picture area changes, it is detected whether the invalid picture area is centrosymmetric with the reference center point. If the invalid picture area is centrosymmetric with the reference center point, the screen projection picture is displayed according to the target display parameter; if the invalid picture area is not centrosymmetric with the reference center point, the target display parameter is discarded to maintain the display parameter of the screen projection picture. The method can improve the problem of frequent switching of the screen projection picture when reducing the invalid picture area displayed by the screen projection picture, and can improve the user's viewing experience. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0019] Figure 1 The schematic diagram of the use scene of the display device in some embodiments of the present application;

[0020] Figure 2 The hardware configuration block diagram of the control device provided by some embodiments of the present application;

[0021] Figure 3 The hardware configuration block diagram of the display device provided by some embodiments of the present application;

[0022] Figure 4 The software configuration schematic diagram of the display device provided by some embodiments of the present application;

[0023] Figure 5 The mirror screen projection schematic diagram provided by some embodiments of the present application;

[0024] Figure 6 The push screen projection schematic diagram provided by some embodiments of the present application;

[0025] Figure 7 The display device function mode schematic diagram provided by some embodiments of the present application;

[0026] Figure 8An effect diagram of a screen projection data picture frame and a screen projection picture in a screen projection process provided for some embodiments of the present application;

[0027] Figure 9a An effect diagram of a screen projection display provided for some embodiments of the present application;

[0028] Figure 9b Another effect diagram of a screen projection display provided for some embodiments of the present application;

[0029] Figure 10 An effect diagram of an optimized screen projection picture provided for some embodiments of the present application;

[0030] Figure 11 A flow diagram of an optimized screen projection picture provided for some embodiments of the present application;

[0031] Figure 12 A flow diagram of a screen projection picture display method provided for some embodiments of the present application;

[0032] Figure 13a A diagram of a picture frame in a subtitle scenario provided for some embodiments of the present application;

[0033] Figure 13b A diagram of a picture frame in a bullet screen scenario provided for some embodiments of the present application;

[0034] Figure 14a An example diagram of a screen projection effect corresponding to the picture frame shown in 13a provided for some embodiments of the present application;

[0035] Figure 14b An example diagram of a screen projection effect corresponding to the picture frame shown in 13b provided for some embodiments of the present application;

[0036] Figure 15 A flow diagram of a screen projection display method based on dynamic content provided for some embodiments of the present application;

[0037] Figure 16 A margin diagram of an invalid picture area provided for some embodiments of the present application;

[0038] Figure 17 A flow diagram of a screen projection picture display method provided for some embodiments of the present application;

[0039] Figure 18 Another effect diagram of an optimized screen projection picture provided for some embodiments of the present application;

[0040] Figure 19 Another flow diagram of a screen projection picture display method provided for some embodiments of the present application;

[0041] Figure 20 Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6;

[0042] Figure 21 Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6;

[0043] Figure 22 Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6;

[0044] Figure 23a Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6;

[0045] Figure 23b Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6; Figure 23a A principle diagram of calculating the target display parameter in the projection process shown in FIG. 6;

[0046] Figure 24 Another effect diagram of optimizing the projection picture provided by some embodiments of the present application is shown in FIG. 6. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be described clearly and completely below with reference to the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only some of the embodiments of the present application, but not all the embodiments of the present application.

[0048] Based on the exemplary embodiments shown in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative labor fall within the scope of protection of the present application. In addition, although the disclosure in the present application is introduced according to one or more examples, it should be understood that each aspect of the disclosure can also constitute a complete technical solution independently.

[0049] It should be understood that the terms "first", "second", "third", etc. in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, for example, those given in the embodiment illustration or description of the present application can be implemented in an order other than that given.

[0050] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to those components clearly listed, but can include other components not clearly listed or inherent to the product or device.

[0051] The display device provided by the embodiments of the present application can have various implementation forms, for example, can be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 3 is a specific implementation of the display device of the present application.

[0052] Figure 1 is a schematic diagram of an operation scenario between the display device and the control device according to an embodiment. As shown in Figure 1 , a user can operate the display device 200 through the smart device 300 or the control device 100.

[0053] In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, to control the display device 200 through wireless or wired mode. The user can input user instructions through the keys on the remote controller, voice input, control panel input, etc., to control the display device 200.

[0054] In some embodiments, the smart device 300 (such as a mobile terminal, a tablet computer, a computer, a notebook computer, etc.) can also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200.

[0055] In some embodiments, the display device 200 can not receive instructions using the above-mentioned smart device or control device, but can receive user control through touch or gesture, etc.

[0056] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300, for example, can directly receive user voice instructions through a voice instruction acquisition module configured inside the display device 200, or can receive user voice instructions through a voice control device arranged outside the display device 200.

[0057] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interaction to the display device 200. The server 400 can be a cluster, or multiple clusters, and can include one or more types of servers.

[0058] Figure 2 is an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment. As shown inFigure 2 As shown, the control device 100 includes a device controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert the commands into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200.

[0059] like Figure 3 As shown, the display device 200 includes at least one of a tuner and demodulator 210 , a communicator 220 , a detector 230 , a device interface 240 , a controller 250 , a display 260 , an audio output interface 270 , a memory, a power supply, and a communication device interface 280 .

[0060] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and first to nth interfaces for input / output.

[0061] The display 260 includes a display screen component for presenting images, and a driving component for driving image display, a component for receiving image signals output from a controller, and a component for displaying video content, image content, and a menu control interface and a user control UI interface.

[0062] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0063] In some embodiments, the communicator 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with multiple communicators 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 may be provided with a communicator 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 may also be provided with a communicator 220 including Bluetooth functionality.

[0064] The communicator 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0065] In some embodiments, the display device 200 can also support simultaneous establishment of communication connection relationship with multiple external devices. The multiple external devices can be connected to the display device 200 through the same type of connection. For example, the external devices are terminal devices 500 such as mobile phones, tablet computers, etc., which can be connected to the display device 200 through a wireless local area network to establish a communication connection with the display device 200. The multiple external devices can also be connected to the display device 200 through different types of connection modes. For example, a first terminal device is connected to the display device 200 through a wireless local area network, and a second terminal device is connected to the display device 200 through Bluetooth.

[0066] In order to realize the communication connection between the display device 200 and the terminal device 500, the display device 200 and the terminal device 500 are respectively provided with a communicator supporting the same type of communication. For example, when the display device 200 is provided with a communicator 220 including a WiFi module, the terminal device 500 should also be provided with a communicator including a WiFi module. In addition, while being provided with the same type of communicator, the display device 200 and the terminal device 500 also need a specific communication transmission protocol for data transmission. For example, WiFi protocol, Bluetooth connection protocol, ZigBee protocol, NFC protocol, etc.

[0067] The communication device interface 280 can be used to receive control signals of the control device 100 (such as an infrared remote controller, etc.).

[0068] The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver for collecting ambient light intensity sensors, or the detector 230 includes an image collector such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or the detector 230 includes a sound collector such as a microphone, etc., for receiving external sound.

[0069] The device interface 240 can include but is not limited to any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It can also be a composite input / output interface formed by the above multiple interfaces.

[0070] The tuning demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals and EPG data signals from multiple wireless or wired broadcast television signals.

[0071] In some embodiments, the controller 250 and the tuning demodulator 210 can be located in different split devices, i.e., the tuning demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0072] The controller 250 controls the operation of the display device and responds to the user's operation by storing various software control programs in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.

[0073] In some embodiments, the controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an n-th interface for input / output, a communication bus, and the like.

[0074] The user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0075] The "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form that the user can accept. The commonly used form of the user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an icon, a window, a control, and the like interface elements displayed in the display screen of an electronic device, wherein the control can include an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, and the like visible interface elements.

[0076] For ease of description, some embodiments of the present application are described by taking the display device 200 configured with an Android system as an example, but are not limited thereto. The display device 200 provided by the embodiments of the present application can also be configured with other systems.

[0077] For example, the display device 200 can be a smart television (TV) or a smart display. Figure 4As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0078] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0079] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0080] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0081] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (such as shrinking the display window, shaking the display, distorting the display, etc.).

[0082] In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime layer to implement the functions implemented by the framework layer.

[0083] In some embodiments, the kernel layer is a layer between hardware and software. As shown in the figure, the kernel layer at least contains at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power supply driver, etc. Figure 4

[0084] The display device 200 can establish a screen projection connection channel and transmit screen projection data based on the screen projection connection after establishing a communication connection relationship with the terminal device 500, so that the display device 200 can display the screen projection picture of the terminal device 500. In some embodiments, in order to establish a screen projection connection relationship, the user can send a screen projection connection request through the terminal device 500, and send the screen projection connection request to the display device 200 through a WiFi network. The display device 200 completes the transmission protocol configuration according to the screen projection connection request, thereby establishing a transmission channel of screen projection data between the display device 200 and the terminal device 500.

[0085] The display device 200 can also realize screen projection connection with the terminal device 500 through different connection modes. For example, when the display device 200 and the terminal device 500 access the same wireless local area network, the screen projection connection can be established based on the WiFi network. For another example, when the display device 200 and the terminal device 500 are both provided with NFC (Near Field Communication) components, the screen projection connection relationship can be established through the NFC components. Obviously, the display device 200 and the terminal device 500 can also use other wired or wireless connection modes to establish a screen projection connection relationship, such as RF (Radio Frequency) connection, infrared connection, cellular network, and other connection modes that can be thought of by those skilled in the art on the basis of the connection modes provided in the above embodiments.

[0086] After establishing the screen projection connection, the display device 200 can receive the screen projection related data of the terminal device 500 through the screen projection data channel, so as to play the screen projection related content in the display device 200. Under different screen projection data transmission protocols, the form of the screen projection data obtained by the display device 200 is different. For example, the display device 200 and the terminal device 500 can establish a screen projection connection through a DLNA (Digital Living Network Alliance) protocol, a Miracast protocol, an AirPlay push protocol, a WiDi screen projection, an NFC mirror screen projection, a Yebao screen projection, etc.​

[0087] DLNA protocol is a protocol for realizing media resource sharing between devices. The protocol uses network technology (wired or wireless) to interconnect various devices, and enables data interaction through a standard protocol, so that media resources can be shared between devices. The DLNA protocol is based on the UPnP protocol, enabling devices to discover and control each other, and enabling seamless transmission and sharing of media resources. The DLNA protocol supports a variety of devices, including televisions, sound systems, mobile phones, computers, etc., enabling users to seamlessly switch and share media content between different devices.

[0088] Miracast protocol is a wireless display standard based on Wi-Fi Direct developed by the Wi-Fi Alliance. Miracast screen projection protocol can be applied to Android devices, that is, Android devices can share video pictures through Miracast screen projection. Android 5.0 and above smart devices are built-in Miracast protocol, so they can directly perform wireless screen projection through the WiFi P2P function between the screen projection device and the receiving end device WiFi card without the need to install any software. In addition, Miracast screen projection also supports synchronous transmission of audio and video.

[0089] Airplay protocol is a wireless playback technology developed by Apple, which is a wireless screen projection protocol for iOS and Mac systems. Apple devices are built-in Airplay screen projection function, which is used with a screen projector supporting AirPlay server service, and the effect is clear and stable. The protocol has a screen projection code function. However, Apple devices and screen projectors must be used in the same local area network (same network segment), and cannot be used across network segments or VLANs.

[0090] WiDi screen projection is a wireless playback technology led by Intel, also based on WiFi Direct technology. Windows 8 / 10 / 11 laptops natively support WiDi screen projection, which can directly screen without the need to install any software, and supports USB reverse control function.

[0091] In some embodiments, after the display device 200 establishes a screen projection connection with the terminal device 500, the display device 200 can transmit screen projection data in mirror mode and push mode. The mirror mode refers to the display device 200 synchronously displaying the picture content displayed by the terminal device 500. For example, as shown in FIG. 2, the display device 200 can display the picture content displayed by the terminal device 500 in mirror mode. Figure 5As shown, the display device 200 displays the main interface of the terminal device 500, and when the user performs an interactive operation on the terminal device 500, causing the main interface content to change, the content displayed by the display device 200 also changes accordingly. To this end, the terminal device 500 can generate screen projection data in the form of a video stream based on the display content, and send the screen projection data to the display device 200 for display.

[0092] The push mode refers to that the display device 200 accesses a network link pushed by the terminal device 500, and obtains a corresponding screen projection picture. For example, as shown in FIG. 2B, when the terminal device 500 plays a video asset, a screen projection control is provided in the upper right corner of the play interface. After the user clicks the screen projection control and selects the display device 200 as a device for displaying the screen projection picture, the terminal device 500 can send a URL address of the currently played video asset to the display device 200. After receiving the URL address, the display device 200 accesses the URL address to obtain video asset data, and plays the video asset. Figure 6

[0093] Among the screen projection protocols supported by the display device 200 and the terminal device 500, some protocols are based on the mirror mode, and some protocols are based on the push mode. For example, under the DLNA protocol, the display device 200 can obtain a link address of a resource in the terminal device 500 through a screen projection data channel, and obtain asset content data by accessing the link address, so as to play the asset data. Meanwhile, the display device 200 can also obtain control instructions sent by the terminal device 500 through the screen projection data channel when playing the asset data, such as fast forward, pause, stop screen projection, etc. For example, after establishing a connection through a communication protocol, the terminal device 500 such as a mobile phone and the display device 200 will negotiate the device functions and network conditions to select a suitable video and audio transmission format. After establishing a session for video and audio streaming, a series of real-time streaming protocol (RTSP) control commands are used to control the play and termination of the video and audio streaming.

[0094] ​In other screen projection connection protocols such as Miracast screen projection, Airplay screen projection, NFC mirror screen projection, and Leplay screen projection, the display device 200 can obtain a video stream, and at this time, the video stream is screen projection data. The video stream can be video data corresponding to a final display screen of the display unit of the terminal device 500, that is, the video stream includes media content screens, UI interfaces, and other video screen contents that can be displayed in the display unit in the terminal device 500. The video stream can also be only video data that can be obtained in the terminal device 500, such as a media video being played. At this time, the terminal device 500 can be a signal source of the display device 200, the display device 200 can continuously obtain video data through a screen projection data channel, and display the video data in the display 260 in real time, to achieve a synchronous display effect with the terminal device 500. Alternatively, the video stream can also be video data obtained from the cloud, that is, the terminal device 500 can send a URL address of a video media to the display device 200, and the display device 200 accesses the URL address based on a screen projection protocol to obtain screen projection data after receiving the URL address.

[0095] It should be noted that the screen projection protocol described above can not only obtain a video stream in the terminal device 500, but also obtain an audio data stream in the terminal device 500, so that the video data and the audio data can be synchronously sent to the display device 200, to enable the display device 200 to synchronously play the video and the audio.

[0096] The terminal device 500 can obtain different screen projection data according to different screen projection protocols. For example, for system applications or direct screen projection at a system level, the terminal device 500 can establish a screen projection data channel by using a Miracast screen projection protocol, an Airplay screen projection protocol, or a WiDi screen projection protocol. Since the Miracast screen projection protocol and the Airplay screen projection protocol require system-level application permissions, the Miracast screen projection protocol and the Airplay screen projection protocol are only applicable to system applications, or the display device 200 and the terminal device 500 of the same manufacturer directly establish a screen projection connection through an operating system built-in rule.

[0097] The display device 200 can establish a screen projection connection with the terminal device 500 based on any of the screen projection modes provided in the embodiments. In some embodiments, the display device 200 can also set a layout of a screen projection window. To this end, as shown in FIG. 2, the display device 200 can internally include multiple function modules in the same application, such as a screen projection application. The screen projection application includes a data management module, a message processing module, a service management module, an algorithm processing module, a View management module, an application interaction processing module, a location management module, and a screen projection management module. Figure 7

[0098] ​Among them, the data management module mainly manages all the message data involved in the current template, and synchronously updates the data information. The message processing module mainly transmits related messages between different modules, such as transmitting data changes to the View layer for refreshing display, or synchronizing View changes to the data management module for change processing of broadcast data, etc. The service management module is responsible for starting and closing the services of the entire application and some customized processing, such as starting specific services in specific scenarios.

[0099] The algorithm processing module is responsible for all algorithm processing of the entire application. The View management module is mainly responsible for all UI display of the entire template application, and receives data to refresh the display of the View. The application interaction processing module is responsible for the processing of interaction with external applications, such as any entry starting the current template application needs to interact with this module, and different customized management is performed according to the difference of the starting entry. The screen projection management module is responsible for screen projection protocol interaction, client list management, and state information processing of window display content.

[0100] It should be noted that the screen projection application, as an application that can display multiple protocol multi-path mirror projection and push content, is an upper layer application inside the display device 200. The Framework layer of the display device 200 can provide a Java interface for docking with hardware, and the multi-path screen projection viewing application realizes docking with the lower layer and information acquisition through the Java interface of the Framework layer. The other Native, Runtime layer, HAL layer, Linux kernel are all standard layers of Android architecture, and each layer interacts and processes according to the business process.

[0101] The display device 200 first starts the application through the service management module, and does some initialization preparation work, such as starting to listen to the mirror or push the corresponding protocol service; the View management module initializes the View displayed by the application layer; the data management module creates some data processing module data; the algorithm processing module performs algorithm layout calculation on the screen projection content, etc.

[0102] The service management module can start the screen projection application in the process of establishing the screen projection connection, and register a Session; and listen to Usession Connection Listener, Usession Prepare Listener, USession DisplayListener and Usession Event Listener. The Session represents a session of the client and the server, and can save the information of the Client. The Usession Connection Listener is used for listening to the connection and disconnection events of the Session. The Usession Prepare Listener interacts with the screen projection preparation of the Client. The Usession Display Listener listens to the changes of the playing information and state and the state changes of the Client. The Usession EventListener processes the information of the Client control and the like.

[0103] After the initialization of the View is completed, the display device 200 displays a default guide page when entering the application, and the guide page displays some device information, such as the device name of the current display device 200 and the corresponding network information. The guide page is displayed through the standard control system controls TextView and ImageView and the corresponding Layout.

[0104] In order to facilitate the management of the View and the Session, in some embodiments, a management object MultiCastPlayView can be set, wherein the management object MultiCastPlayView can be associated with the information of the Session, SurfaceView / TextureView, and the like. For example, for the terminal device A, the corresponding data of the Client can be represented as: Session: SessionClient, View: SurfaceView / TextureView.

[0105] When the display device 200 prepares the View as the server, it can notify the terminal device 500 as the mobile terminal to record or send the video stream (i.e., the projection data) through UsesionPrepareListener. When the terminal device 500 is ready to send the video information, the display device 200 knows that the projection is to be played through onFirstFrame() of UsesionDisplayListener. Therefore, it can obtain the current client video width and height from the Session, determine the direction of the current video stream based on the width and height, and then use the algorithm to calculate the current position and size to be displayed, i.e., the initial position and size.

[0106] That is, in some embodiments, the display device 200 obtains a screen projection session (Session) sent by the terminal device 500. The screen projection session includes the resolution of the picture frame. The screen resolution of the display device is then detected, and the screen display area of ​​the projection screen is calculated based on the resolution of the picture frame and the screen resolution. Then, initial display parameters are generated based on the screen display area, and the display 260 is controlled to display the projection screen according to the initial display parameters.

[0107] For example, when the resolution of the terminal device 500 is 1920×1080 and the screen resolution of the display device 200 is 1920×1080, the projection data sent by the terminal device 500 to the display device 200 is as follows: Figure 8 As shown in the left part. The algorithm processing module obtains the screen resolution of the screen frame in the projection data from the projection session (Session) as 1920×1080, and then calculates the screen display area of ​​the projection screen as the full-screen area (i.e., the entire user interface) through the screen resolution 1920×1080 and the picture resolution 1920×1080, that is, the projection screen: width 1920, height 1080, distance from the upper left corner position (0, 0). The data management module of the display device 200 can sort and store the data obtained by the algorithm processing module, and then transmit the data, including the initial display parameters: Session: SessionClient, View: SurfaceView / TextureView, Position: (0, 0), Width: 1920, Height: 1080.

[0108] After receiving the data information, the View management module of the display device 200 sets the display parameters through LayoutParams, including the position (i.e., coordinates) from the top and left boundaries, as well as the corresponding display width and height, and then displays the position through the setLayout outParams method. That is:

[0109] FrameLayout.LayoutParams lp1 = new FrameLayout.LayoutParams(width, height, 0); lp1.width = 1920; lp1.height = 1080; lp1.leftMargin = 0; lp1.topMargin = 0; mPlayerView.setLayoutParams(lp1).

[0110] By setting the display position of the projection SurfaceView / TextureView, the display device 200 can display the projection screen as shown in the right part. Figure 8

[0111] It should be noted that the data associated with the management object and the parameters of the algorithm processing provided in the above embodiments are only exemplary and not limited thereto. Other data objects can also be used in the embodiments of the present application.

[0112] In some embodiments, the projection data sent by the terminal device 500 to the display device 200 includes a picture frame used to form a projection picture, and the picture frame includes a valid picture area and an invalid picture area. In terms of visual angle, the valid picture area can be used to present picture content for a user to view. That is, the valid picture area can be a region in the picture frame that has picture content for the user to view, and the invalid picture area can be a region in the picture frame other than the valid picture area, for example, the invalid picture area can be located at the periphery of the valid picture area and has no substantial effect. In other words, the invalid picture area can be a region in the picture frame that has no actual meaning and is a region that the user does not pay attention to. In some embodiments, the invalid picture area can present a single color effect, such as a black, gray, or other solid color region.

[0113] In some embodiments, the display device 200 can scan all pixel points in the picture frame, which can include a row-by-row scanning mode and a column-by-column scanning mode, such as first scanning all pixel points in the picture frame row by row and then scanning all pixel points in the picture frame column by column, or first scanning all pixel points in the picture frame column by column and then scanning all pixel points in the picture frame row by row. Of course, the above scanning order is not unique. The region in which the color values of all row and array pixel points are target values is marked as an invalid picture area. The color value is a characteristic numerical value representing the color of a pixel point, such as an RGB value.

[0114] For example, a pixel point with an RGB value of (0, 0, 0) is a pixel point without display content, and a region in the picture frame composed of pixel points with an RGB value of (0, 0, 0) is an invalid picture area, such as Figure 8 ​The area a shown in the figure is the effective image area; the area composed of pixels of other color values ​​is the effective image area, such as Figure 8 As shown in area b, since the RGB values ​​of the pixels in the invalid screen area are not set, a pure color such as black may be displayed.

[0115] In some embodiments, when the target value is the color value corresponding to black, the pixel points of the entire row of the picture frame whose color value is the target value are marked as an invalid picture area, and the pixel points of the entire column of the picture frame whose color value is the target value are marked as an invalid picture area. At this time, the display effect presented by the invalid picture area is black, and the invalid picture area can also be referred to as a black edge or a black edge area. Similarly, when the target value is the color value corresponding to gray, the display effect presented by the invalid picture area is gray, and the invalid picture area can also be referred to as a gray edge or a gray edge area. It is understandable that the principles for other colors are the same as above and will not be elaborated here.

[0116] For example, Figure 9a As shown, when the terminal device 500 is in a horizontal screen state, the media played by the terminal device 500 has an invalid screen area, and the terminal device 500 displays the terminal interface 910; at this time, the terminal device 500 starts recording and sends the projection data to the display device 200. The picture frame 920 in the projection data includes an invalid screen area 922 and a valid screen area 921. The display device 200 displays the following based on the projection data: Figure 9a The projection screen 930 is shown.

[0117] like Figure 9b As shown, when the terminal device 500 is Figure 9a When the horizontal screen state is switched to the vertical screen state, the media played by the terminal device 500 still has an invalid screen area 922, and the terminal device 500 displays the terminal interface 910; at this time, the terminal device 500 starts recording and sends the projection data to the display device 200. The picture frame 920 in the projection data includes the invalid screen area 922 and the valid screen area 921. The display device 200 displays the following based on the projection data: Figure 9b The projection screen 930 is shown.

[0118] Obviously, by Figures 9a-9b As can be seen from the screen projection process shown, when the picture frame of the screen projection data sent by the terminal device 500 includes an invalid picture area, the display device 200 will also completely display the invalid picture area in the user interface, and the invalid picture area will occupy a certain display space of the display device 200.

[0119] Therefore, if Figure 11As shown, in some embodiments, the display device 200 detects the invalid picture area of the picture frame, and calculates the pre-processing width of the picture frame in the first direction and the pre-processing height of the picture frame in the second direction based on the invalid picture area (S1101). The pre-processing width is the width of the valid picture area 921, and the pre-processing height is the height of the valid picture area 922. Wherein, the first direction is perpendicular to the second direction, such as the x direction and the y direction; the pre-processing width is the difference between the width of the picture frame and the width of the invalid picture area in the first direction, and the pre-processing height is the difference between the height of the picture frame and the height of the contentless area in the second direction. Then, the first proportion of the picture frame width and the pre-processing width is calculated, and the second proportion of the picture frame height and the pre-processing height is calculated (S1102). The first proportion is set as the scaling proportion of the projection picture in the first direction, and the second proportion is set as the scaling proportion of the projection picture in the second direction (S1103). Finally, the display device 200 scales the width of the projection picture according to the first proportion, and scales the height of the projection picture according to the second proportion (S1104). That is, the scaling proportions of the first direction and the second direction are calculated respectively, and the projection picture is scaled according to the scaling proportions.

[0120] For example, the resolution of the terminal device 500 is 1920x1080, and the screen resolution of the display device 200 is 1920x1080. As shown in FIG. 9, the terminal device 500 records its own terminal interface based on the projection protocol, and forms projection data, and sends the projection data to the display device 200. Wherein, the picture frame 920 of the projection data has the invalid picture area 921 and the invalid picture area 922, as shown in FIG. 9. Figure 10 As shown, the first direction is the x direction, and the second direction is the y direction. The terminal device 500 records its own terminal interface based on the projection protocol, and forms projection data, and sends the projection data to the display device 200. Wherein, the picture frame 920 of the projection data has the invalid picture area 921 and the invalid picture area 922, as shown in FIG. 9. Figure 10 If the invalid picture area 922 is (128, 72), the algorithm processing module of the display device 200 calculates the pre-processing height by subtracting 72 pixel points from both sides in the y direction, and obtains the pre-processing height as 1080-2*72=936; similarly, the display device 200 calculates the pre-processing width by subtracting 128 pixel points from both sides in the x direction, and obtains the pre-processing width as 1920-2*128=1664.

[0121] After the display device 200 calculates the pre-processed width and pre-processed height, it calculates the ratio of the width and height of the original size of the picture frame to the pre-processed height and pre-processed width. The first ratio is 1920 / 1664, and the second ratio is 1080 / 936. That is, scaleX = (float) 1920 / (float)(1920-2*128) = 1.15f, scaleY = (float) 1080 / (float)(1080-2*72) = 1.15f. Then, the display device 200 sets the position of the View through the View management module. Set scaleX to the scaling ratio of the projection screen (View: Surface View / TextureView) in the x direction, and set scaleY to the scaling ratio of the projection screen in the y direction. In this way, when the display device 200 displays the picture frame of the projection data, it will be presented. Figure 10 The projection screen 930 shown on the right can reduce the invalid screen area in the user interface of the display device 200.

[0122] However, since the position and size of the invalid screen area 922 in the picture frame 920 are uncertain, when the invalid screen area 922 is unevenly distributed or the invalid screen area 922 is overall asymmetric in the x-direction and y-direction, the projection screen 930 is scaled by subtracting the invalid screen areas in the x-direction and y-direction through the algorithm processing module, and the projection screen 930 may appear to be offset in the display device 200.

[0123] To this end, in some embodiments, such as Figure 12 As shown, the display device 200 can detect the invalid screen area of ​​the picture frame (S1201). Then, the target display parameters of the projection screen are calculated based on the invalid screen area (S1202). Among them, the target display parameters are used to set the center point of the valid screen area to the reference center point of the user interface, and to maximize the display proportion of the valid screen area in the user interface. Then, the display 260 is controlled to display the projection screen according to the target display parameters (S1203).

[0124] That is, the display device 200 detects each screen frame 920 of the projection data, and after detecting the invalid screen area of ​​the screen frame 920, calculates the target display parameters of the projection screen according to the size of the invalid screen area 922. Display parameters are used to set the parameters of the projection screen, such as the layout set by the View management module; the target display parameters of the embodiment of the present application are used to set the valid screen area 921 of the screen frame 920 to the reference center point of the user interface, while minimizing the display proportion of the invalid screen area 922 in the user interface and maximizing the proportion of the valid screen area 921 in the user interface.

[0125] That is, the projection screen displayed according to the target display parameter can reduce the invalid screen area 922 in the user interface to the greatest extent, maximize the display of the valid screen area 921 in the screen frame, and enable the center of the valid screen area 921 to be located at the center of the user interface (screen center point). When the display device 200 displays the projection screen, the display parameter of the projection screen is calculated according to the above principle to adjust the display effect of the projection screen.

[0126] For example, when the invalid screen area 922 is a black border area, the projection screen displayed by the display device 200 according to the target display parameter can reduce the black border area in the user interface to the greatest extent, maximize the display of the valid screen area 921 in the user interface, and enable the valid screen area 921 to be displayed in the center of the user interface.

[0127] In some embodiments, the target display parameter includes a scaling ratio of the projection screen 930 in a first direction and a second direction, and a position parameter of the projection screen. The position parameter can include a distance between the projection screen and a left edge of the projection window, a distance between the projection screen and a top edge of the projection window, and the like. The first direction and the second direction are perpendicular, for example, the first direction can be the x direction, and the second direction can be the y direction. When the display device 200 displays the projection screen according to the target display parameter, the width of the projection screen is scaled according to the scaling ratio in the first direction, the height of the projection screen is scaled according to the scaling ratio in the second direction, and the display position of the projection screen is set based on the position parameter. In this way, the display device 200 can scale the projection screen 930 or move the position of the projection screen 930 in the projection window by using the calculated target display parameter, thereby removing the invalid screen area 922 displayed by the display device 200 to the greatest extent, maximizing the display of the valid screen area 921, and maintaining the center display effect of the valid screen area 921.

[0128] Since the projection data is composed of multiple screen frames 920, the invalid screen area 922 of different screen frames 920 can also be different. That is, the position and size of the invalid screen area 922 in the current screen frame and the previous screen frame in the projection data sent by the terminal device 500 can change. For example, as shown in FIG. 9B, the terminal device 500 plays a media asset including dynamic subtitle content. As the media asset plays, the subtitle intermittently appears in the invalid screen area 922 at the bottom of the terminal interface 910. Accordingly, as shown in FIG. 9C, the position of the subtitle in the projection data recorded by the terminal device 500 changes to the valid screen area 921, and the valid screen area 921 and the invalid screen area 922 are constantly changing. Figure 13a Figure 13a

[0129] For example, as shown in FIG. 9B, the terminal device 500 plays a media asset including dynamic subtitle content. As the media asset plays, the subtitle intermittently appears in the invalid screen area 922 at the bottom of the terminal interface 910. Accordingly, as shown in FIG. 9C, the position of the subtitle in the projection data recorded by the terminal device 500 changes to the valid screen area 921, and the valid screen area 921 and the invalid screen area 922 are constantly changing. Figure 13b ​​As shown, the terminal device 500 plays Figure 13a When the media resources shown are displayed, the barrage function is turned on. The barrage content will continue to scroll to the left in the terminal interface 910. Correspondingly, as the barrage scrolls, the location of the barrage in the projection data recorded by the terminal device 500 will change to the effective screen area 921, so Figure 13b The effective screen area 921 and the invalid screen area 922 shown are also constantly changing.

[0130] based on Figure 12 In steps S1201-S1203 shown, in some embodiments, when the invalid image area 922 in the image frame changes, the display device 200 will still display the projected image 930 according to the calculated target display parameters. If the invalid image area 922 of each image frame in the projected data changes frequently, the projected image 930 displayed by the display device 200 will also change continuously, resulting in the effect of switching back and forth between the projected images.

[0131] For example, Figures 13a-13b During the screen projection process shown, the display device 200 receives Figure 13a When the projection data is displayed, the projection screen is displayed according to the target display parameters, and the Figure 14a The display effect shown; the display device 200 receives Figure 13b When the projection data is displayed, the projection screen is displayed according to the target display parameters, and the Figure 14b The display effect shown. Figures 14a-14b As can be seen from the projection screen shown, since the individual picture frames in the projection data are constantly changing, the projection screen presented by the display device 200 will show a frequent switching effect.

[0132] It is understandable that the above-mentioned scenario of changing the invalid screen area 922 based on the dynamic content of the bullet screen and subtitles is only an exemplary description, and the embodiment provided in this application can be applied to any scenario of changing the invalid screen area 922 of the picture frame. In this regard, this application does not impose any limitation.

[0133] Based on the above application scenarios, in some embodiments, such as Figure 15 As shown, the display device 200 may include a display 260, a communicator 220, and a controller 250. The display 260 is configured to display a user interface 261, which includes a projection screen of the terminal device 500; the communicator 200 is configured to establish a communication connection with the terminal device 500 and receive projection data sent by the terminal device 500, wherein the projection data includes a picture frame 920 for forming a projection screen, and the picture frame 920 includes an effective picture area 921 and an invalid picture area 922; the controller 250 is configured to execute the following program steps:

[0134] S1501: detecting an invalid picture area of the picture frame.

[0135] The display device 200 establishes a screen projection connection with the terminal device 500 through the communicator 220, receives the screen projection data sent by the terminal device 500, and controls the display 260 to display the picture frame of the screen projection data based on the full-screen display of the screen projection window. At the same time, in the process of screen projection, the display device 200 also detects the invalid picture area 922 of the picture frame 920 in real time.

[0136] In some embodiments, after the display device 200 establishes a screen projection connection with the terminal device 200 and displays the screen projection picture corresponding to the screen projection data according to the initial display parameter, a timing function is started to determine whether the invalid picture area in the picture frame changes within a target time period. For example, the target time period is 500 ms, and the screen projection application of the display device 200 can perform polling inspection through Handler and Runnable, and use the postDelayed method to execute a Runnable task every 500 ms; or, the display device 200 registers a listener to detect changes in the parameters related to the content area 921.

[0137] It should be noted that the value of the target time period is an empirical value, which can be freely set based on actual conditions. Alternatively, the display device 200 can set different values of the target time period for different screen projection protocols. In this regard, the present application does not make any limitation.

[0138] Therefore, in some embodiments, the display device 200 can detect the valid picture area 921 of the current picture frame and obtain the first area information of the valid picture area 921 in the current picture frame. The first area information includes the width and height of the valid picture area and the position of the valid picture area in the picture frame, such as the upper left corner or the center point coordinates. If the first area information of the current picture frame is inconsistent with that of the previous picture frame, it is marked that the invalid picture area 922 changes; if the first area information of the current picture frame is consistent with that of the previous picture frame, it is marked that the invalid picture area 922 does not change.

[0139] That is, the display device 200 continuously receives the picture frame of the screen projection data and detects the related parameters of the valid picture area 921 in the current picture frame and the previous picture frame in real time, including but not limited to the width and height of the valid picture area 921 and the position of the valid picture area 921 in the picture frame 920. If any of the related parameters of the valid picture area 921 in the current picture frame is inconsistent with that of the valid picture area 921 in the previous picture frame, it is marked that the invalid picture area 922 changes; otherwise, it is marked that the invalid picture area 922 does not change.

[0140] Alternatively, in some embodiments, the display device 200 can also acquire second region information of the invalid picture region 922 in the current picture frame. The second region information includes the width and height of the invalid picture region 922 and the position of the invalid picture region 922 in the picture frame 920. If the second region information of the current picture frame is inconsistent with that of the previous picture frame, it is marked that the invalid picture region 922 is changed; if the second region information of the current picture frame is consistent with that of the previous picture frame, it is marked that the invalid picture region 922 is not changed.

[0141] That is, the display device 200 continuously receives the picture frames of the screen projection data, and detects the related parameters of the invalid picture region 922 in the current picture frame and the previous picture frame in real time, including but not limited to the width and height of the invalid picture region 922 and the position of the invalid picture region 922 in the picture frame 920. If any of the related parameters of the invalid picture region 922 in the current picture frame is inconsistent with that of the invalid picture region 922 in the previous picture frame, it is marked that the invalid picture region 922 is changed; otherwise, it is marked that the invalid picture region 922 is not changed.

[0142] It should be noted that in some embodiments, the display device 200 can also synchronously acquire the first region information and the second region information. The present application does not limit this.

[0143] In some embodiments, when detecting the invalid picture region 922 or the valid picture region 921, the display device 200 can detect the color value (such as RGB value) of each picture frame 920 of the screen projection data to determine the invalid picture region 922 in the picture frame 920. That is, the display device 200 reads the picture frame of the screen projection data and detects the color value of the picture frame. Then, the pixel points with the target value as the color value are marked as the pixel points of the invalid picture region, so as to obtain the invalid picture region of the picture frame 920. The target value represents the color value of the pixel point without display content. For example, taking the color value as the RGB value as an example, the target value can be (0, 0, 0).

[0144] S1502: calculating a target display parameter of the screen projection picture according to the invalid picture region; the target display parameter is used to set a center point of the valid picture region at a reference center point of the user interface, and make the display proportion of the valid picture region in the user interface maximum.

[0145] After detecting the invalid screen area of ​​the picture frame 920, the display device 200 calculates the target display parameters of the projection screen according to the size of the invalid screen area 922. Among them, the display parameters are parameters used to set the projection screen, such as the layout set by the View management module; the target display parameters of the embodiment of the present application are used to set the effective screen area 921 of the picture frame 920 to the reference center point of the user interface, while minimizing the display proportion of the invalid screen area 922 in the user interface and maximizing the display proportion of the effective screen area 921 in the user interface. That is, the projection screen displayed according to the target display parameters can minimize the invalid screen area 922 in the user interface, while allowing the center of the effective screen area 921 to be located at the center position of the user interface (center point of the screen). When the display device 200 displays the projection screen, the display parameters of the projection screen are calculated according to the above principles to adjust the display effect of the projection screen.

[0146] In some embodiments, when calculating the target display parameters, the display device 200 can use the reference center point as the center of symmetry to compare the invalid screen areas in the first direction and the second direction to determine whether the invalid screen area 922 is symmetrical. When determining whether the invalid screen area 922 is symmetrical, the display device 200 can use an image processing algorithm to determine whether the invalid screen area 922 is centrally symmetrical based on the reference center point; or, the display device 200 can also use a geometric symmetry detection algorithm to determine whether the invalid screen area 922 is centrally symmetrical based on the reference center point; or, the display device 200 can also obtain the margins of the invalid screen area 922 from the upper, lower, left, and right boundaries of the user interface (or projection window) to determine whether the invalid screen area 922 is centrally symmetrical based on the reference center point. For ease of description, in the embodiment of the present application, the margins of the invalid screen area 922 from the upper, lower, left, and right boundaries of the user interface are represented as top, bottom, left, and right, respectively.

[0147] It is understood that the present embodiment exemplifies two methods for determining whether the invalid screen area is symmetrical, but is not intended to be limiting. The method for determining whether the invalid screen area 922 is symmetrical may also be implemented based on other methods, such as using a third-party algorithm library or service framework.

[0148] In some embodiments, as Figure 16As shown, the display device 200 detects the first invalid screen area 922a and the second invalid screen area 922b of the screen frame in the first direction, and detects the third invalid screen area 922c and the fourth invalid screen area 922d in the second direction. Then calculate the first margin (left) of the first invalid screen area 922a in the first direction, the second margin (right) of the second invalid screen area 922b in the first direction, the third margin (top) of the third invalid screen area 922c in the second direction, and the fourth margin (bottom) of the fourth invalid screen area in the second direction. That is, the margin corresponding to the first invalid screen area 922a is left, the margin corresponding to the second invalid screen area 922b is right, the margin corresponding to the third invalid screen area 922c is top, and the margin corresponding to the fourth invalid screen area 922d is bottom.

[0149] After calculating the margins of the invalid screen area 922 in each direction, if the first margin is equal to the second margin, and the third margin is equal to the fourth margin, then the invalid screen area 922 is marked as being centrally symmetrical about the reference center point; conversely, if the first margin is not equal to the second margin, and / or the third margin is not equal to the fourth margin, then the invalid screen area 922 is marked as not being centrally symmetrical about the reference center point. That is, when the two margins in the x-direction (left and right) are not equal; or the two margins in the y-direction (top and bottom) are not equal; or the two margins in the x-direction are not equal and the two margins in the y-direction are also not equal, the display device 200 marks the invalid screen area 922 as not being centrally symmetrical about the reference center point.

[0150] It should be noted that the picture frame of the embodiment of the present application may not have one or more of the first invalid picture area, the second invalid picture area, the third invalid picture area and the fourth invalid picture area, that is, the value of any one of the values ​​of top, bottom, left and right can be 0.

[0151] In some embodiments, as Figure 17 As shown, if the invalid picture area 922 is centrally symmetrical about the reference center point, the display device 200 calculates the pre-processed width of the picture frame 920 in the first direction and the pre-processed height of the picture frame in the second direction (S1701). Then, a first ratio of the picture frame width to the pre-processed width and a second ratio of the picture frame height to the pre-processed height are calculated (S1702).

[0152] When the display device 200 calculates that the first ratio is equal to the second ratio, one of the ratios is set as the scaling ratio of the projection screen in the first direction and the second direction. That is, when the first ratio is equal to the second ratio, the display device 200 sets the first ratio as the scaling ratio of the projection screen in the first direction and the second direction, or sets the second ratio as the scaling ratio of the projection screen in the first direction and the second direction to generate the target display parameters (S1703). At this time, the projection display effect of the display device 200 is as follows: Figure 10 shown.

[0153] On the contrary, in some embodiments, when the first ratio is not equal to the second ratio, in order to ensure that the projection screen can be displayed according to the original ratio of the effective screen area 921 after scaling, the display device 200 obtains the minimum value of the first ratio and the second ratio (S1704), and then sets the minimum value as the scaling ratio of the projection screen in the first direction, and sets the minimum value as the scaling ratio of the projection screen in the second direction to generate the target display parameters (S1705). At this time, the projection display effect of the display device 200 is as follows: Figure 18 shown.

[0154] For example, the resolution of the terminal device 500 is 1920×1080, and the screen resolution of the display device 200 is 1920×1080. Figure 18 As shown, the display device 200 calculates that the invalid screen area is centrally symmetrical about the reference center point, and the left and right of the invalid screen area 922 are 100, and the top and bottom are 50. The display device 200 calculates the preprocessing height as 1080-2*50=980, and calculates the preprocessing width as 1920-2*100=1720. Then, the first ratio in the x direction and the second ratio in the y direction are calculated, that is, scaleX=(float)1920 / (float)(1920-2*100)=1.12f, scaleY=(float)1080 / (fl oat)(1080-2*50)=1.10f. The display device 200 obtains the minimum value of 1.10f between the first ratio and the second ratio. Then, the View management module is used to set the position of the View according to the ratio of 1.10f. That is, the projection screen is scaled through View.animate().scaleX(scaleY).scaleY(scaleY). In this way, when the display device 200 displays the picture frame of the projection data, it presents Figure 18 The projection screen 930 shown on the right can reduce the invalid screen area in the user interface of the display device 200.

[0155] like Figure 19As shown, in some embodiments, if the invalid picture area 922 is not centrosymmetric with the reference center point, i.e., the two invalid picture areas in the x direction are not symmetric to each other, or the two invalid picture areas in the y direction are not symmetric to each other, or the two invalid picture areas in the x direction are not symmetric and the two invalid picture areas in the y direction are not symmetric, the display device 200 calculates the pre-processing width of the picture frame 920 in the first direction and the pre-processing height of the picture frame in the second direction (S1901).

[0156] After the pre-processing width and the pre-processing height are calculated, the display device 200 further calculates the target center point of the picture frame 920 under the pre-processing width and the pre-processing height (S1902), i.e., the center point of the valid picture area 921. Then, the center offset is calculated according to the target center point and the reference center point (S1903), and the position parameter of the projection picture is set based on the center offset (S1904). The first ratio of the picture frame width to the pre-processing width is calculated, and the second ratio of the picture frame height to the pre-processing height is calculated (S1905). Similarly, in order to enable the projection picture to be displayed in the original ratio of the valid picture area 921, the minimum value of the first ratio and the second ratio is obtained (S1906), and the minimum value is set as the scaling ratio of the projection picture in the first direction, and the minimum value is set as the scaling ratio of the projection picture in the second direction, to generate the target display parameter (S1907).

[0157] Correspondingly, in some embodiments, when the display device 200 displays the projection picture according to the target display parameter, the position of the projection picture in the user interface is moved according to the position parameter (S1908), and the width of the projection picture is scaled according to the minimum value, and the height of the projection picture is scaled according to the minimum value (S1909).

[0158] S1503: In the target time period, when the invalid picture area changes, it is detected whether the invalid picture area is centrosymmetric with the reference center point.

[0159] When the display device 200 calculates the target display parameter of the current picture frame, it also detects whether the invalid picture area 922 of the current picture frame changes in the target time period. When the invalid picture area 922 of each picture frame in the projection data changes, it indicates that each picture frame in the projection data is constantly changing, i.e., there is dynamic content in the picture frame of the projection data. In order to enable the valid picture area 921 to be completely displayed in the user interface, and to prevent the projection picture from frequently switching, the display device 200 judges whether the invalid picture area 922 of the picture frame is centrosymmetric with the reference center point.

[0160] For example, when the display device 200 determines whether the invalid picture area 922 is centrosymmetric with the reference center point, the display device 200 can determine by the values of top, bottom, left and right; or the display device 200 can also determine by any one of the above embodiments (such as image processing algorithm, symmetry detection algorithm, third-party library or framework, etc.). Here, the present application will not be described in detail.

[0161] S1504: If the invalid picture area is centrosymmetric with the reference center point, the display device displays the screen projection picture according to the target display parameter.

[0162] When the invalid picture area 922 of the picture frame changes and the display device 200 detects that the invalid picture area 922 is centrosymmetric with the reference center point within the target time period, it means that the change area of the dynamic content in the picture frame 920 is symmetrical, and at this time the display device 200 can display the screen projection picture according to the target display parameter. For example, there is a moving bullet screen in the picture frame 920, but the area where the bullet screen moves is centrosymmetric with the reference center point within the target time period; or there is a subtitle in the picture frame 920, but the display area of the subtitle is a dynamic content scene that is centrosymmetric with the reference center point within the target time period.

[0163] The following describes the scenario in which the display device 200 performs step S1504 through three examples. In the examples, the resolution of the terminal device 500 is 1920x1080, the screen resolution of the display device 200 is 1920x1080, and the preset target time period is 500ms.

[0164] Example 1: As Figure 20As shown, the algorithm processing module detects that the invalid screen area 922 in the current screen frame 920 is 0 for left and right, and 50 for top and bottom. The display device 200 then executes steps S1701-S1705. That is, the display device 200 calculates the preprocessing height as 1080-2*50=980, and calculates the preprocessing width as 1920-0=1920. Then, the first ratio in the x-direction and the second ratio in the y-direction are calculated, that is, scaleX=(float)1920 / (float)(1920)=1f, scaleY=(float)1080 / (float)(1080-2*50)=1.10f. The display device 200 obtains the minimum value 1f of the first ratio and the second ratio as the scaling ratio of the projection screen in the x-direction and the y-direction. As the bullet screen moves, the invalid screen area of ​​the picture frame is constantly changing within 500ms, but the moving area of ​​the bullet screen within 500ms is centrally symmetrical about the reference center point, so the display device 200 can set the position of the projection screen according to the target display parameter (1f). Since the minimum value of the first ratio and the second ratio is 1, Figure 20 As shown on the right, the projection screen 930 will still maintain its original display effect after scaling.

[0165] Example 2: For example Figure 21 As shown, the algorithm processing module detects that the invalid image area 922 in the current image frame 920 is (left and right are 120, top and bottom are 50). The display device 200 then executes steps S1701-S1705. That is, the display device 200 calculates the pre-processing height as 1080-2*50=980 and the pre-processing width as 1920-2*120=1680. Then, the first scale in the x-direction and the second scale in the y-direction are calculated, namely scaleX=(float)1920 / (float)(1920-2*120)=1.14f, and scaleY=(float)1080 / (float)(1080-2*50)=1. 10f. The display device 200 obtains the minimum value 1.10f of the first ratio and the second ratio as the scaling ratio of the projection screen in the x-direction and the y-direction. As the bullet screen moves, the invalid screen area of ​​the screen frame is constantly changing within 500ms, but the moving area of ​​the bullet screen within 500ms is centrally symmetrical about the reference center point, so at this time the display device 200 can set the position of the projection screen according to the target display parameter (1.10f). That is, the View management module of the display device 200 scales the projection screen according to 1.10f. In this way, when the display device 200 displays the screen frame of the projection data, it displays as follows Figure 21 The projection screen 930 is shown on the right.

[0166] Example 3: If Figure 22 As shown, the algorithm processing module detects that the invalid picture area 922 in the current picture frame 920 is 405 for left and right, and 656.5 for top and bottom). The display device 200 then executes steps S1701-S1705. That is, the display device 200 calculates the preprocessing height as 1080-2*405=270, and calculates the preprocessing width as 1920-2*656.5=607. Then, the first ratio in the x direction and the second ratio in the y direction are calculated, that is, scaleX=(float)1080 / (float)(1080-2*405)=4f, scaleY=(float)1920 / (float)(1920-2*656.5)=3.2f. The display device 200 obtains the minimum value 3.2f of the first ratio and the second ratio as the scaling ratio of the projection screen in the x direction and the y direction. As the bullet screen moves, the invalid screen area of ​​the screen frame is constantly changing within 500ms, but the moving area of ​​the bullet screen within 500ms is centrally symmetrical at the reference center point, so the display device 200 can set the position of the projection screen according to the target display parameter (3.2f). That is, the View management module of the display device 200 scales the projection screen according to 3.2f. In this way, when the display device 200 displays the screen frame of the projection data, it displays as follows Figure 22 The projection screen 930 is shown on the right.

[0167] S1505: If the invalid image area is not centrally symmetrical about the reference center point, discard the target display parameters so that the display maintains the display parameters of the projected image.

[0168] During the target time period, when the invalid screen area 922 of the picture frame changes, but the display device 200 detects that the invalid screen area 922 is not symmetrical with the reference center point, it means that the changing area of ​​the dynamic content in the picture frame 920 is asymmetrical. At this time, if the display device 200 displays the projection screen according to the target display parameters, the projection screen will appear Figures 14a-14b The effect of frequent switching is shown.

[0169] Therefore, in an embodiment of the present application, within the target time period, when the display device 200 detects that the invalid screen area 922 of the picture frame has changed, but the invalid screen area 922 is not symmetrical about the reference center point, the calculated target display parameters are discarded. That is, the display device 200 can ignore the target display parameters currently calculated by the algorithm processing module based on the invalid screen area in the current picture frame, maintain the display parameters of the projection screen, and thus not scale or move the projection screen. For example, there is a changing barrage in the picture frame 920, but the area where the barrage moves is not symmetrical about the reference center point; or, the barrage is a dynamic content scene that is random in a flash-in and flash-out manner.

[0170] The following describes two examples of the display device 200 executing step S1504. In the examples, the resolution of the terminal device 500 is 1920×1080, the screen resolution of the display device 200 is 1920×1080, and the preset target time period is 500 ms.

[0171] Example 4: If Figure 23a As shown, the algorithm processing module detects that the current invalid screen area is not centrally symmetrical, and the display device 200 executes steps S1901-S1907. Within 500ms, the barrage sometimes appears on the left side of the screen frame and sometimes on the right side of the screen frame, and the invalid screen area is constantly changing. When the barrage appears on the left side of the screen frame, left is 0, right is 120, top and bottom are 50, and the display device 200 calculates the preprocessing height as 1080-2*50=980, and calculates the preprocessing width as 1920-120=1800. Then, the target center point can be obtained as (900,540) through the preprocessing height and preprocessing width; as shown Figure 23bAs shown, after the display device 200 subtracts the margin of the invalid picture area, the center point of the remaining picture frame area (valid picture area) is offset. In order to display the remaining picture frame content in the center, the display device 200 needs to move 60 pixels to the right before it can be scaled. Therefore, the algorithm processing module of the display device 200 can calculate the offset as 960-900=60=60 based on the target center point (900,540) and the reference center point (960,540), that is, a 60° shift to the right. Similarly, when the barrage appears on the right side of the picture frame, left is 120, right is 0, top and bottom are 50; the algorithm processing module will calculate the offset as 900-960=-60, that is, a 60° shift to the left. Then, the first scale in the x-direction and the second scale in the y-direction are calculated: scaleX = (float)1920 / (float)(1920 - 120) = 1.06f, and scaleY = (float)1080 / (float)(1080 - 2*50) = 1.10f. Display device 200 obtains the minimum of the first and second scales, 1.06f, as the scale ratio of the projected image in the x-direction and y-direction.

[0172] Therefore, if Figure 23a As shown in the picture frame 920, as the bullet screen moves, the invalid picture area of ​​the picture frame is constantly changing, and the moving area of ​​the bullet screen within 500ms is not centrally symmetrical at the reference center point. Therefore, at this time, the display device 200 discards the target display parameters to maintain the original display parameters of the picture frame. That is, the algorithm processing module of the display device 200 deletes the target display parameters calculated this time, and the View management module does not modify the display parameters of the projection screen. In this way, when the display device 200 displays the picture frame of the projection data, it can maintain the display effect of the picture frame corresponding to the initial display parameters, and display as shown below. Figure 23a The projection screen 930 is shown on the right.

[0173] Example 5: If Figure 24 As shown, the calculation method of the target display parameter is the same as the principle of the above embodiment, which will not be described here. Figure 24 In the screen projection process shown, the number of bullet comments is small, and the effective screen area 921 for displaying the media resource screen in the screen frame 920 is constantly changing. Therefore, within 500ms, the invalid screen area 922 of each screen frame 920 in the screen projection data changes, and the invalid screen area 921 is not centrally symmetrical about the reference center point. The display device 200 discards the target display parameters calculated by the algorithm processing module, and makes the original display parameters of the projection screen 930, thereby displaying as shown below. Figure 24 The projection screen 930 is shown on the right.

[0174] For the case where the invalid picture area 922 in the picture frame does not change, in some embodiments, when the invalid picture area 922 of each picture frame 920 in the screen projection data changes in the target time period, the display device 200 controls the display 260 to display the screen projection picture according to the target display parameter. That is, if the invalid picture area 922 of the picture frame 920 does not change, it means that the current screen projection data does not include dynamic content such as bullet screen or subtitles located in the invalid picture area. At this time, the display device 200 can display the screen projection picture according to the target display parameter calculated according to the above principle, so as to maximize the invalid picture area 922 displayed by the user interface, increase the effective picture area 921 displayed by the user interface, and at the same time, enable the effective picture area 921 to be displayed in the center of the user interface.

[0175] However, for the media content itself having the invalid picture area 922, the invalid picture area 922 surrounds the boundary of the effective picture area 921. After the terminal device 500 starts the bullet screen function, the bullet screen may be displayed on the invalid picture area 922 at the boundary of the media content. In order to facilitate the distinction, the following embodiments refer to the effective picture area 921 of the media content itself as the media picture area, and refer to the invalid picture area 922 of the media content itself as the black area.

[0176] Therefore, in some embodiments, the display device 200 can also detect a target bullet screen area in the effective picture area 921. The target bullet screen area is the display area of the bullet screen located in the black area. Since the bullet screen is non-essential display content, after detecting the target bullet screen area, the display device 200 updates the target bullet screen area to the invalid picture area 922, so as to calculate the target display parameter according to the updated invalid picture area 922. In this way, when the display device 200 displays the screen projection picture 930, the part of the bullet screen displayed in the black area can be removed, so as to increase the display proportion of the media picture area in the user interface.

[0177] It should be noted that when detecting the target bullet screen area, the display device 200 can perform motion analysis on the picture frame based on at least one of the dynamic nature, moving speed, and text features of the bullet screen, detect the inter-frame difference of each picture frame, and then determine the target bullet screen area according to the ratio of the display content pixel points to the non-display content pixel points. Alternatively, the display device 200 can also detect the target bullet screen area in other ways. In this regard, the present application does not make any limitation.

[0178] Based on the display device 200, the application further provides a dynamic content-based screen projection display method, which is applied to the display device 200 described above. The display device 200 can include a display 260, a communicator 220, and a controller 250. The display 260 is configured to display a user interface 261, which includes a screen projection picture of a terminal device 500. The communicator 220 is configured to establish a communication connection with the terminal device 500 and receive screen projection data sent by the terminal device 500. The screen projection data includes picture frames used to form the screen projection picture, and the picture frames include valid picture areas and invalid picture areas. Figure 15 As shown in FIG. 15, the method includes the following steps:

[0179] S1501: detecting the invalid picture area of the picture frame;

[0180] S1502: calculating a target display parameter of the screen projection picture according to the invalid picture area; the target display parameter is used to set a center point of the valid picture area at a reference center point of the user interface and maximize a display proportion of the valid picture area in the user interface;

[0181] S1503: detecting whether the invalid picture area is centrosymmetric to the reference center point within a target time period when the invalid picture area changes;

[0182] S1504: if the invalid picture area is centrosymmetric to the reference center point, controlling the display to display the screen projection picture according to the target display parameter;

[0183] S1505: if the invalid picture area is not centrosymmetric to the reference center point, discarding the target display parameter to make the display maintain a display parameter of the screen projection picture.

[0184] According to the technical solution, the display device and the screen projection display method based on dynamic content can detect the invalid picture area of the picture frame in the screen projection data, and calculate the target display parameter of the screen projection picture according to the invalid picture area. The target display parameter is used to set the center point of the valid picture area in the picture frame to the reference center point of the user interface, and to maximize the display ratio of the valid picture area in the user interface. In the target time period, when the invalid picture area changes, it is detected whether the invalid picture area is centrally symmetric with the reference center point. If the invalid picture area is centrally symmetric with the reference center point, the screen projection picture is displayed according to the target display parameter; if the invalid picture area is not centrally symmetric with the reference center point, the target display parameter is discarded to maintain the display parameter of the screen projection picture. The method improves the problem of frequent switching of the screen projection picture while reducing the invalid picture area displayed by the screen projection picture and keeping the valid picture area displayed in the center, thereby improving the viewing experience of the user.

[0185] The same or similar parts between various embodiments in the specification can be referred to each other, which will not be described here.

[0186] Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application or the part that contributes to the prior art can be embodied in the form of software products, which can be stored in storage media such as ROM / RAM, magnetic disk, optical disk, etc., and include a plurality of instructions to make a computer device (which can be a personal computer, server, or network device, etc.) execute the method of various embodiments or some parts of the embodiments of the present application.

[0187] Finally, it should be pointed out that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0188] In order to facilitate explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display configured to display a user interface, wherein the user interface includes a projection screen of the terminal device; a communicator configured to establish a communication connection with a terminal device and receive projection data sent by the terminal device, wherein the projection data includes a picture frame for forming the projection picture, and the picture frame includes a valid picture area and an invalid picture area; The controller is configured as: Detecting an invalid picture area of ​​the picture frame; Calculating target display parameters of the projection screen based on the invalid screen area; the target display parameters are used to set the center point of the valid screen area to the reference center point of the user interface, and to maximize the display proportion of the valid screen area in the user interface; within a target time period, when the invalid screen area changes, detecting whether the invalid screen area is centrally symmetrical about the reference center point; If the invalid screen area is centrally symmetrical about the reference center point, controlling the display to display the projection screen according to the target display parameters; If the invalid screen area is not centrally symmetrical about the reference center point, the target display parameters are discarded so that the display maintains the display parameters of the projection screen.

2. The display device according to claim 1, wherein After receiving the projection data of the terminal device through the communicator, the controller is further configured to: Obtaining a screen projection session sent by the terminal device, where the screen projection session includes a resolution of the picture frame; Detect the screen resolution of the display device; Calculating a screen display area of ​​the projection screen according to the resolution of the screen frame and the screen resolution; Initial display parameters are generated based on the screen display area, and the display is controlled to display the projection screen according to the initial display parameters.

3. The display device according to claim 1, wherein After calculating the target display parameter, the controller is further configured to: When the invalid screen area has not changed, the display is controlled to display the projection screen according to the target display parameters.

4. The display device according to claim 1, wherein The controller is further configured to: Detect the valid picture area of ​​the current picture frame; Acquire first region information of the effective picture area in the current picture frame, where the first region information includes width and height of the effective picture area and a position of the effective picture area in the picture frame; If the first area information of the current picture frame is inconsistent with that of the previous picture frame, marking that the invalid picture area is changed; If the first region information of the current picture frame is consistent with the first region information of the previous picture frame, the invalid picture region is marked as unchanged.

5. The display device according to claim 1, wherein The controller is further configured to: Acquire second region information of the invalid picture area in the current picture frame, where the second region information includes width and height of the invalid picture area and a position of the invalid picture area in the picture frame; If the second area information of the current picture frame is inconsistent with that of the previous picture frame, marking that the invalid picture area is changed; If the second region information of the current picture frame is consistent with the second region information of the previous picture frame, the invalid picture region is marked as unchanged.

6. The display device according to claim 1, wherein The controller detects whether the invalid screen area is centrally symmetric with respect to the reference center point, and is configured to: Detecting a first invalid picture area and a second invalid picture area of ​​the picture frame in a first direction, and detecting a third invalid picture area and a fourth invalid picture area of ​​the picture frame in a second direction, wherein the first direction is perpendicular to the second direction; Calculating a first margin of the first invalid screen area in the first direction, a second margin of the second invalid screen area in the first direction, a third margin of the third invalid screen area in the second direction, and a fourth margin of the fourth invalid screen area in the second direction; If the first margin is equal to the second margin and the third margin is equal to the fourth margin, marking the invalid screen area to be centrally symmetrical with respect to the reference center point; If the first margin is not equal to the second margin, and / or the third margin is not equal to the fourth margin, the invalid screen area is marked as not being centrally symmetrical about the reference center point.

7. The display device according to claim 1, wherein The controller calculates the target display parameters of the projection image and is configured to: Taking the reference center point as the center of symmetry, comparing the invalid screen areas in a first direction and a second direction, where the first direction is perpendicular to the second direction; If the invalid picture area is centrally symmetric with respect to the reference center point, calculating a pre-processed width of the picture frame in the first direction and a pre-processed height of the picture frame in the second direction; The pre-processing width is the difference between the picture frame width and the invalid picture area width in the first direction, and the pre-processing height is the difference between the picture frame height and the invalid picture area height in the second direction; calculating a first ratio of the picture frame width to the preprocessing width, and calculating a second ratio of the picture frame height to the preprocessing height; When the first ratio is equal to the second ratio, the first ratio is set to the scaling ratio of the projection screen in the first direction and the second direction, or the second ratio is set to the scaling ratio of the projection screen in the first direction and the second direction to generate the target display parameters.

8. The display device according to claim 7, wherein: The controller is further configured to: When the first ratio is not equal to the second ratio, obtaining a minimum value of the first ratio and the second ratio; The minimum value is set as the scaling ratio of the projection screen in the first direction, and the minimum value is set as the scaling ratio of the projection screen in the second direction to generate the target display parameters.

9. The display device according to claim 7, wherein: The controller is further configured to: If the invalid picture area is not centrally symmetrical about the reference center point, calculating a pre-processed width of the picture frame in the first direction and a pre-processed height of the picture frame in the second direction; The pre-processing width is the difference between the picture frame width and the invalid picture area width in the first direction, and the pre-processing height is the difference between the picture frame height and the invalid picture area height in the second direction; Calculating a target center point of the picture frame under the preprocessing width and the preprocessing height; Calculating a center offset according to the target center point and the reference center point; Setting a position parameter of the projection screen based on the center offset, wherein the position parameter is used to set a display position of the projection screen; calculating a first ratio of the picture frame width to the preprocessing width, and calculating a second ratio of the picture frame height to the preprocessing height; Obtaining a minimum value of the first ratio and the second ratio; The minimum value is set as the scaling ratio of the projection screen in the first direction, and the minimum value is set as the scaling ratio of the projection screen in the second direction to generate the target display parameters.

10. A screen projection display method based on dynamic content, characterized in that: Applied to a display device, the display device includes a display, a communicator, and a controller, the display is configured to display a user interface, the user interface includes a projection screen of a terminal device; the communicator is configured to establish a communication connection with the terminal device and receive projection data sent by the terminal device, the projection data includes a picture frame for forming the projection screen; the method includes: Detecting an invalid picture area of ​​the picture frame; Calculating target display parameters of the projection screen based on the invalid screen area; the target display parameters are used to set the center point of the valid screen area to the reference center point of the user interface, and to maximize the display proportion of the valid screen area in the user interface; within a target time period, when the invalid screen area changes, detecting whether the invalid screen area is centrally symmetrical about the reference center point; If the invalid screen area is centrally symmetrical about the reference center point, controlling the display to display the projection screen according to the target display parameters; If the invalid screen area is not centrally symmetrical about the reference center point, the target display parameters are discarded so that the display maintains the display parameters of the projection screen.

Images