A display device, a method and a medium for receiving screen mirroring content

Abstract

The display device provided by the present application, the controller is configured to: receive the screen-cast media resource, and determine the media resource attribute; if the media resource attribute is a video, detect the portrait / landscape state of the display, obtain the video aspect ratio, and determine whether the video aspect ratio matches the portrait / landscape state of the display; if the media resource attribute is a picture, fill the screen for display according to the original ratio of the current image aspect ratio. The display device provided by the present application can process images and videos separately according to the attributes of the received screen-cast content. For images, they are directly displayed, while for videos, it is determined whether rotation is required based on the video aspect ratio and the portrait / landscape state of the display, so that the video playback better adapts to the ratio of the display, improving the user experience.

Description

Technical Field

[0001] This application relates to the technical field of smart TVs, and in particular to a display device and a method for receiving screen mirroring content. Background Art

[0002] Screen sharing is an interactive operation of multiple display devices. Generally, wireless networks are used to transfer media resources, so that the content displayed on one display device can be synchronized to a second display device for users to view. Taking mobile phone screen mirroring as an example, for a mobile phone and a smart TV connected to the same WiFi network, the mobile phone can execute a screen mirroring operation instruction to send the screen displayed on the mobile phone to the smart TV in the form of a video stream, so as to utilize the large screen of the smart TV to obtain a better user experience.

[0003] Since media resources can be vertical resources or horizontal resources, when the media resource stream is synchronized from one device to a second display device, there is a possibility that the aspect ratio of the media resource is different from the presentation mode of the display device. For example, the display size of the media resource is 4:3, while the display device is 3:4.

[0004] In order to fully display the screen on the mobile phone and maximize the display ratio, the display device needs to adaptively match the media resources. Summary of the Invention

[0005] This application provides a display device and a method for receiving screen mirroring content, so that the presentation state of the display is adapted to the screen mirroring content.

[0006] On the one hand, this application provides a display device, including: a display;

[0007] A rotation component configured to drive the display to rotate so that the display is in one of a landscape state or a portrait state;

[0008] A user interface, the communication information of which is configured to be connected to a terminal;

[0009] A controller configured to:

[0010] Receive screen mirroring media resources and determine the attributes of the media resources;

[0011] If the media resource attribute is a video, detect the landscape / portrait state of the display, obtain the video aspect ratio, and determine whether the video aspect ratio matches the landscape / portrait state of the display, and determine whether the display needs to be rotated according to the matching situation;

[0012] If the media resource attribute is a picture, display it by filling the screen according to the original ratio of the current image aspect ratio.

[0013] Second aspect, the present application provides a method for receiving screen mirroring content, including:

[0014] Receiving screen mirroring media resources and determining the attributes of the media resources;

[0015] If the media resource attribute is a video, detecting the horizontal / vertical screen state of the display, obtaining the video aspect ratio, and determining the matching situation between the video aspect ratio and the horizontal / vertical screen state of the display, and determining whether the display needs to be rotated according to the matching situation;

[0016] If the media resource attribute is a picture, filling the screen for display according to the original ratio of the current image aspect ratio. As can be seen from the above technical solutions, the display device provided by the present application, the controller is configured to: receive screen mirroring media resources and determine the attributes of the media resources; if the media resource attribute is a video, detect the horizontal / vertical screen state of the display, obtain the video aspect ratio, and determine whether the video aspect ratio matches the horizontal / vertical screen state of the display; if the media resource attribute is a picture, fill the screen for display according to the original ratio of the current image aspect ratio. The display device provided by the present application can process images and videos separately according to the attributes of the received screen mirroring content, directly display the images, and for videos, determine whether rotation is needed according to the video aspect ratio and the horizontal / vertical screen state of the display, making the video playback more adaptable to the ratio of the display and improving the user experience. Description of the Drawings

[0017] In order to more clearly illustrate the technical solutions of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

[0018] Figure 1 It is an application scenario diagram of a display device of the present application;

[0019] Figure 2 It is a hardware configuration block diagram of the control device of the present application;

[0020] Figure 3A It is a schematic diagram of the horizontal mode of the mobile terminal of the present application;

[0021] Figure 3B It is a schematic diagram of the vertical mode of the mobile terminal of the present application;

[0022] Figure 4 It is a schematic diagram of receiving horizontal media resources when the display device is in the horizontal screen in an embodiment of the present application;

[0023] Figure 5Schematic diagram of a display device in a vertical screen state in an embodiment of the present application when receiving a horizontal media resource and rotating it to a horizontal screen;

[0024] Figure 6 Schematic diagram of a display device in a vertical screen state in an embodiment of the present application when receiving a vertical media resource;

[0025] Figure 7 Schematic diagram of a display device in a horizontal screen state in an embodiment of the present application when receiving a vertical media resource and rotating it to a vertical screen;

[0026] Figure 8 Schematic flowchart of a method for processing received screen mirroring data in the present application;

[0027] Figure 9 Schematic flowchart of comparing the sampling resolution with the initial resolution in the present application. Detailed implementation manners

[0028] The embodiments will be described in detail below, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0029] In the technical solution provided by the present application, the display device may be an electrical device such as a smart TV with a relatively large screen that presents video and audio signals to users. The display device may have an independent operating system and support function expansion. Various application programs can be installed in the display device according to user needs. For example, traditional video applications, social applications such as short videos, and reading applications such as comics and reading books. These applications can use the screen of the display device to display the application interface and provide users with richer media resources. At the same time, the display device can also perform data interaction and resource sharing with different terminals. For example, a smart TV can be connected to a mobile phone through wireless communication methods such as a local area network and Bluetooth, so as to play the resources in the mobile phone or directly perform screen mirroring to display the screen on the mobile phone.

[0030] An embodiment of the present application provides a display device and a computer storage medium. The display device, such as a TV that supports horizontal and vertical screen rotation, is abbreviated as a rotatable TV. It should be noted that the method provided in this embodiment is not only applicable to rotatable TVs, but also applicable to other display devices, such as computers, tablets, etc., to facilitate users to display the target media details page in different horizontal and vertical screen states of the display, and improve the user viewing experience of the display device in different viewing states.

[0031] As used in the embodiments of the present application, the term "module" may refer to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that can perform functions related to that element.

[0032] As used in the embodiments of the present application, the term "remote control" refers to a component of an electronic device (such as the display device disclosed in the present application), which can generally wirelessly control the electronic device within a relatively short distance range. This component can generally be connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface on a touch screen.

[0033] As used in the embodiments of the present application, the term "gesture" refers to a user behavior in which a user expresses an intended idea, action, purpose, and / or result through a change in hand shape or a hand movement.

[0034] As used in the embodiments of the present application, the term "hardware system" may refer to an entity component composed of mechanical, optical, electrical, and magnetic devices such as integrated circuits (ICs) and printed circuit boards (PCBs), which has functions of computing, controlling, storing, inputting, and outputting. In various embodiments of the present application, the hardware system is usually also referred to as a motherboard or a main chip or a controller.

[0035] See Figure 1 , which is an application scenario diagram of a display device provided in some embodiments of the present application. As Figure 1 shown, communication can be carried out between the control device 100 and the display device 200 in a wired or wireless manner.

[0036] Among them, the control device 100 is configured to control the display device 200. It can receive operation instructions input by the user and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing a mediating role in the interaction between the user and the display device 200. For example: when the user operates the channel up / down keys on the control device 100, the display device 200 responds to the channel up / down operation.

[0037] The control device 100 can be a remote control 100A, including infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 wirelessly or through other wired means. The user can input user instructions through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. For example, the user can input corresponding control instructions through the volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input button, menu button, power on / off button, etc. on the remote control to achieve the function of controlling the display device 200.

[0038] The control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a laptop, etc. For example, use the application program running on the smart device to control the display device 200. The application program can provide various controls for the user through an intuitive user interface (UI) on the screen associated with the smart device through configuration.

[0039] Exemplarily, the mobile terminal 100B can install a software application with the display device 200, and establish connection communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example: The mobile terminal 100B and the display device 200 can establish a control instruction protocol, and by operating various function keys or virtual controls on the user interface provided on the mobile terminal 100B, the functions of the physical buttons arranged like the remote control 100A can be achieved. It is also possible to transmit the audio and video content displayed on the mobile terminal 100B to the display device 200 to achieve the synchronous display function.

[0040] The display device 200 can provide network TV functions with broadcast reception functions and computer support functions. The display device can be implemented as a digital TV, an Internet TV, an Internet Protocol TV (IPTV), etc.

[0041] The display device 200 can be a liquid crystal display, an organic light-emitting display, a projection device. The specific display device type, size, and resolution are not limited.

[0042] The display device 200 also communicates with the server 300 for data communication through various communication methods. Here, the display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 can provide various contents and interactions to the display device 200. Exemplarily, the display device 200 can send and receive information, for example: receive electronic program guide (EPG) data, receive software program updates, or access a remotely stored digital media library. The server 300 can be a group, or multiple groups, and can be one type or multiple types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 300.

[0043] Figure 2 The hardware configuration block diagram of the display device 200 is exemplarily shown. As Figure 2 shown, the display device 200 may include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotation assembly 276, an audio processor 280, an audio output interface 285, and a power supply 290.

[0044] Among them, the rotation assembly 276 may include components such as a drive motor and a rotating shaft. Among them, the drive motor may be connected to the controller 250 and output a rotation angle under the control of the controller 250; one end of the rotating shaft is connected to the power output shaft of the drive motor, and the other end is connected to the display 275, so that the display 275 can be fixedly installed on the wall or bracket through the rotation assembly 276.

[0045] The rotation assembly 276 may further include other components, such as transmission components, detection components, etc. Among them, the transmission components can adjust the rotation speed and torque output by the rotation assembly 276 through a specific transmission ratio, and can be a gear transmission method; the detection components can be composed of sensors arranged on the rotating shaft, such as angle sensors, attitude sensors, etc. These sensors can detect parameters such as the rotation angle of the rotation assembly 276 and send the detected parameters to the controller 250, so that the controller 250 can judge or adjust the state of the display device 200 according to the detected parameters. In practical applications, the rotation assembly 276 may include one or more of the above components, but is not limited thereto.

[0046] The tuner demodulator 210 receives radio and television signals by wire or wirelessly, and can perform modulation and demodulation processes such as amplification, mixing, and resonance, and is used to demodulate the audio and video signals carried in the frequencies of the TV channels selected by the user from multiple wireless or wired radio and television signals, as well as additional information (such as EPG data).

[0047] In some other exemplary embodiments, the tuner demodulator 210 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs a TV signal after modulation and demodulation, and inputs it into the display device 200 through the external device interface 240.

[0048] The communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the display device 200 can send content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include network communication protocol modules such as a WIFI module 221, a Bluetooth communication protocol module 222, a wired Ethernet communication protocol module 223, or a near-field communication protocol module. Thus, the communicator 220 can receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a Bluetooth signal, a radio frequency signal, etc.

[0049] The detector 230 is a component of the display device 200 for collecting signals of the external environment or interacting with the outside. The detector 230 may include a sound collector 231, such as a microphone, which can be used to receive the user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, it can collect environmental sounds for identifying the type of environmental scene, so that the display device 200 can adapt to environmental noise.

[0050] The external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and an external device. The external device interface 240 can be connected to external devices such as a set-top box, a gaming device, a laptop computer, etc. in a wired / wireless manner, and can receive data such as video signals (e.g., moving images), audio signals (e.g., music), additional information (e.g., EPG) from the external device.

[0051] The controller 250 controls the operation of the display device 200 and responds to the user's operations by running various software control programs (such as an operating system and various application programs) stored in the memory 260.

[0052] In some exemplary embodiments, the controller 250 includes a random access memory (RAM), a read-only memory (ROM), a graphics processor, a CPU processor, a communication interface, and a communication bus. Among them, the RAM, ROM, the graphics processor, and the CPU processor communication interface are connected through the communication bus.

[0053] The ROM is used to store various system startup instructions. For example, when a power-on signal is received, the power of the display device 200 starts to boot up, and the CPU processor 254 runs the system startup instructions in the ROM 252, copies the operating system stored in the memory 260 to the RAM 251 to start running the startup operating system. After the operating system starts up, the CPU processor 254 then copies various application programs in the memory 260 to the RAM 251, and then starts to run and start various application programs.

[0054] The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces connected to external devices via a network.

[0055] The controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

[0056] Among them, the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object, such as an operation of displaying a connection to a hyperlink page, document, image, etc., or an operation of executing a program corresponding to the object. The user input command for selecting a GUI object may be an input command input through various input devices (e.g., a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

[0057] The memory 260 is used to store various types of data, software programs, or application programs for driving and controlling the operation of the display device 200. The memory 260 may include volatile and / or non-volatile memory. The term "memory" includes the memory 260, the RAM and ROM of the controller 250, or the memory card in the display device 200.

[0058] In some embodiments, the memory 260 is specifically used to store the operating program for driving the controller 250 in the display device 200; store various application programs built in the display device 200 and downloaded by the user from external devices; store data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUI, and selectors for selecting GUI objects.

[0059] In some embodiments, the memory 260 is specifically used to store driver programs and related data of the tuner 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., such as external data (e.g., audio and video data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received from the user interface.

[0060] Figure 2Among them, the user interface 265 receives various user interactions. Specifically, it is used to send the user's input signal to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote controller 100A can send input signals such as power switch signals, channel selection signals, volume adjustment signals, etc. input by the user to the user interface 265, and then the user interface 265 forwards them to the controller 250; or, the remote controller 100A can receive output signals such as audio, video, or data output from the user interface 265 after being processed by the controller 250, and display the received output signals or output the received output signals in the form of audio or vibration.

[0061] In some embodiments, the user can input a user command in the graphical user interface (GUI) displayed on the display 275, and then the user interface 265 receives the user input command through the GUI. Specifically, the user interface 265 can receive a user input command for controlling the position of a selector in the GUI to select different objects or items. Among them, the "user interface" is a media interface for interaction and information exchange between an application program or an operating system and the user, and it realizes the conversion between the internal form of information and the form acceptable to the user. The common manifestation form of the user interface is the graphical user interface (GUI), which refers to the user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, and the control can include visible interface elements such as icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, Widgets, etc.

[0062] Or, the user can input a user command by inputting a specific sound or gesture, and then the user interface 265 receives the user input command by identifying the sound or gesture through a sensor.

[0063] The video processor 270 is used to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, and can obtain a video signal that can be directly displayed or played on the display 275.

[0064] The display 275 is used to receive the image signal input from the video processor 270 and display video content, images, and menu control interfaces. The displayed video content can be the video content in the broadcast signal received by the tuner demodulator 210, or the video content input from the communicator 220 or the external device interface 240. The display 275 also displays the user control interface UI generated in the display device 200 and used to control the display device 200.

[0065] In addition, the display 275 may include a display screen component for presenting a picture and a driving component for driving image display. Alternatively, if the display 275 is a projection display, it may further include a projection device and a projection screen.

[0066] Rotation component 276, and the controller may issue a control signal to cause the rotation component 276 to rotate the display 275.

[0067] Audio processor 280, which is used to receive external audio signals, perform decompression, decoding, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal, to obtain an audio signal that can be played in the speaker 286.

[0068] Power supply 290, which is used to provide power supply support for the display device 200 for the power input from an external power source under the control of the controller 250. The power supply 290 may be a built-in power circuit installed inside the display device 200, or a power source installed outside the display device 200.

[0069] During the screen mirroring process, the mobile terminal 100B may send display picture data to the display device 200 through a wireless connection method, such as through the Miracast protocol or the DLNA protocol, to form a screen mirroring video stream. When the display device 200 receives the screen mirroring video stream, it may decode the screen mirroring video stream through the controller 250, parse out the frame pictures, and after processing, form a screen mirroring picture and send it to the display 275 for display.

[0070] The following takes the screen mirroring from a mobile terminal to a TV as an example for illustration. The mobile terminal 100B may be an intelligent terminal device with display and human-computer interaction functions, such as a mobile phone, a tablet computer, etc. The videos or pictures on the mobile terminal may be content with the horizontal direction as the positive direction. For example, when the mobile phone is placed horizontally, a TV drama is being played. When the mobile phone is placed horizontally, the aspect ratio of the screen is greater than 1. The videos or pictures on the mobile terminal may also be content with the vertical direction as the positive direction, such as pictures taken when the user's mobile phone is placed vertically. When the mobile phone is placed vertically, the aspect ratio of the screen is less than 1.

[0071] In some embodiments, the TV may support horizontal and vertical rotation under the drive of the rotation component. For example, when playing a TV drama or a movie with a landscape orientation, since these media resources are generally landscape-oriented, the TV is placed horizontally to present the landscape media resources. When playing fitness or portrait-oriented media resources, the TV is rotated to the vertical position to present the portrait resources.

[0072] In some embodiments, when the TV is placed horizontally and no rotation instruction is triggered, it may also present portrait resources received through screen mirroring. And when the TV is placed vertically and a rotation instruction is triggered, it may also present landscape resources received through screen mirroring.

[0073] In some embodiments, when screen sharing is performed via the DLNA protocol, the display device can obtain the horizontal and vertical presentation states of the image. Since the media resources on the mobile terminal 100B can be presented in a horizontal or vertical layout, the screen mirroring screen also has different layout modes. For example, when the user presents horizontal media resources on the mobile phone, the width of the screen is greater than the height of the screen, as Figure 3A shown. When the user presents vertical media resources on the mobile phone, the width of the screen is less than the height of the screen, as Figure 3B shown.

[0074] In order to enable the display device 200 to automatically rotate the screen according to the horizontal and vertical states of the screen on the mobile terminal 100B during screen mirroring, so as to achieve a better user experience, a screen mirroring protocol can be configured between the display device 200 and the mobile terminal 100B, such as a screen mirroring protocol based on the DLNA standard, a screen mirroring protocol based on the Airplay standard, etc. The video stream of the screen is transmitted through the screen mirroring protocol, so that the screen on the mobile terminal 100B can be screen mirrored to the display device 200.

[0075] In some embodiments, the screen mirroring content can be a video or a picture. Generally, the user spends a longer time browsing videos and a relatively shorter time browsing pictures.

[0076] When the screen mirroring content received by the display device is a video, it can detect the horizontal and vertical screen relationship of the video content, and combine the current display mode of the display to determine whether to rotate. If a horizontal video is received in the horizontal screen state and full-screen playback can be achieved, the original state can be maintained and the video can be played directly, as Figure 4 shown. If a horizontal video is received in the vertical screen state and is intelligently presented on a partial display interface due to the inconsistent aspect ratio, while playing the video in the vertical screen first, the rotation component is controlled to rotate the display 275 of the display device to the horizontal screen state to achieve full-screen playback, as Figure 5 shown.

[0077] If a vertical video is received in the vertical screen state and full-screen playback can be achieved, the original state can be maintained and the video can be played directly, as Figure 6 shown. If a vertical video is received in the horizontal screen state and is intelligently presented on a partial display interface due to the inconsistent aspect ratio, while playing the video in the horizontal screen first, the rotation component is controlled to rotate the display 275 of the display device to the vertical screen state to achieve full-screen playback, as Figure 7 shown.

[0078] When the screen-cast content is a picture, the user may be browsing an application related to a photo album. At this time, the user's stay time on a single picture is limited. The user may choose the previous picture for screen-casting to be horizontal, and the next picture will become vertical, and then become horizontal again in the next one. Moreover, the change in the presentation state of the display device, that is, the rotation component driving the display device to rotate takes a certain amount of time. When the display device placed horizontally just receives the vertical resource and starts to rotate to the vertical, the user may trigger an instruction to browse the next picture, and it needs to change back to the horizontal again. In this way, the display device rotates frequently, which not only affects the user experience but also reduces the service life of the display device.

[0079] In some embodiments, in a display device of the present application, it is necessary to determine whether to rotate the display according to the received media resource information, the horizontal and vertical states of the media assets, and the presentation state of its own display. For video playback, when pushed from the mobile phone side, the TV side rotates and zooms in / out the TV and the video playback interface with the video picture, always keeping the video in a vertical state, and finally adapting to the display effect of the entire screen. For picture playback, based on the horizontal and vertical screens of the TV side, in the horizontal screen, it is displayed maximally in the original proportion in the horizontal screen, and in the vertical screen, it is displayed maximally in the original proportion in the vertical screen. When rotating, the rotation angle is reset, and finally it is adapted to the display screen with the maximum proportion.

[0080] In some embodiments, for video playback: when the TV side receives the video link from the mobile phone side, it accesses the video resource, determines the horizontal and vertical screens of the TV side, and registers an angle monitor. After obtaining the video width and height, it is displayed and played on the TV side by adapting to the entire screen in the original proportion. When the video width and height are inconsistent with the horizontal and vertical screens of the TV, a rotation instruction is sent, and the angle information of the current TV rotation is obtained through the angle monitor. The zoom factor required for the video picture to be calculated is set to the frame grabbing interface. When the frame grabbing interface obtains the angle information and the zoom factor, it performs angle and zoom settings on the current video playback picture, always ensuring that the image is vertically displayed until the rotation ends.

[0081] In some embodiments, for picture playback: when the TV side receives the picture push request from the mobile phone side, it determines the horizontal and vertical screens of the current TV side, and displays it by filling the entire screen with the original proportion of the current image width and height. When the user manually rotates the TV with the remote control, when the ConfigurationChange is monitored, the angle and the zoom factor are set to ensure that the picture is tiled across the entire screen in the original proportion.

[0082] A display device provided by the present application includes:

[0083] A display;

[0084] A rotation component configured to drive the display to rotate so that the display is in one of the rotation states of a horizontal screen state or a vertical screen state;

[0085] A user interface, the communication information of which is configured to be connected to a terminal;

[0086] And a controller, see Figure 8 , which is configured to execute:

[0087] S01: Receive the screen mirroring media resource and determine the attributes of the media resource;

[0088] In practical applications, the user can first perform a screen mirroring display operation on the mobile terminal 100B to send the display screen of the mobile terminal 100B to the display device 200. For example, the user successively selects "Settings - Connection & Sharing - Screen Mirroring" on the mobile phone, and selects a display device in the current network in the device list of the screen mirroring operation as the screen mirroring object, and then performs the screen mirroring operation.

[0089] After performing the screen mirroring operation, the mobile terminal 100B will send the displayed screen to the display device 200 through a screen mirroring protocol, such as the DLNA protocol or other mirroring protocols. As new interactive screens are continuously generated during the screen mirroring process, the mobile terminal 100B will send the screens frame by frame to the display device 200, forming a screen mirroring data stream (hereinafter referred to as a screen mirroring video stream).

[0090] It should be noted that the user can also perform a screen mirroring operation through a third-party application. For example, when the user opens a video application, there is a screen mirroring icon on the video playback interface of the video application. The user can click on this icon to perform the screen mirroring operation. Generally, the screen mirroring screen through a third-party application is based on the played video resource. For example, when the played video resource is a landscape media such as a movie or a TV drama, the width of the effective screen in the screen mirroring screen is greater than the height; when the played video resource is a vertical media such as a short video or a comic, the width of the effective screen in the screen mirroring screen is less than the height.

[0091] The TV receives the media resource and determines whether the received is a video or an image according to the attributes of the media resource.

[0092] S02: If the media resource attribute is a video, detect the horizontal and vertical screen states of the display, obtain the video aspect ratio, and determine the matching situation between the video aspect ratio and the horizontal and vertical screen states of the display, and determine whether it is necessary to rotate the display according to the matching situation.

[0093] After receiving the screen-cast video stream, the display device 200 starts to register the monitoring of the rotation angle, calls back the current real-time rotation angle data of the machine, obtains the rotation direction and angle information of the current TV, and at this time, judges the horizontal and vertical screen states of the TV side. And obtains the width and height data of the video. First, display the video picture on the TV side according to the original ratio. Compare the horizontal and vertical screens of the TV side with the width and height of the video. If the TV side is in the vertical screen state at this time and the video is in the horizontal screen state, or if the TV side is in the horizontal screen state at this time and the video is in the horizontal screen state, then drive the TV to rotate automatically.

[0094] S03: If the media resource attribute is a picture, then fill the screen according to the original ratio of the current image width-to-height ratio for display.

[0095] In one implementation, in order to realize that when the video width-to-height ratio does not match the horizontal and vertical screen states of the display, while driving the display to rotate, the video can be synchronously enlarged. Obtain the current rotation angle in real time, calculate the zoom factor, and rotate the UI in the opposite direction at the same time through the rotation direction and angle data, and synchronously enlarge or reduce the display effect.

[0096] In some embodiments, when the video width-to-height ratio does not match the horizontal and vertical screen states of the display, then drive the display to rotate. When the video width-to-height ratio matches the horizontal and vertical screen states of the display, directly display and adapt the screen according to the original ratio on the display, and present the video content.

[0097] In some exemplary embodiments, not all videos can trigger rotation. It is also necessary to determine whether to rotate according to the video duration, so that when the screen-cast content is a long video, the video width-to-height ratio and the display state match to make the user experience better. When the video time is too short, when the user plays a relatively short video, the display device may just complete a display rotation when the video ends, and then wait for the next video cast by the user, and then determine again according to the width-to-height ratio. Rotating the display too frequently like this will give the user a bad user experience.

[0098] For example, after receiving the screen-cast content, the controller can start playing on the user interface first, and obtain that the video duration is greater than or equal to a certain time value T min When it is, then detect the video width-to-height ratio and the presentation state of the display. When the width-to-height ratio does not match the presentation state of the display, control the rotation component to drive the display to rotate. And when the video duration is less than this time value T min When it is, it is determined that the video time is too short and there is no need to rotate the TV.

[0099] As Figure 9 shown, when the video width-to-height ratio does not match the horizontal and vertical screen states of the display, then drive the display to rotate, and it further includes:

[0100] S021: Obtain the original resolution of the video adapted to the display before rotation;

[0101] S022: Determine the zoom factor of the video picture according to the original resolution and the full-screen resolution of the display;

[0102] S023: Monitor the rotation angle information of the display, and gradually zoom the video picture according to the rotation angle information to ensure that the video picture is finally displayed full-screen.

[0103] In some embodiments, the initial resolution is F1 and the full-screen resolution is F2. Then, during the rotation of the video picture, it needs to be enlarged by F2 / F1 times. When the rotation angle of the display from landscape to portrait is monitored, the entire rotation process can be divided into 90 equal parts according to the rotation angle. For each degree of rotation, it is enlarged by (F2 / F1) / 90. In this way, it rotates to full-screen display at a uniform speed.

[0104] For example, when the display device is in the landscape state and receives a vertical video resource, the user interface presented by the display is as Figure 7 (b): The vertical side length of the video picture is the same as the long side length of the display and is displayed therein. Since the display device is in the landscape state and the video interface is in the vertical state at this time, the landscape and portrait orientations of the TV end and the video picture do not match. Therefore, the rotation interface of the display device is called to control the rotation component to drive the rotation of the display. The controller obtains the rotation direction and angle information through the rotation angle callback. The change of the video playback picture is calculated in real time according to the rotation angle information of the TV. When the TV end rotates from landscape to portrait, the default magnification at the start of rotation is F2 / F1. The current angle data and zoom factor are set to the frame grabbing interface, and the video picture is rotated and zoomed in real time. The video playback picture always remains vertical relative to the user. At this time, the TV picture and the video picture are overlapped and displayed, as follows Figure 7 (c).

[0105] In some embodiments, the magnification can also be calculated according to the long side of the display and the height of the video picture, as well as the short side length of the display and the width of the video picture. For example, the default magnification at the start of rotation is 1. For each degree of rotation, the height of the video playback picture is enlarged by (the long side length of the TV picture - the height of the video picture) / 90, and the width is enlarged by (the short side width of the TV picture - the width of the video picture) / 90.

[0106] In some embodiments, before the start of the rotation process, relevant prompts or rotations can be popped up on the user interface, and then the display is driven to rotate.

[0107] In some embodiments, when the display device is in the portrait display and the video resource is in the landscape state, the user interface presented by the display is as Figure 5(b): The horizontal side length of the video screen is the same as the short side length of the display, and it is displayed therein. At this time, the portrait and landscape orientations of the display device and the video screen do not match, so the rotation interface of the TV side is called to notify the TV side to rotate. The rotation direction and angle information are obtained through the rotation angle callback, and the change of the video playback screen is calculated in real time according to the angle information of the TV rotation. As an optional method, when the TV side rotates from landscape to portrait, the default multiple at the start of rotation is 1. When rotating 1 degree, the height of the video playback screen is enlarged by (short side length of the TV screen - height of the video screen) / 90, and the width is enlarged by (long side length of the TV screen - width of the video screen) / 90. The current angle data and scaling factor are set to the frame grabbing interface to rotate and scale the video screen in real time. The video playback screen always remains vertical relative to the user, and finally the TV screen and the video playback screen are overlapped and displayed, as shown in (c).

[0108] In some embodiments, when the display device receives a picture push request from the mobile phone side, it displays the current picture at the original ratio maximally without rotating the display according to whether the picture and the display of the display match or not.

[0109] Of course, the above projection of the picture is only an exemplary illustration. In some embodiments, whether the projection media is a video or a picture, when it does not match the display state of the display, the rotation component can be triggered to rotate the display.

[0110] In some embodiments, the display device not only rotates according to the projection data. Regardless of whether the display device is in the landscape state or the portrait state, the user can still actively issue a rotation instruction to rotate the display device to a state different from the previous one. From the perspective of viewing the display device from the front, the rotation component 276 can rotate the display screen to the portrait state, that is, the state where the vertical side length of the screen is greater than the horizontal side length, or rotate the screen to the landscape state, that is, the state where the horizontal side length of the screen is greater than the vertical side length. For example, it can be realized that the user manually triggers the rotation of the display. When there is a subjective instruction input, the priority level of execution can be set to high. For example, regardless of whether the video screen and the display presentation match, when a rotation instruction input by the user is received, even if the video screen and the display presentation match, the display can also receive the trigger instruction and rotate.

[0111] In a specific implementation, the present application further provides a computer storage medium. The computer storage medium can store a program, and when the program is executed, it may include some or all of the steps in the embodiments of the method provided by the present application. When the controller of the display device provided by the present application runs the computer program instructions, the controller executes the steps configured by the present application. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), or the like.

[0112] Those skilled in the art can clearly understand that the technologies in the embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.

[0113] For the same or similar parts among the various embodiments in this specification, reference can be made to each other. In particular, for the embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

[0114] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A display device, characterized in that, Comprising: A display; A rotating component configured to drive the display to rotate so that the display is in one of a landscape state or a portrait state; A user interface configured to send an input signal to a controller; The controller is configured to: Receive a screen-cast media resource and determine the media resource attributes; If the media resource attribute is a video, play the media resource, obtain the video duration of the media resource, and when the video duration is greater than or equal to a time value, detect the landscape / portrait state of the display, obtain the video aspect ratio, and determine the matching situation between the video aspect ratio and the landscape / portrait state of the display, and determine whether to rotate the display according to the matching situation; when the video duration is less than the time value, do not rotate the display; If the media resource attribute is a picture, do not rotate the display and display it by filling the screen according to the original ratio of the current image aspect ratio.

2. The display device according to claim 1, characterized in that, The controller is further configured to: When the video aspect ratio does not match the landscape / portrait state of the display, drive the display to rotate; When the video aspect ratio matches the landscape / portrait state of the display, directly display and adapt the screen according to the original ratio on the display to present the video content.

3. The display device according to claim 2, characterized in that, When the controller executes that when the video aspect ratio does not match the landscape / portrait state of the display, drive the display to rotate, it is further configured to: After obtaining the video aspect ratio, display and play it by adapting the entire screen according to the original ratio on the display; When the display rotates to match the video aspect ratio, display the video picture full screen.

4. The display device according to claim 2, characterized in that, When the controller executes that when the video aspect ratio does not match the landscape / portrait state of the display, drive the display to rotate, it is further configured to: Obtain the original resolution of the video adapted to the display before rotation; Determine the scaling factor of the video picture according to the original resolution and the full-screen resolution of the display; Monitor the rotation angle information of the display and gradually scale the video picture according to the rotation angle information to ensure that the video picture is finally displayed full screen.

5. The display device according to claim 4, characterized in that, The controller is further configured to: If the initial resolution is F1 and the full-screen resolution is F2, then during the rotation of the video picture, it needs to be enlarged by F2 / F1 times; when monitoring the rotation angle of the display from landscape to portrait, the entire rotation process can be divided into 90 equal parts according to the rotation angle, and for each degree of rotation, it is enlarged by (F2 / F1) / 90.

6. A method for receiving screen mirroring content, applied to a display device, characterized in that, Comprising: Receive a screen-cast media resource and determine the media resource attributes; If the media resource attribute is a video, play the media resource, obtain the video duration of the media resource, and when the video duration is greater than or equal to a time value, detect the landscape / portrait state of the display, obtain the video aspect ratio, and determine the matching situation between the video aspect ratio and the landscape / portrait state of the display, and determine whether to rotate the display according to the matching situation; when the video duration is less than the time value, do not rotate the display; If the media resource attribute is a picture, do not rotate the display, and fill the screen for display according to the original ratio of the current image aspect ratio.

7. The method for receiving screen mirroring content according to claim 6, characterized in that, It includes: When the video aspect ratio does not match the portrait / landscape state of the display, drive the display to rotate; When the video aspect ratio matches the portrait / landscape state of the display, directly display and adapt the screen according to the original ratio on the display to present the video content.

8. The method for receiving screen mirroring content according to claim 7, characterized in that, The step of "When the video aspect ratio does not match the portrait / landscape state of the display, drive the display to rotate" further includes: After obtaining the video aspect ratio, display and play by adapting the entire screen according to the original ratio on the display; When the display rotates to match the video aspect ratio, display the video picture full screen.

9. The method for receiving screen mirroring content according to claim 7, characterized in that,The step of "When the video aspect ratio does not match the portrait / landscape state of the display, drive the display to rotate" further includes: Obtain the original resolution of the video adapted to the display before rotation; Determine the zoom factor of the video picture according to the original resolution and the full-screen resolution of the display; Monitor the rotation angle information of the display, and gradually scale the video picture according to the rotation angle information to ensure that the video picture is finally displayed full screen.

10. A non-volatile storage medium, characterized in that, Execute the method described in claims 6 to 9 above.

Images