A display device and a method for adapting the rotation of the display screen.

By using a rotating component and controller in smart TVs to automatically adjust the display status, the problem of screen aspect ratio mismatch when displaying vertical media assets on smart TVs has been solved, thus improving the user experience.

CN116248936BActive Publication Date: 2025-10-31HISENSE VISUAL TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202310006657.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-03-13
Publication Date
2025-10-31
Estimated Expiration
2040-03-13

AI Technical Summary

Technical Problem

When displaying vertical media, smart TVs may fail to display properly due to a mismatch between the aspect ratio of the image and the aspect ratio of the display screen, resulting in wasted screen space and a poor user experience.

Method used

A display device and a method for adapting the rotation of the display screen are provided. The rotation state of the video media resource is detected by a rotation component and a controller, and the display is automatically adjusted to adapt to the screen ratio of the video media resource, including the switching between landscape and portrait modes.

Benefits of technology

It enables automatic screen rotation to adapt to video media resources of different proportions, avoiding wasted space due to screen scaling and improving user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116248936B_ABST
    Figure CN116248936B_ABST
Patent Text Reader

Abstract

This application provides a display device and a method for adapting display screen rotation. In practical applications, the current rotation state of the display can be detected in response to the playback action of video media resources on the display device. If the video media resource is portrait-oriented and the current rotation state of the display is landscape, the rotation component can be controlled to rotate the display to landscape mode; or, if the video media resource is landscape-oriented and the current rotation state of the display is portrait, the rotation component can be controlled to rotate the display to portrait mode, so that the display automatically rotates to adapt to the aspect ratio corresponding to the video media resource.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of a domestic application (application number: 202010176794.2, application date: 2020-03-13, invention title: a display device and a method for rotating and adapting display screen). Technical Field

[0002] This application relates to the field of smart TV technology, and in particular to a display device and a method for rotating and adapting display images. Background Technology

[0003] Smart TVs have their own independent operating system and support functional expansion. Various applications can be installed on smart TVs according to user needs, such as traditional video apps, social media apps like short videos, and reading apps like comics and books. These applications can utilize the smart TV screen to display their content, providing the smart TV with rich media resources. Simultaneously, smart TVs can also interact with different terminals and share resources. For example, smart TVs can connect to mobile phones via local area networks, Bluetooth, or other wireless communication methods to play resources from the phone or directly cast the phone's screen.

[0004] However, because different applications or media assets from different sources correspond to different aspect ratios, smart TVs are often used to display images with aspect ratios different from traditional videos. For example, video resources shot on mobile phones and other terminals are generally vertical media assets with aspect ratios of 9:16, 9:18, 3:4, etc.; while the images provided by reading applications are vertical resources with aspect ratios similar to those of books. The aspect ratio of smart TV display screens is generally 16:9 or similar horizontal. Therefore, when displaying vertical media assets such as short videos and comics on a smart TV, the aspect ratio is mismatched with the display screen ratio, and the vertical media assets cannot be displayed correctly. Generally, the vertical media assets need to be scaled down to be displayed completely, which not only wastes display space on the screen but also leads to a poor user experience. Summary of the Invention

[0005] This application provides a display device and a method for rotating and adapting the display screen to solve the problem of wasting screen display space in traditional display devices.

[0006] In a first aspect, this application provides a display device comprising: a display; a rotating assembly connected to the display and configured to drive the display to rotate, thereby placing the display in a rotation state between a landscape state and a portrait state; and a controller connected to the rotating assembly and the display, configured to:

[0007] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0008] If the video media resource is a portrait-oriented resource and the current rotation state of the display is landscape, control the rotation component to rotate the display to portrait mode.

[0009] Based on the above-mentioned display device, this application also provides a display screen rotation adaptation method, including:

[0010] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0011] If the video media resource is a portrait-oriented resource and the current rotation state of the display is landscape, control the rotation component to rotate the display to portrait mode.

[0012] Secondly, this application provides a display device including: a display; a rotating component connected to the display and configured to drive the display to rotate so that the display is in a rotation state between a landscape state and a portrait state.

[0013] The controller, which is connected to the rotating component and the display, is configured to:

[0014] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0015] If the video media resource is a landscape media resource and the current rotation state of the display is portrait mode, control the rotation component to rotate the display to landscape mode.

[0016] Based on the above-mentioned display device, this application also provides a display screen rotation adaptation method, including:

[0017] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0018] If the video media resource is a landscape media resource and the current rotation state of the display is portrait mode, control the rotation component to rotate the display to landscape mode.

[0019] As can be seen from the above technical solutions, this application provides a display device and a method for adapting display screen rotation. In practical applications, the current rotation state of the display can be detected in response to the resource playback action of the display device. If the video media resource is a vertical media resource and the current rotation state of the display is a landscape state, the rotation component can be controlled to rotate the display to a landscape state; or, if the video media resource is a horizontal media resource and the current rotation state of the display is a portrait state, the rotation component can be controlled to rotate the display to a portrait state, so that the display automatically rotates to adapt to the screen ratio corresponding to the video media resource.

[0020] Thirdly, this application provides a display device, comprising: a display; a rotating component connected to the display and configured to drive the display to rotate by a preset angle; and a controller connected to the display and the rotating component and configured to:

[0021] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0022] If the aspect ratio of the video media resource matches the current rotation state, control the display to show the image corresponding to the video media resource;

[0023] If the aspect ratio of the video media resource does not match the current rotation state, the rotation component is controlled to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image of the video media resource.

[0024] Based on the above-mentioned display device, this application also provides a display screen rotation adaptation method, including:

[0025] In response to a resource playback action of a display device, the current rotation state of the display is detected;

[0026] If the aspect ratio of the video media resource matches the current rotation state, control the display to show the image corresponding to the video media resource;

[0027] If the aspect ratio of the video media resource does not match the current rotation state, the rotation component is controlled to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image of the video media resource.

[0028] As can be seen from the above technical solutions, this application provides a display device and a display screen rotation adaptation method. In practical applications, the current rotation state of the display can be detected in response to the resource playback action of the display device. If the aspect ratio of the video media resource does not match the current rotation state, the rotation component is controlled to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image of the video media resource. When the display device detects that the width and height of the currently playing video do not match the current rotation state of the display, it automatically drives the motor of the TV to rotate, and simultaneously scales and rotates the image on the display during the rotation process, avoiding the need for users to watch tilted video images for extended periods of time, thus improving the user experience. Attached Figure Description

[0029] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1A An application scenario diagram of a display device provided for some embodiments of this application;

[0031] Figure 1B A rear view of a display device provided for some embodiments of this application;

[0032] Figure 2 A hardware configuration block diagram of the control device 100 in FIG1 provided for some embodiments of this application;

[0033] Figure 3 Figure 1 shows a hardware configuration block diagram of the display device 200 provided for some embodiments of this application;

[0034] Figure 4 A block diagram illustrating the architecture configuration of the operating system in the memory of a display device 200 provided in some embodiments of this application;

[0035] Figure 5A Figure 1 is a schematic diagram of the landscape state of the display device provided for some embodiments of this application;

[0036] Figure 5B Figure 1 is a schematic diagram of the display device in portrait mode, provided for some embodiments of this application;

[0037] Figure 6 A flowchart illustrating the display screen rotation adaptation method provided in some embodiments of this application;

[0038] Figure 7 A schematic flowchart illustrating the detection of switch status provided in some embodiments of this application;

[0039] Figure 8 A flowchart illustrating the input rotation command provided in some embodiments of this application;

[0040] Figure 9 A schematic flowchart illustrating the display screen scaling operation provided in some embodiments of this application;

[0041] Figure 10 A schematic flowchart illustrating the display screen rotation operation provided in some embodiments of this application;

[0042] Figure 11 A schematic flowchart illustrating the calculation of rotation parameters provided in some embodiments of this application;

[0043] Figure 12This is a schematic diagram of a display screen rotation adaptation method provided in some embodiments of this application;

[0044] Figure 13 These are schematic diagrams of display screens provided for some embodiments of this application;

[0045] Figure 14 This is a schematic flowchart of a display screen rotation adaptation method provided in some embodiments of this application. Detailed Implementation

[0046] To enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of this application.

[0047] A rotating TV is a new type of smart TV, mainly consisting of a monitor and a rotating assembly. The monitor is fixed to a wall or stand using the rotating assembly, and its angle can be adjusted to accommodate different aspect ratios. For example, monitors are often placed horizontally to display videos with aspect ratios of 16:9 or 18:9. When the video aspect ratio is 9:16 or 9:18, a horizontally placed monitor needs to scale the image, resulting in black areas on the sides. Therefore, the rotating assembly allows the monitor to be placed vertically to accommodate 9:16 or 9:18 aspect ratio videos.

[0048] To facilitate the display of target media asset details pages in different screen rotation states and improve the user viewing experience, this application provides a display device, a details page display method, and a computer storage medium. The display device includes, for example, a rotating television. It should be noted that the method provided in this embodiment is not only applicable to rotating televisions but also to other display devices, such as computers and tablets.

[0049] The term "module" as used in the embodiments of this application can refer to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0050] The term "remote control" as used in the embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application) that can wirelessly control the electronic device over a relatively short distance. This component typically connects to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard buttons in a typical remote control device with a user interface on a touchscreen.

[0051] The term "gesture" as used in the embodiments of this application refers to user behavior in which a user expresses an expected idea, action, purpose, and / or result through a change in hand shape or hand movement.

[0052] The term "hardware system" as used in the embodiments of this application can refer to a physical component with computing, control, storage, input, and output functions, composed of mechanical, optical, electrical, and magnetic devices such as integrated circuits (ICs) and printed circuit boards (PCBs). In the embodiments of this application, the hardware system is also commonly referred to as a motherboard, main chip, or controller.

[0053] See Figure 1A Figure 1 illustrates an application scenario of a display device provided in some embodiments of this application. As shown in Figure 1, the control device 100 and the display device 200 can communicate via wired or wireless means.

[0054] The control device 100 is configured to control the display device 200. It can receive operation commands input by the user and convert them into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200. For example, if the user operates the channel up / down keys on the control device 100, the display device 200 will respond with the channel up / down operation.

[0055] The control device 100 can be a remote control 100A, including infrared or Bluetooth communication protocols, and other short-range communication methods, to control the display device 200 wirelessly or via wired means. Users can input commands through buttons on the remote control, voice input, or control panel input to control the display device 200. For example, users can input corresponding control commands through volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input buttons, menu buttons, and power buttons on the remote control to control the display device 200.

[0056] The control device 100 can also be a smart device, such as a mobile terminal 100B, tablet computer, computer, laptop computer, etc. For example, an application running on the smart device can be used to control the display device 200. This application can be configured to provide various controls to the user through an intuitive user interface (UI) on the screen associated with the smart device.

[0057] For example, mobile terminal 100B can install software applications with display device 200 to connect and communicate via network communication protocols, achieving one-to-one control operations and data communication. For instance, mobile terminal 100B can establish a control command protocol with display device 200, allowing operation of various function keys or virtual controls on the user interface provided on mobile terminal 100B to achieve functions similar to the physical buttons on remote control 100A. Audio and video content displayed on mobile terminal 100B can also be transmitted to display device 200 for synchronized display.

[0058] Display device 200 provides network television functionality, including broadcast reception and computer support. The display device can be implemented as digital television, network television, Internet Protocol television (IPTV), etc.

[0059] Display device 200 can be a liquid crystal display, an organic light-emitting display, or a projection device. Specific display device type, size, and resolution are not limited.

[0060] Display device 200 also communicates with server 300 via various communication methods. This allows display device 200 to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. Server 300 can provide display device 200 with various content and interactive features. For example, display device 200 can send and receive information, such as receiving Electronic Program Guide (EPG) data, receiving software updates, or accessing a remotely stored digital media library. Server 300 can be a group or multiple groups, and can be one or more types of servers. Other network services such as video-on-demand and advertising services can be provided through server 300.

[0061] In some embodiments, such as Figure 1B As shown, the display device 200 includes a rotating assembly 276, a controller 250, a display 275, a terminal interface 278 extending from a gap in the back panel, and the rotating assembly 276 connected to the back panel. The rotating assembly 276 allows the display 275 to rotate. From the perspective of viewing the display device from the front, the rotating assembly 276 can rotate the display to a portrait mode, i.e., a mode where the vertical side of the screen is longer than the horizontal side, or to a landscape mode, i.e., a mode where the horizontal side of the screen is longer than the vertical side.

[0062] Figure 2 An exemplary configuration block diagram of the control device 100 is shown. For example... Figure 2 As shown, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

[0063] The controller 110 includes random access memory (RAM) 111, read-only memory (ROM) 112, processor 113, communication interface, and communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0064] For example, when an interaction of pressing a button on a remote control 100A or touching a touch panel on a remote control 100A is detected, the controller 110 may control the generation of a signal corresponding to the detected interaction and send the signal to the display device 200.

[0065] The memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 120 can also store various control signal commands input by the user.

[0066] Under the control of the controller 110, the communicator 130 enables communication of control signals and data signals with the display device 200. For example, the control device 100 sends control signals (such as touch signals or control signals) to the display device 200 via the communicator 130, and the control device 100 can receive signals sent by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example, with the infrared signal interface, the user input command needs to be converted into an infrared control signal according to the infrared control protocol and then sent to the display device 200 via the infrared transmitting module. Similarly, with the radio frequency signal interface, the user input command needs to be converted into a digital signal, then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 via the radio frequency transmitting terminal.

[0067] User input interface 140 may include at least one of microphone 141, touchpad 142, sensor 143, button 144, etc., so that the user can input user commands about controlling display device 200 to control device 100 through voice, touch, gesture, pressing, etc.

[0068] User output interface 150 outputs user commands received from user input interface 140 to display device 200, or outputs image or audio signals received by display device 200. Here, user output interface 150 may include LED interface 151, vibration interface 152 for generating vibration, audio output interface 153 for outputting sound, and display 154 for outputting images, etc. For example, remote control 100A can receive audio, video, or data output signals from user output interface 150, and display the output signals as images on display 154, output audio signals on audio output interface 153, or output vibration signals on vibration interface 152.

[0069] The power supply 160 provides operating power to the various components of the control device 100 under the control of the controller 110. It can be in the form of a battery and related control circuitry.

[0070] Figure 3 The diagram illustrates, for example, a hardware configuration block diagram of a display device 200. (As shown...) Figure 3 As shown, the display device 200 may include a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, a rotating component 276, an audio processor 280, an audio output interface 285, and a power supply 290.

[0071] The rotating assembly 276 may include components such as a drive motor and a rotating shaft. The drive motor can be connected to the controller 250 and is controlled by the controller 250 to output a rotation angle. One end of the rotating shaft is connected to the power output shaft of the drive motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or bracket through the rotating assembly 276.

[0072] The rotating assembly 276 may also include other components, such as transmission components and detection components. The transmission component can adjust the rotational speed and torque output by the rotating assembly 276 through a specific transmission ratio, and can be a gear transmission. The detection component can consist of sensors mounted on the rotating shaft, such as angle sensors and attitude sensors. These sensors can detect parameters such as the rotation angle of the rotating assembly 276 and send the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display device 200 based on the detected parameters. In practical applications, the rotating assembly 276 may include, but is not limited to, one or more of the above-mentioned components.

[0073] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means and can perform modulation and demodulation processes such as amplification, mixing, and resonance. It is used to demodulate the audio and video signals carried in the frequency of the television channel selected by the user from multiple wireless or wired broadcast television signals, as well as additional information (such as EPG data).

[0074] The tuner 210, as selected by the user and controlled by the controller 250, responds to the frequency of the television channel selected by the user and the television signal carried by that frequency.

[0075] The tuner / demodulator 210 can receive signals through various means depending on the broadcasting system of the television signal, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or internet broadcasting; and can use digital modulation or analog modulation depending on the modulation type; and can demodulate analog and digital signals depending on the type of television signal received.

[0076] In some other exemplary embodiments, the tuner 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, which is then input to the display device 200 via the external device interface 240.

[0077] The communicator 220 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the display device 200 can send content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include network communication protocol modules or near-field communication protocol modules such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223. Thus, the communicator 220 can receive control signals from the control device 100 according to the control of the controller 250, and realize the control signals as WIFI signals, Bluetooth signals, radio frequency signals, etc.

[0078] Detector 230 is a component of display device 200 used to collect signals from the external environment or to interact with the outside world. Detector 230 may include a sound acquisition unit 231, such as a microphone, which can be used to receive the user's voice, such as voice signals of the user's control commands to the display device 200; or, it can collect ambient sounds to identify the type of environmental scene, enabling the display device 200 to adapt to ambient noise.

[0079] In some other exemplary embodiments, the detector 230 may also include an image acquisition device 232, such as a camera or webcam, which can be used to acquire external environmental scenes to adaptively change the display parameters of the display device 200; and to acquire user attributes or user interaction gestures to realize the function of interaction between the display device and the user.

[0080] In some other exemplary embodiments, the detector 230 may also include a light receiver for acquiring ambient light intensity to adapt to changes in display parameters of the display device 200, etc.

[0081] In some other exemplary embodiments, the detector 230 may also include a temperature sensor, such as by sensing the ambient temperature, so that the display device 200 can adaptively adjust the display color temperature of the image. For example, in a high-temperature environment, the display device 200 may adjust the color temperature of the displayed image to be cooler; in a low-temperature environment, the display device 200 may adjust the color temperature of the displayed image to be warmer.

[0082] External device interface 240 is a component that provides data transmission between the controller 250 and the display device 200 and external devices. External device interface 240 can be connected to external devices such as set-top boxes, gaming devices, and laptops via wired / wireless means, and can receive data such as video signals (e.g., moving images), audio signals (e.g., music), and additional information (e.g., EPG) from external devices.

[0083] The external device interface 240 may include one or more of the following: an HDMI terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, a component terminal (not shown in the figure), and a red, green and blue (RGB) terminal (not shown in the figure).

[0084] The controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as operating systems and various applications) stored in the memory 260.

[0085] like Figure 3 As shown, the controller 250 includes a random access memory (RAM) 251, a read-only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM 251, ROM 252, graphics processor 253, CPU processor 254, and communication interface 255 are connected through the communication bus 256.

[0086] ROM 252 is used to store various system startup instructions. For example, when a power-on signal is received, the display device 200 starts up, and the CPU processor 254 executes the system startup instructions in ROM 252, copying the operating system stored in memory 260 to RAM 251 to start running the operating system. After the operating system has started, the CPU processor 254 copies various application programs from memory 260 to RAM 251, and then starts running these applications.

[0087] The graphics processor 253 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. The graphics processor 253 may include an arithmetic logic unit (ALU) for performing calculations based on various interactive commands input by the user, and then displaying various objects according to display attributes; and a renderer for generating various objects based on the ALU, and displaying the rendering results on the display 275.

[0088] CPU processor 254 is used to execute operating system and application instructions stored in memory 260, and to process various applications, data, and content according to received user input instructions, so as to ultimately display and play various audio and video content.

[0089] In some exemplary embodiments, the CPU processor 254 may include multiple processors. These multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some initialization operations of the display device 200 in a display device preload mode, and / or to display a screen in normal mode. The multiple or one sub-processors are used to perform an operation in a display device standby mode or other states.

[0090] Communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

[0091] The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object to be displayed on the monitor 275, the controller 250 can perform operations related to the object selected by the user input command.

[0092] The object can be any of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object may include displaying a link to a hyperlinked page, document, image, etc., or executing a program corresponding to the object. The user input command for selecting the GUI object can be a command entered via various input devices connected to the display device 200 (e.g., mouse, keyboard, touchpad, etc.) or a voice command corresponding to spoken speech by the user.

[0093] Memory 260 is used to store various types of data, software programs, or application programs that drive and control the operation of display device 200. Memory 260 may include volatile and / or non-volatile memory. The term "memory" includes memory 260, RAM 251 and ROM 252 of controller 250, or memory cards in display device 200.

[0094] In some embodiments, the memory 260 is specifically used to store the running program of the controller 250 in the display device 200; to store various applications built into the display device 200 and downloaded by the user from external devices; and to store data such as the visual effects images of various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects.

[0095] In some embodiments, the memory 260 is specifically used to store drivers and related data for the tuner 210, communicator 220, detector 230, external device interface 240, video processor 270, display 275, audio processor 280, etc., such as external data (e.g., audio and video data) received from the external device interface or user data (e.g., key information, voice information, touch information, etc.) received from the user interface.

[0096] In some embodiments, memory 260 specifically stores software and / or programs representing an operating system (OS), which may include, for example, a kernel, middleware, application programming interfaces (APIs), and / or applications. Exemplarily, the kernel may control or manage system resources, as well as the functionality implemented by other programs (such as the middleware, APIs, or applications); simultaneously, the kernel may provide interfaces to allow middleware, APIs, or applications to access the controller to control or manage system resources.

[0097] Figure 4 The diagram illustrates an example of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture, from top to bottom, consists of the application layer, middleware layer, and kernel layer.

[0098] The application layer includes both built-in system applications and non-system-level applications. It is responsible for direct interaction with the user. The application layer can include multiple applications, such as settings applications, e-post applications, and media center applications. These applications can be implemented as web applications, running on the WebKit engine, and specifically developed and executed using HTML5, Cascading Style Sheets (CSS), and JavaScript.

[0099] Here, HTML, short for HyperText Markup Language, is a standard markup language used to create web pages. It uses tags to describe web pages. HTML tags are used to describe text, graphics, animations, sounds, tables, links, etc. The browser reads the HTML document, interprets the content of the tags in the document, and displays it in the form of a web page.

[0100] CSS, short for Cascading Style Sheets, is a computer language used to style HTML documents. It defines style structures such as fonts, colors, and positions. CSS styles can be stored directly in HTML web pages or in separate stylesheet files, allowing for control over the styles displayed on a webpage.

[0101] JavaScript is a language used for web page programming. It can be inserted into HTML pages and interpreted and executed by the browser. The interactive logic of web applications is implemented using JavaScript. JavaScript can communicate with the kernel layer through browsers by encapsulating JavaScript extension interfaces.

[0102] The middleware layer provides standardized interfaces to support operation in various environments and systems. For example, the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Experts Group (MHEG) middleware related to data broadcasting, as DLNA middleware related to communication with external devices, or as middleware providing the browser environment for applications running within display devices, etc.

[0103] The kernel layer provides core system services, such as file management, memory management, process management, network management, and system security and permission management. The kernel layer can be implemented as a kernel based on various operating systems, such as a kernel based on the Linux operating system.

[0104] The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as display drivers for monitors, camera drivers for cameras, button drivers for remote controls, WiFi drivers for WiFi modules, audio drivers for audio output interfaces, and power management drivers for power management (PM) modules.

[0105] Figure 3In this system, the user interface 265 receives various user interactions. Specifically, it is used to send user input signals to the controller 250, or to transmit output signals from the controller 250 to the user. For example, the remote control 100A can send user input signals such as power switch signals, channel selection signals, and volume adjustment signals to the user interface 265, which then forwards them to the controller 250; or, the remote control 100A can receive output signals such as audio, video, or data output from the user interface 265 after processing by the controller 250, and display the received output signals or output the received output signals as audio or vibration.

[0106] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 can receive user input commands for controlling the position of a selector within the GUI to select different objects or items. Here, "user interface" refers to the medium interface through which an application or operating system interacts and exchanges information with the user; it realizes the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the display of an electronic device, where controls can include visual interface elements such as icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, and widgets.

[0107] Alternatively, users can input user commands by entering specific sounds or gestures, and the user interface 265 can receive user input commands by recognizing the sounds or gestures through sensors.

[0108] The video processor 270 is used to receive external video signals and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard encoding and decoding protocol of the input signal, so as to obtain a video signal that can be directly displayed or played on the display 275.

[0109] For example, the video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, etc.

[0110] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if the input is an MPEG-2 stream (a compression standard based on digital storage media for moving images and speech), the demultiplexing module will demultiplex it into video signals and audio signals.

[0111] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0112] Image compositing modules, such as image synthesizers, are used to overlay and blend GUI signals generated by a graphics generator based on user input or its own data with scaled video images to generate displayable image signals.

[0113] The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to 120Hz or 240Hz. The usual format is achieved by frame interpolation.

[0114] The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format, such as converting the signal output by the frame rate conversion module to output RGB data signals.

[0115] Display 275 is used to receive image signals from video processor 270 and to display video content, images, and a menu control interface. The displayed video content can be from broadcast signals received by tuner 210, or from video input via communicator 220 or external device interface 240. Display 275 also displays the user interface (UI) generated in display device 200 and used to control display device 200.

[0116] Furthermore, the display 275 may include a display component for displaying an image and a driving component for driving the image display. Alternatively, if the display 275 is a projection display, it may also include a projection device and a projection screen.

[0117] The controller can send a control signal to the rotating component 276 to rotate the display 255.

[0118] The audio processor 280 is used to receive external audio signals, and perform audio data processing such as decompression and decoding, noise reduction, digital-to-analog conversion and amplification according to the standard encoding and decoding protocol of the input signal, so as to obtain an audio signal that can be played in the speaker 286.

[0119] For example, the audio processor 280 can support various audio formats, such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), and High-Efficiency AAC (HE-AAC).

[0120] The audio output interface 285 is used to receive audio signals output by the audio processor 280 under the control of the controller 250. The audio output interface 285 may include a speaker 286 or an external audio output terminal 287 for outputting to an external device, such as a headphone output terminal.

[0121] In some other exemplary embodiments, the video processor 270 may include one or more chips. The audio processor 280 may also include one or more chips.

[0122] In addition, in some other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or integrated with the controller 250 into one or more chips.

[0123] The power supply 290, under the control of the controller 250, provides power to the display device 200 from an external power source. The power supply 290 can be a built-in power circuit installed inside the display device 200, or it can be an external power source installed outside the display device 200.

[0124] See Figure 5A Figure 1 is a schematic diagram of the landscape mode of the display device provided in some embodiments of this application. The operation mode of the display 275 in landscape mode can be called landscape media viewing mode, and the operation mode of the display 275 in portrait mode can be called portrait media viewing mode. In Figure 5, the display 275 in the display device 200 can be seen directly. The controller 250 in the display device 200 is further connected to the server 300 for calling the interface of the server 300 to obtain corresponding data. The display 275 in the display device 200 can be driven to rotate by the rotating component 276 and used to display the user interface. In practical applications, the user can control the playback mode and playback content of the display device 200 through the control device 100. The playback modes include landscape media viewing mode and portrait media viewing mode.

[0125] In one implementation, the display device 200 includes a rotating component 276. This rotating component 276 can fix the display device 200 in place and, under the control of the controller 250, can control the rotation of the display 275 to position it in landscape or portrait mode. The rotating component 276 can be fixed to the back of the display 275, is used for fixing to a wall, and receives control commands from the controller 250 to rotate the display 275 in a vertical plane, thus positioning it in landscape or portrait mode.

[0126] In this context, the landscape mode refers to a state where, when viewed from the front of the display 275, the horizontal length (width) is greater than the vertical length (height); the portrait mode refers to a state where, when viewed from the front of the display 275, the horizontal length (width) is less than the vertical length (height). Clearly, in this application, "vertical" means approximately vertical, and "horizontal" means approximately horizontal.

[0127] Driven by the rotating component 276, the display 275 can rotate 90 degrees clockwise or counterclockwise to position the display 275 in portrait mode, such as... Figure 5B As shown. In portrait mode, the monitor can display the user interface corresponding to the portrait mode, and has the corresponding interface layout and interaction methods. In portrait media viewing mode, users can watch short videos, comics, and other portrait media. Similarly, since the controller 250 in the display device 200 is further connected to the server 300, the corresponding portrait media data can be obtained by calling the interface of the server 300 in portrait mode.

[0128] Portrait mode is more suitable for playing media with a 9:16 aspect ratio or similar vertical format, such as short videos shot on mobile phones and other terminals. Since mobile phones and other terminal devices mostly use 9:16, 9:18, or other vertical screen ratios, when the terminal is connected to display device 200 and the terminal's screen is displayed on display device 200, portrait mode can avoid excessive scaling of the image, making full use of the display screen 275 and providing a better user experience.

[0129] It's important to note that landscape mode is primarily used for displaying horizontal media such as TV series and movies, while portrait mode is mainly used for displaying vertical media such as short videos and comics. These two modes are simply different monitor settings and do not limit the content that can be displayed. For example, vertical media such as short videos and comics can still be displayed in landscape mode, and horizontal media such as TV series and movies can still be displayed in portrait mode; however, in portrait mode, the incompatible display windows need to be compressed and adjusted.

[0130] Display device 200 can provide a display screen to the user via monitor 275, and can provide multiple display layers, such as a picture quality layer and a UI layer. The picture quality layer refers to the display layer on display device 200 used to present the playback image after the user plays media materials; it can also be called the video layer of display device 200. The playback image corresponding to the media material can be displayed on the picture quality layer. The UI layer (User Interface) refers to the display layer used to provide interactive operations for the user; it can also be called the OSD (On-Screen Display) layer of display device 200. The UI layer can display various interactive controls, such as controlling the homepage.

[0131] Depending on the rotation state of the display 275, the homepage mode presented on the display 275 will also be different. For example, in one implementation, during the startup of the display device 200, if it detects that the current display 275 is in landscape mode, the controller 250 will request to call the interface of the server 300 to send a request to the server 300 to obtain landscape homepage data. The server 300 will respond to the request and send the landscape homepage data to the controller 250. The controller 250 will identify the landscape homepage data and control the display 275 to display the landscape homepage based on the landscape homepage data.

[0132] In another implementation, when the monitor 275 is in portrait mode, in response to an operation command, the rotation component 276 is controlled to rotate, changing the monitor 275 from portrait to landscape mode. A request is then made to the server 300's interface to retrieve landscape homepage data. The server 300 responds to this request and sends the landscape homepage data to the controller 250. The controller 250 identifies the landscape homepage data and controls the monitor 275 to display the landscape homepage based on it.

[0133] To achieve a better viewing experience, the display 275 can be adjusted to either landscape or portrait mode using the rotation component 276 when displaying different media assets. Specifically, the display 275 can rotate according to the user's needs. The user can send a rotation trigger command to the controller 250 based on their viewing requirements. The controller 250 receives and responds to the user's rotation trigger command, switching the rotation state of the display 275. The rotation state can include either landscape or portrait mode, with landscape mode corresponding to landscape media viewing mode and portrait mode corresponding to portrait media viewing mode.

[0134] In one implementation, the controller 250 of the display device 200 can determine whether the display 275 needs to be rotated by detecting the aspect ratio of the image displayed on the monitor 275. For example, if a user plays a short video, comic, or other vertical media in landscape mode, the controller 250 can detect that the vertical media does not match the current landscape mode and automatically control the rotation component 276 to rotate the monitor 275 90 degrees to adjust it to portrait mode.

[0135] Because the rotation of the rotating component 276 is relatively slow, the user needs to view the tilted image for an extended period during the rotation. For example, if the monitor 275 needs to rotate 90 degrees clockwise to switch from landscape to portrait mode, and the rotation process takes 15 seconds, the image on the monitor 275 will tilt continuously as the monitor 275 rotates until it reaches portrait mode. Then, the image is rotated 90 degrees counterclockwise to achieve portrait display.

[0136] To reduce tilt time and improve user experience, this application allows for synchronous rotation of the displayed image at the image quality layer, ensuring that the image displayed on the monitor 275 remains upright during rotation. The image quality layer is a display layer within the operating system corresponding to the display device 200. Unlike the UI layer, the image quality layer allows for convenient adjustments to image quality, scaling, and orientation. Generally, the playback of media assets is displayed at the image quality layer; therefore, synchronous rotation at the image quality layer eliminates the need to consider the source of the video resources, allowing adjustments to be made for all media assets.

[0137] When a user plays media that does not match the current rotation state, the monitor 276 needs to be rotated to fit the incompatible media image. The specific process is as follows:

[0138] First, users select a video to play. Users can play videos according to their needs through a series of operations on the UI interface. For example, users can operate on the control device 100, selecting "Featured" - "My Applications" - "Short Videos" on the homepage to enter the short video application interface. Then, within the corresponding short video application interface, users can select any video to play. Clearly, in this application, video resources include those from local sources, DLNA (Digital Living Network Alliance) push notifications, and DMS (Database Management System) sharing.

[0139] To accommodate different display formats, the user-operated homepage can be either landscape or portrait mode, and the content displayed can differ between these modes. For example, in landscape mode, the homepage can display a variety of horizontal media assets or links, such as movies and TV series, for users to directly select and play. Vertical media assets, on the other hand, can be categorized into one or more controls, such as a "short video" app icon; users need to click the corresponding control before they can select and play the vertical media asset or link.

[0140] Secondly, the video being played is detected. After the user confirms the video resource to be opened, the controller 250 decodes the video resource and converts it into a video image for display on the monitor 275. While controlling the monitor 275 to display the video image, the controller 250 can also detect the aspect ratio of the image and the rotation state of the monitor 275 to determine whether the aspect ratio of the currently displayed image is compatible with the current rotation state of the monitor 275.

[0141] For example, if the currently displayed image is a portrait-oriented media file and the monitor 275 is in portrait mode, the aspect ratio of the currently displayed image is compatible with the rotation of the monitor 275, and no rotation adjustment is required; if the currently displayed image is a portrait-oriented media file but the monitor 275 is in landscape mode, the aspect ratio of the currently displayed image is not compatible with the rotation of the monitor 275, and rotation adjustment is required.

[0142] Finally, rotation adjustment is performed. When rotation adjustment is required, the controller 250 triggers the rotation component 276 to rotate, thereby adjusting the rotation state of the display 275; at the same time, the image can be rotated in the opposite direction on the image quality layer, so that the displayed image can always remain in a positive display state during the rotation of the display 275.

[0143] For example, if the currently playing video is in portrait orientation, but the monitor 275 is in landscape orientation, the controller 250 sends a command to the rotation component 276 to rotate it, causing the rotation component 276 to rotate the monitor 275 90 degrees clockwise, thus adjusting the monitor 275's orientation to portrait. The current display image can be adjusted at the image quality layer by rotating and / or scaling it, allowing it to rotate smoothly 90 degrees counter-clockwise. Because the clockwise rotation of the display image during this process counteracts the tilt caused by the counter-clockwise rotation of the monitor 275, the display image remains in a positive orientation.

[0144] like Figure 6The diagram shown is a flowchart illustrating a display screen rotation adaptation method according to this application. For the actual control process, the controller 250 described in this application is further configured to execute the following program steps:

[0145] S1: In response to the video media resource playback action of the display device, detect the current rotation state of the display.

[0146] When a user selects a media resource on the control panel and plays it, a video media resource playback action is generated on the display device 200. For example, after a user opens a short video application through "Featured - My Applications - Short Videos", they can select one of several short video resource icons to play.

[0147] After detecting video media resource playback, the controller 250 can determine the current rotation state of the display 275 through the angle sensor on the rotation component 276 or the gravity acceleration sensor on the display 275. For example, by analyzing the data measured by the gravity acceleration sensor, it can be determined that the current gravity direction of the display 275 is perpendicular to the long side, thus determining that the display 275 is currently in landscape mode.

[0148] S2: If the aspect ratio of the video media resource matches the current rotation state, control the display to show the image corresponding to the video media resource.

[0149] The controller 250 can determine the display aspect ratio of the video media resource from the file description information of the video media resource. For example, if the video media resource being played is a short video with a display aspect ratio of 9:16, then the current short video is determined to be a portrait media resource. If the rotation state of the monitor 275 is also in portrait mode at this time, that is, the aspect ratio of the video media resource matches the current rotation state, then the controller can directly control the monitor to display the image corresponding to the video media resource.

[0150] S3: If the aspect ratio of the video media resource does not match the current rotation state, control the rotation component to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image of the video media resource.

[0151] For example, if the current rotation state of the monitor 275 is landscape mode and the video media resource being played is a short video or other vertical media resource, then it is determined that the aspect ratio of the video media resource does not match the current rotation state. In this case, the rotation component 276 can be controlled to rotate the monitor 275 to portrait mode to adapt to the display aspect ratio corresponding to the short video being played.

[0152] It should be noted that, in the technical solution provided in this application, whether the aspect ratio and rotation state match refers to whether the aspect ratio of the video media resource being played is the same as or has a similar proportional relationship with the aspect ratio of the monitor 275 screen. For example, for traditional horizontal media such as movies and TV series, the width of the screen is greater than the height, that is, the aspect ratio of horizontal media is usually greater than 1. When the monitor 275 is in landscape mode, the long side is horizontal and is considered the width, and the short side is vertical and is considered the height, so the aspect ratio of the monitor 275 in landscape mode is also greater than 1. Similarly, for vertical media such as short videos and comics, the width of the screen is less than the height, that is, the aspect ratio of vertical media is less than 1. When the monitor 275 is in landscape mode, the long side is vertical and is considered the height, and the short side is horizontal and is considered the width, so the aspect ratio of the monitor 275 in portrait mode is also less than 1.

[0153] In this application, if the aspect ratio of the video media resource is simultaneously greater than 1 or simultaneously less than 1 of the aspect ratio of the display 275, then the aspect ratio of the video media resource is determined to match the current rotation state. That is, the aspect ratio of horizontal media resources matches the landscape state; the aspect ratio of vertical media resources matches the portrait state. Similarly, if the aspect ratio of the video media resource is not simultaneously greater than 1 or simultaneously less than 1 of the aspect ratio of the display 275, then the aspect ratio of the video media resource is determined to not match the current rotation state. For example, the aspect ratio of portrait media resources does not match the landscape state; the aspect ratio of horizontal media resources does not match the portrait state.

[0154] To obtain the aspect ratio of the displayed image, the controller 250 can retrieve it from the resource's description information after the user selects to play a particular resource. For most resources, the file description specifies the aspect ratio; for example, if the file description is 4096×2160, then the aspect ratio is determined to be 4096:2160 > 1. Alternatively, the aspect ratio can be determined by querying the effective pixels occupied by the displayed image in both width and height. For example, if, excluding the pixels occupied by the black inset area, the effective pixels occupied by the displayed image are 720 in width and 1280 in height, then its aspect ratio is 720:1280 < 1.

[0155] In one implementation, such as Figure 7 As shown, controller 250 is also configured to perform the following program steps:

[0156] S111: Detect the on / off state of the rotating assembly.

[0157] After selecting a video resource to play, the controller 250 can detect the rotation switch of the display device 200 to determine whether the rotating component 276 is in the on state. Obviously, the on / off state of the rotating component 276 can refer to the hardware on / off state, that is, whether the control circuit of the rotating component 276 is powered on; or it can refer to the software on / off state, that is, in the operating system, the control program corresponding to the rotating component 276 is active.

[0158] S112: If the switch is on, detect the aspect ratio of the display screen corresponding to the video media resource and the current rotation state of the display.

[0159] If the rotating component 276 is in the ON state, it means that the rotating component 276 can be started and operated by the system at any time. At this time, the controller 250 can further detect the aspect ratio of the display screen corresponding to the current video media resource and the current rotation state of the display, and determine whether the display 275 and the display screen need to be rotated based on the detection results.

[0160] The aspect ratio of a display screen refers to the ratio between the width and height of the screen's edge. It's important to note that the screen edge here refers to the effective display edge, such as the edge of a video or image, excluding black areas filled in to fit the screen. For example, if the current display is a portrait-oriented media file with a width of 360 pixels and a height of 640 pixels, the corresponding aspect ratio is 360:640. However, if the current monitor (275) is in landscape mode with a resolution of 3840×2160, meaning the screen's aspect ratio is also 3840:2160, then the aspect ratio of the current display screen is inconsistent with the monitor's rotation.

[0161] Because video resources have significantly different aspect ratios, they can be categorized by their aspect ratio to accommodate various resource types. If the aspect ratio is greater than 1 (meaning the width is greater than the height), the video resource is a horizontal media resource; similarly, if the aspect ratio is less than 1 (meaning the width is less than the height), the video resource is a vertical media resource.

[0162] Correspondingly, the compatibility between the aspect ratio of the currently displayed image and the current rotation state of the monitor can be determined by examining the aspect ratio. If the aspect ratio is greater than 1, it indicates that the video is relatively wide. In this case, if the monitor 275 is in landscape mode, it does not need to be rotated; if the monitor 275 is in portrait mode, it needs to be rotated to landscape mode. If the aspect ratio is less than 1, it indicates that the video is relatively tall. In this case, if the monitor 275 is in landscape mode, it needs to be rotated; if the monitor 275 is in portrait mode, it does not need to be rotated.

[0163] Furthermore, after detecting the on / off state of the rotating component, the controller 250 is further configured to:

[0164] S113: If the switch is in the off state, control the display to show the settings screen.

[0165] When the rotating component 276 is detected to be in an off state, it cannot be directly controlled to complete the rotation operation. Therefore, the user needs to be notified to turn the rotating component 276 on. For example, a settings screen, i.e., the UI interface corresponding to "Settings," is displayed on the monitor 275 to allow the user to turn on the rotating component 276.

[0166] The system can also determine whether the display aspect ratio matches the rotation state by judging the applications running on the display device 200. Typically, applications installed on the display device 200 can be categorized into three types: First, applications that only support landscape mode, such as movie and TV apps like Cloud TV, Little TV, and iQiyi. If such an application is opened in portrait mode, the monitor 275 will be rotated to landscape mode. Second, applications that only support portrait mode, such as short video apps like Kuaishou and Douyin. If such an application is opened in landscape mode, the monitor 275 will be rotated to portrait mode. Third, applications that support both landscape and portrait modes, such as app stores, video call apps, and games. These applications do not require the monitor 275 to be rotated when opened, but the application interface layout needs to be adjusted according to the rotation state of the monitor 275.

[0167] In one implementation, such as Figure 8 As shown, controller 250 is also configured to perform the following program steps:

[0168] S121: Receive a rotation command input by the user for rotating the display.

[0169] The rotation command refers to the command used to trigger a rotation operation. It can be initiated actively by the user or automatically by the controller 250 based on the current display state. It should be noted that the rotation command is intended to trigger a rotation operation; in practical applications, a corresponding command may not actually exist. For example, if the controller 250 determines that the currently playing image is portrait media while the current display 275 is in landscape mode, it can automatically trigger a rotation operation without generating an additional rotation command. Therefore, for those skilled in the art, whether or not a rotation operation is triggered, it falls within the scope of protection of this application.

[0170] Users can generate control commands to trigger the rotation component 276 to rotate by performing different operations through the control device 100. The operations performed by the user can be directly displayed as controls on the UI interface, or they can be displayed dynamically on the UI interface. That is, the controller 250 can adjust the display of controls on the UI interface in real time by detecting the aspect ratio of the playing video and the current rotation state of the display 275.

[0171] For example, when a user selects a video resource in the "Short Video" application to play, the controller 250 detects that the aspect ratio of the video is portrait, which is inconsistent with the current landscape orientation of the monitor 275. The UI then displays a prompt and controls such as "The current video resource is more suitable for portrait viewing. Do you want to automatically switch to portrait mode?" or "Yes / No". When the user selects "Yes", corresponding user input is generated and sent to the controller 250.

[0172] S122: Send the rotation command to the rotation component to control the rotation component to start rotating.

[0173] For user-initiated rotation commands, controller 250 needs to parse the user's input to determine the rotation strategy for monitor 275. For example, when the user wants to change monitor 275 from landscape to portrait mode, the rotation command can control the rotation component 276 to rotate 90 degrees clockwise; when the user wants to change monitor 275 from portrait to landscape mode, the rotation command can control the rotation component 276 to rotate 90 degrees counterclockwise.

[0174] In one implementation, if the aspect ratio of the video media resource does not match the current rotation state, the controller 250 is further configured to:

[0175] S31: Calculate the rotation parameters based on the current rotation state and the aspect ratio of the video media resource.

[0176] The controller 250 can determine whether to rotate the monitor 275 based on the current rotation state and the aspect ratio of the video media resource. For example, if the current rotation state of the monitor 275 is landscape and the aspect ratio of the video media resource is portrait, the controller 250 can specify that the monitor 275 needs to be rotated to portrait mode, that is, the monitor 275 rotates 90 degrees clockwise.

[0177] S32: Adjust the display of the screen corresponding to the video media resource according to the rotation parameters.

[0178] To achieve a better viewing experience when rotating the monitor 275, the controller 250 can rotate the displayed image simultaneously with the monitor 275 to ensure the displayed image is always facing forward. Therefore, the rotation parameters include the display image scaling ratio and / or rotation angle. The controller 250 needs to adjust the displayed image; for example, while the monitor 275 rotates 90 degrees clockwise, it controls the displayed image to rotate 90 degrees counterclockwise, maintaining synchronization between the monitor 275 and the displayed image rotation to ensure the image is always displayed facing forward.

[0179] In this application, by adjusting the display at the image quality layer—that is, adjusting only the video playback image—the flexibility and efficiency of adjustment are greatly increased. Adjustments at the image quality layer are not limited by the source of the video resource file being played; they can be made to video files on the local disk, video files pushed to the display device 200 via DLNA, and video files shared via DMS. Furthermore, adjustments at the image quality layer can allow for further adjustments to the display without affecting the UI layer.

[0180] For example, the controller 250 can also make more detailed adjustments to the displayed image, including rotation and scaling operations. The rotation operation is an adjustment made to accommodate the rotation of the monitor 275, while the scaling operation is an adjustment made to accommodate changes in the width and height of the monitor 275 during rotation. In practical applications, rotation and scaling operations can be performed simultaneously, or rotation can be performed first, followed by scaling.

[0181] In one implementation, such as Figure 9 As shown, for the scaling operation of the displayed screen, the controller 250 is further configured to perform the following steps:

[0182] S311: Obtain the current display window position corresponding to the video media resource.

[0183] S312: Determine the position of the target display window based on the current rotation status;

[0184] S313: Compare the target display window position with the current display window position to generate width and height deformation;

[0185] S314: Generate a scaling step, wherein the scaling step is the scaling amount per unit time of width and height calculated based on the width and height deformation and the rotation speed of the rotating component;

[0186] S315: Adjust the width and height values ​​of the display window according to the scaling step.

[0187] In the technical solution provided in this application, the current display window position and the target display window position refer to the screen display window positions before and after the rotation of the monitor 275, corresponding to the rotation state of the monitor 275. For example, when the monitor 275 needs to rotate from a landscape state to a portrait state, the position of the screen displaying the video in the corresponding image layer in the landscape state is the current display window position; while in the portrait state after rotation, the position of the screen displaying the video in the corresponding image layer is the target window position. Similarly, when the monitor 275 needs to rotate from a portrait state to a landscape state, the position of the screen displaying the video in the corresponding image layer in the portrait state is the current display window position; while in the landscape state after rotation, the position of the screen displaying the video in the corresponding image layer is the target window position.

[0188] In this embodiment, in order to ensure that the displayed image can always fill a large portion of the display area of ​​the display 275 during the rotation of the display 275 and to guarantee the quality of the displayed image, the display image can be scaled proportionally during the rotation of the display image.

[0189] Specifically, after playing the media assets, the position of the target display window can be determined based on the rotation angle and the screen size of the monitor 275. For example, if it is necessary to switch from landscape to portrait mode, the extracted rotation angle is 90 degrees clockwise, thus determining the predetermined target window position as the position corresponding to the playback area in portrait mode.

[0190] After determining the target display window position, the width and height distortion of the display window can be determined by comparing the target display window position with the current display window position. For example, a 65-inch monitor with a 1440:810 aspect ratio will display portrait media in landscape mode, meaning the height of the displayed image will be less than or equal to the monitor's 275mm height, i.e., less than or equal to 810mm. However, in portrait mode, the height of the displayed image will be less than or equal to 1440mm (the width of the monitor in landscape mode). Therefore, the height distortion can be determined as 1440 - 810 = 630mm. Similarly, the width distortion can be calculated based on the aspect ratio of the portrait media.

[0191] After determining the width and height deformation, the scaling amount per unit time can be calculated based on the width and height deformation and the rotation speed of the rotating component 276, thus generating the scaling step. For example, if the display 275 needs to rotate from landscape to portrait mode in 15 seconds, the height scaling step is 630 / 15 = 42 mm / s. Similarly, the width scaling step can also be calculated based on the width deformation.

[0192] After determining the scaling steps for the height and width of the display screen, the width and height values ​​of the display screen window can be adjusted simultaneously according to the scaling steps. This ensures that when the monitor 275 is rotated to the target position, the display screen precisely fills the display area of ​​the monitor 275, improving the user experience.

[0193] To achieve a better display effect, in the step of simultaneously adjusting the width and height values ​​of the display window according to the scaling step, the controller 250 can also be configured to perform the following steps: locate the scaling base point coordinates in the current display window; and, based on the scaling base point coordinates, synchronously adjust the width and height values ​​of the display window according to the scaling step.

[0194] The scaling reference point can be positioned based on the shape and adjustment method of the display window. For example, the center point of the display window can be selected as the scaling reference point, so that the position of the reference point remains fixed before and after the display screen is rotated. Alternatively, one of the four vertices of the window boundary can be used as the scaling reference point, such as the top left vertex.

[0195] In one implementation, such as Figure 10 As shown, for the rotation operation of the displayed screen, the controller 250 is further configured to perform the following steps:

[0196] S321: Generates the rotation direction of the generated image;

[0197] The rotation direction of the displayed image can be determined based on the rotation direction of the monitor 275, wherein the rotation direction of the image is opposite to the rotation direction of the monitor. For example, if the monitor 275 needs to rotate 90 degrees clockwise to switch from landscape mode to portrait mode, the corresponding rotation direction of the image is counterclockwise.

[0198] S322: Compare the target display window position with the current display window position to generate an angle deformation amount.

[0199] After determining the rotation direction, the angular deformation amount can be generated based on the target display window position and the current display window position. For example, if the target display window position is the display position in portrait mode and the current display window position is the display position in landscape mode, then the angular deformation amount is 90 degrees.

[0200] S323: Generate rotation step size.

[0201] After generating the angular deformation, the rotation step size is calculated by combining it with the rotation speed of the display 275. The rotation step size is the amount of angular rotation per unit time calculated based on the angular deformation and the rotation speed of the rotating component. For example, if the time taken to switch from landscape to portrait mode is 15 seconds, then the rotation step size is 90 / 15 = 6 degrees / s, meaning that the display screen rotates 6 degrees per second during the rotation process to ensure that the display 275 and the display screen rotate synchronously.

[0202] S324: Adjust the display orientation of the display window according to the rotation step and the screen rotation direction.

[0203] After calculating the rotation step size, the display orientation of the screen window can be adjusted according to the rotation step size and the screen rotation direction. For example, if the monitor rotates 6 degrees clockwise per second, the screen will rotate 6 degrees counterclockwise per second, thus keeping the screen in a positive orientation at all times.

[0204] It should be noted that, to accommodate various video resources, the state of the monitor 275 may not be limited to landscape or portrait modes; it may also maintain various tilt states depending on playback requirements. Therefore, the current display window position and the target display window position are not limited to the two situations mentioned above, but may also be a rotation process at any two tilt angles. Therefore, any screen rotations that can be associated with the above rotation methods, including landscape / portrait rotation, landscape / tilt rotation, portrait / tilt rotation, and diagonal screen rotation, all fall within the scope of protection of this application.

[0205] In the above embodiments, the rotation of the displayed screen can be controlled based on the speed at which the rotating component 276 drives the display 275 to rotate. Since the rotation speed of the rotating component 276 is determined by the drive motor after initial debugging of a display device 200 and can remain constant, the rotation parameters can be determined using a fixed rotation speed for all rotation processes. Therefore, the process of calculating the rotation parameters described above is the simplest and most convenient for controlling the rotation operation.

[0206] However, in certain situations, such as when the rotating component 276 accumulates errors over time, its rotation speed may change. To adapt to these changes, in one implementation, the rotating component 276 is equipped with an angle callback interface. This interface can detect the rotation angle of the rotating component 276 in real time using an angle sensor, thereby determining the posture of the display 275 at any given moment during its rotation. Alternatively, a gravity acceleration sensor can be installed on the display 275. During the rotation of the display 275, the posture of the display 275 at any given moment can be obtained by detecting the information from the gravity sensor in the three directions of the spatial coordinate system (x, y, z). The display screen can then be adjusted in real time based on the detected data. Figure 11 As shown, the controller is further configured as follows:

[0207] S231: Monitor the angle sensor of the rotating component and / or the gravity acceleration sensor to obtain the angle data of the display in real time;

[0208] S232: Calculate the rotation parameters of the display screen synchronously based on the angle data.

[0209] In practical applications, such as Figure 12 As shown, the controller 250 can obtain the rotation angle of the display 275 by listening to the Android standard angle callback interface during the rotation of the display 275, thereby calculating the position and required rotation angle of the target window in real time, and achieving the effect of rotating with the display 275.

[0210] In the above embodiments, the angle callback interface for monitoring is not limited to the standard Android angle callback interface. In actual applications, other corresponding angle callback interfaces can be called according to the operating system of the display device 200. An angle callback interface can also be generated by the controller 250 according to the x, y, z direction information of sensors such as the gravity acceleration sensor, based on a set rule.

[0211] For example, the steps for calculating the position of the target window and the required rotation angle in real time are as follows:

[0212] like Figure 13 As shown, the video display area Rect is a rectangular area composed of 4 points, and the coordinates of each point are its coordinates on the screen. Taking the top left corner of the screen as the origin, the position can be determined by specifying point 1 and point 4 in Rect. Point 1 is (left, top), and point 4 is (right, bottom).

[0213] The parameters set for the Surface View of the image quality layer include the scaling ratios (scale X and scale Y) and the rotation angle (rotate). Scale X and scale Y can use the right and bottom positions of the Rect to record the width and height of the video window. The current position (oldRect) and the target position (newRect) of the video window are calculated respectively. Based on the principle of equal increments, the width and height of the display area are gradually increased until the target position is reached. The specific algorithm is as follows:

[0214] Rect oldRect = new Rect(0, 0, oldWidth, oldHeight);

[0215] Rect newRect = new Rect(0, 0, newWidth, newHeight);

[0216] float defWidth = (newWidth – oldWidth) / 90;

[0217] float defWidth = (newWidth – oldWidth) / 90;

[0218] float tempWidth = oldWidth + defWidth × rotate;

[0219] float tempHeight = ildHeight + defHeight × rotate;

[0220] flocat scaleX = tempWidth / mBaseWidth;

[0221] flocat scaleY = tempHeight / mBaseHeight;

[0222] Among them, mBaseWidth and mBaseHeight are the base width and height, used to calculate scale X and scale Y.

[0223] As can be seen from the above technical solutions, the display device provided by this application can adjust the video playback image at the image quality layer, thereby realizing automatic rotation of the display 275. During the rotation of the display 275, the display image also rotates in real time, so that the display image can always remain in a positive state, reducing the impact of the TV rotation process on the viewing experience.

[0224] Based on the aforementioned display device 200, this application also provides a display screen rotation adaptation method, wherein the display screen rotation adaptation method is configured in a controller 250 for controlling the rotation process, specifically including:

[0225] S1: In response to the video media resource playback action of the display device, detect the current rotation state of the display;

[0226] S2: If the aspect ratio of the video media resource matches the current rotation state, control the display to show the image corresponding to the video media resource;

[0227] S3: If the aspect ratio of the video media resource does not match the current rotation state, control the rotation component to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image of the video media resource.

[0228] As can be seen from the above technical solutions, this application provides a display device and a display screen rotation adaptation method. In practical applications, the current rotation state of the display can be detected in response to the playback action of video media resources on the display device. If the aspect ratio of the video media resource does not match the current rotation state, the rotation component is controlled to rotate the display so that the display adapts to the aspect ratio of the video media resource and plays the corresponding image. When the display device detects that the width and height of the currently playing video do not match the current rotation state of the display, it automatically drives the motor of the TV to rotate, and simultaneously scales and rotates the image on the display during the rotation process, avoiding the need for users to watch tilted video images for extended periods, thus improving the user experience.

[0229] In one implementation, such as Figure 14 As shown, this application also provides a display device 200, including a display, a rotating component, and a controller.

[0230] The rotating component is connected to the display and is configured to drive the display to rotate so that the display is in a rotating state, either in landscape or portrait mode.

[0231] The controller, connected to the rotating component and the display, is configured to:

[0232] In response to the playback action of video media resources on the display device, the current rotation state of the display is detected;

[0233] If the video media resource is a portrait-oriented resource and the current rotation state of the display is landscape, control the rotation component to rotate the display to portrait mode.

[0234] In one implementation, such as Figure 14 As shown, this application also provides a display device 200, including a display, a rotating component, and a controller.

[0235] The rotating component is connected to the display and is configured to drive the display to rotate so that the display is in a rotating state, either in landscape or portrait mode.

[0236] The controller, connected to the rotating component and the display, is configured to:

[0237] In response to the playback action of video media resources on the display device, the current rotation state of the display is detected;

[0238] If the video media resource is a landscape media resource and the current rotation state of the display is portrait mode, control the rotation component to rotate the display to landscape mode.

[0239] As can be seen from the above technical solutions, this application provides a display device 200 and a display screen rotation adaptation method. In practical applications, the current rotation state of the display 275 can be detected in response to the video media resource playback action of the display device 200. If the video media resource is a vertical media resource and the current rotation state of the display 275 is a landscape state, the rotation component 276 can be controlled to rotate the display 275 to a landscape state; or, if the video media resource is a horizontal media resource and the current rotation state of the display 275 is a portrait state, the rotation component 276 can be controlled to rotate the display 275 to a portrait state. By automatically rotating the display 275, the screen ratio corresponding to the video media resource can be adapted.

[0240] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.

Claims

1. A display device, characterized in that, include: monitor; A rotating component, connected to the display, is configured to drive the display to rotate so that the display can switch between landscape and portrait modes; The controller, which is connected to the rotating component and the display, is configured to: In response to video media resource actions of the display device, the current display status of the display is detected; If the video media resource is a portrait media resource and the current display state of the monitor is landscape mode, the rotating component is controlled to rotate the monitor to portrait mode in response to user input; The rotation parameters are calculated based on the current rotation state and aspect ratio of the video media resource, and the rotation parameters include the display image scaling ratio and / or rotation angle; Adjust the display window of the video media resource on the screen according to the rotation parameters; Obtain the current display window position of the video media resource on the display; The position of the target display window is determined based on the current rotation state of the screen; The target display window position is compared with the current display window position to generate width and height deformation. Determine the scaling step size, which is the amount of width and height scaling per unit time calculated based on the width and height deformation and the rotation speed of the rotating component; as well as Adjust the width and height values ​​of the display window according to the scaling step.

2. The display device according to claim 1, characterized in that, The controller, responding to a user's selection to access video media resources on the display device, is further configured to: Detect the on / off state of the rotating component; If the switch is on, detect the aspect ratio of the display screen corresponding to the video media resource and the current display status of the monitor; If the switch is in the off state, the display will continue to show the playback screen.

3. The display device according to claim 1, characterized in that, The controller, in controlling the rotating component to rotate the display to portrait mode, is further configured to: rotate the displayed image in the opposite direction at the UI layer so that the displayed image always remains in a positive display state during the rotation process.

4. The display device according to claim 1, characterized in that, The controller is also configured to: Determine the coordinates of the scaling base point within the current display window; and Using the coordinates of the scaling base point as a reference, the width and height values ​​of the display window are adjusted synchronously according to the scaling step.

5. The display device according to claim 1, characterized in that, The controller is also configured to: Determine the window rotation direction, which is opposite to the screen rotation direction; The target display window position is compared with the current display window position, resulting in angular deformation; as well as Generate a rotation step size, wherein the rotation step size is the angular rotation increment per unit time calculated based on the angular deformation and the rotation speed of the rotating component.

6. The display device according to claim 1, wherein, The rotating component includes an angle sensor, and the controller is further configured to acquire screen angle data in real time by monitoring the angle sensor. The rotation parameters of the display window are calculated synchronously based on the angle data; and The window used to display the video media resources is adjusted according to the rotation parameters.

7. The display device according to claim 5, wherein, The rotating component includes an angle sensor, and the controller is further configured to: During the process of the controller controlling the rotating component to rotate the display to a portrait orientation, it is further configured to: According to the rotation step and the screen rotation direction, adjust the orientation of the screen corresponding to the homepage so that the screen corresponding to the homepage is displayed in the correct orientation; the screen rotation direction is opposite to the rotation direction of the display; the rotation step is the preset time angle rotation amount corresponding to the rotation of the display.

8. A display screen adaptation method, applied to a display device, the display device including a display; a rotating component; and a controller, the controller being connected to the rotating component and the display, characterized in that, include: In response to video media resource actions of the display device, the current display status of the display is detected; If the video media resource is a portrait media resource and the current display state of the monitor is landscape mode, the rotating component is controlled to rotate the monitor to portrait mode in response to user input; The rotation parameters are calculated based on the current rotation state and aspect ratio of the video media resource, and the rotation parameters include the display image scaling ratio and / or rotation angle; Adjust the display window of the video media resource on the screen according to the rotation parameters; Obtain the current display window position of the video media resource on the display; The position of the target display window is determined based on the current rotation state of the screen; The target display window position is compared with the current display window position to generate width and height deformation. Determine the scaling step size, which is the amount of width and height scaling per unit time calculated based on the width and height deformation and the rotation speed of the rotating component; as well as Adjust the width and height values ​​of the display window according to the scaling step.

Citation Information

Patent Citations

  • Video processing method and electronic equipment

    CN104935857A

  • A mirror image same-screen automatic full-frame method

    CN109814828A

  • Monitor rotation apparatus of computer

    KR1020110072163A