Display device and picture magnification method

Abstract

The invention relates to a display device and a picture magnification method. The display device includes: a display configured to display an operation interface; the cursor position of the cursor in the operation interface is determined by the pointing position of the remote controller in the three-dimensional space; the controller is configured to: in response to an area magnification operation on a picture displayed by the display, capture the displayed picture; creating a reference view above the displayed picture, compressing the screenshot picture to obtain a compressed screenshot picture, and displaying the compressed screenshot picture in the reference view; the resolution of the reference view is smaller than that of the screenshot picture; in response to a pointing operation on the reference view, creating an amplified display view at the cursor position; mapping a first region in the reference view to a second region in the screenshot picture, and obtaining a target picture of the second region from the screenshot picture; and filling the target picture into the amplified display view. By adopting the display equipment, the definition of the magnified display view can be ensured, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display device and a method for magnifying an image. Background Art

[0002] As display technology continues to advance, it has made significant progress, and its application scenarios are becoming increasingly diverse. For example, in the context of meeting annotation, participants can annotate the meeting content during the meeting, such as marking key points and recording ideas. This greatly enhances the interactivity and intuitiveness of the meeting, making it easier for participants to participate in the discussion. Another example is that in teaching and presentation scenarios, users can mark up the display according to their presentation needs.

[0003] In actual use cases, to ensure that users can clearly understand the content on the display screen, it is usually necessary to stretch or magnify the display screen. However, the magnified display screen often lacks clarity, making it difficult for users to clearly identify the annotation content, affecting the acquisition and understanding of key information and reducing the overall user experience. Summary of the Invention

[0004] The present application provides a display device and a method for image magnification to solve the problem of insufficient clarity of an image after magnification.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] The display is configured to display an operation interface; the operation interface has a cursor; the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space;

[0007] At least one controller, connected to the display, configured to:

[0008] In response to a zoom operation on a region of a picture currently displayed on the display, capturing the picture currently displayed to obtain a screenshot;

[0009] Creating a base view by overlaying it on the currently displayed image, compressing the screenshot to obtain a compressed screenshot, and displaying the compressed screenshot in the base view; wherein the base view has a smaller resolution than the screenshot;

[0010] In response to a pointing operation on the base view, creating a zoomed-in presentation view at a cursor position of the cursor;

[0011] Mapping a first area where the cursor is located in the base view to a second area in the screenshot, and obtaining a target image of the second area from the screenshot; wherein the area pixel size of the second area is larger than the area pixel size of the first area;

[0012] Filling the target image into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

[0013] In the above embodiment, by responding to a zoom operation on an area of ​​the currently displayed screen on the display, the currently displayed screen is captured, thereby obtaining a screenshot containing the content of the currently displayed screen, providing a data basis for subsequent screen zooming. By superimposing a base view on the currently displayed screen and compressing the screenshot to obtain a compressed screenshot, the compressed screenshot is displayed in the base view, thereby reducing the bandwidth capacity requirements of the display system. By responding to a pointing operation on the base view, an enlarged display view is created at the cursor position, so that the enlarged display view has a follow-up feature, can respond to the movement of the cursor in real time, locate the area of ​​user interest, and improve the convenience of operation control. By mapping the first area where the cursor is located in the base view to the second area in the screenshot, obtaining a target image of the second area from the screenshot, and filling the target image into the enlarged display view, an enlarged display of the area where the cursor is located is achieved. Since the target image is extracted from the screenshot image, the image resolution of the screenshot image is greater than the view resolution of the baseline view, and the screenshot image is compressed to obtain a compressed screenshot image, which is displayed in the baseline view. Therefore, the clarity of the enlarged display view can be guaranteed without increasing the system bandwidth capacity, thereby improving the user experience.

[0014] In some embodiments, when the controller maps the first area where the cursor is located in the baseline view to the second area in the screenshot and obtains the target image of the second area from the screenshot, it is configured to: determine the mapping position of the cursor position in the screenshot, and the regional pixel size of the second area; and capture the target image of the second area from the screenshot with the mapping position as the center.

[0015] In the above embodiment, by determining the mapped position of the cursor position in the screenshot and the pixel size of the second area, the position of the target image in the screenshot can be accurately and quickly determined. The target image is captured by capturing the pixel size of the second area from the screenshot with the mapped position as the center.

[0016] In some embodiments, when determining the mapping position of the cursor position in the screenshot and the regional pixel size of the second area, the controller is configured to: determine a target ratio between the display resolution of the display and the view resolution of the baseline view; map the cursor position to the screenshot according to the target ratio to obtain the mapping position; and use the ratio between the view pixel size of the enlarged display view and the preset magnification multiplied by the target ratio as the regional pixel size of the second area.

[0017] In the above embodiment, the target ratio is introduced to quantify the coordinate mapping relationship between the display resolution and the view resolution. By mapping the cursor position to the fused view image according to the target ratio, the mapping position can be adaptively determined. The ratio between the view pixel size of the enlarged display view and the preset magnification can be used to represent the regional pixel size of the first region. By multiplying this ratio by the target ratio, the regional pixel size of the second region can be quickly and accurately determined.

[0018] In some embodiments, when the controller executes an operation in response to zooming in on an area of ​​the screen currently displayed on the display, capturing the currently displayed screen and obtaining a screenshot, the controller is configured to: control the display to display the annotation floating view in response to a media access operation; control the display to display the function area menu in response to a triggering operation on the annotation floating view; capture the screen currently displayed on the display and obtain a screenshot in response to a triggering operation on the zoom control in the function area menu.

[0019] In the above embodiment, in response to a media access operation, the display is controlled to display an annotation pop-up view, providing a basic platform for subsequent operations. In response to a triggering operation on the annotation pop-up view, the display is controlled to display a function area menu to guide the user to further operations. In response to a triggering operation on the zoom control in the function area menu, the current display image is captured, thereby obtaining a screenshot.

[0020] In some embodiments, when the controller executes a screenshot in response to a trigger operation on a magnification control in a function area menu, captures the current screen displayed on the display, and obtains a screenshot, the controller is configured to: hide the cursor and / or the function area menu in response to a trigger operation on a magnification control in the function area menu; captures the current screen displayed on the display, and obtains a screenshot.

[0021] In the above embodiment, by hiding the cursor and / or the function area menu, that is, hiding the visual elements irrelevant to the desired magnified display content, the information presentation is simplified, and the cursor or function area menu is prevented from blocking the desired magnified display content, so that the user can quickly and accurately obtain the required information.

[0022] In some embodiments, the controller is further configured to: in response to a media access operation, control the display to display a content view, so that in the case of media access, the content view can be displayed, wherein the media content is displayed.

[0023] In some embodiments, the controller is further configured to, in response to a triggering operation on the annotation pop-up view, control the display to display the annotation view, wherein the annotation content is displayed in the annotation view. Thus, when the annotation pop-up view is triggered, the annotation view can be displayed, providing a view basis for subsequent screenshot acquisition.

[0024] In some embodiments, when the controller creates an enlarged display view at the cursor position of the cursor in response to a pointing operation on the base view, the controller is configured to: determine, in response to the pointing operation on the base view, a position to be displayed in which the enlarged display view does not exceed the display boundary, based on the view pixel size of the enlarged display view and the picture size of the picture currently displayed on the display; and control the display to display the enlarged display view according to the position to be displayed.

[0025] In the above embodiment, the display position is adjusted by determining the display position of the enlarged display view to be created, if the enlarged display view at the cursor position at least partially exceeds the display boundary, while ensuring that the enlarged display view does not exceed the display boundary. By controlling the display to display the enlarged display view based on the display position, the enlarged display view can be displayed within the display boundary, thereby improving the display quality.

[0026] In some embodiments, when the controller executes the process of obtaining a target image in the second area from the screenshot, the controller is configured to: obtain the image in the second area that does not exceed the display boundary from the screenshot as the target image; accordingly, when the controller executes the process of filling the target image into the enlarged display view, the controller is configured to: evenly stretch the target image and fill it into the enlarged display view.

[0027] In the above embodiment, by obtaining the portion of the image in the second area that does not exceed the display boundary from the screenshot as the target image, the effective content within the portion of the screenshot that does not exceed the display boundary is extracted. The target image is evenly stretched to fill the enlarged display view, which helps to improve the display effect.

[0028] In a second aspect, some embodiments provide a method for image magnification, including:

[0029] In response to a zoom operation on a region of a picture currently displayed on the display, capturing the picture currently displayed to obtain a screenshot;

[0030] Creating a base view by overlaying it on the currently displayed image, compressing the screenshot to obtain a compressed screenshot, and displaying the compressed screenshot in the base view; wherein the base view has a smaller resolution than the screenshot;

[0031] In response to a pointing operation on the reference view, creating an enlarged presentation view at a cursor position of the cursor; the cursor is displayed on an operation interface of the display, and the cursor position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space;

[0032] Mapping a first area where the cursor is located in the base view to a second area in the screenshot, and obtaining a target image of the second area from the screenshot; wherein the area pixel size of the second area is larger than the area pixel size of the first area;

[0033] Filling the target image into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

[0034] In the above embodiment, by responding to a zoom operation on an area of ​​the currently displayed screen on the display, the currently displayed screen is captured, thereby obtaining a screenshot containing the content of the currently displayed screen, providing a data basis for subsequent screen zooming. By superimposing a base view on the currently displayed screen and compressing the screenshot to obtain a compressed screenshot, the compressed screenshot is displayed in the base view, thereby reducing the bandwidth capacity requirements of the display system. By responding to a pointing operation on the base view, an enlarged display view is created at the cursor position, so that the enlarged display view has a follow-up feature, can respond to the movement of the cursor in real time, locate the area of ​​user interest, and improve the convenience of operation control. By mapping the first area where the cursor is located in the base view to the second area in the screenshot, obtaining a target image of the second area from the screenshot, and filling the target image into the enlarged display view, an enlarged display of the area where the cursor is located is achieved. Since the target image is extracted from the screenshot image, the image resolution of the screenshot image is greater than the view resolution of the baseline view, and the screenshot image is compressed to obtain a compressed screenshot image, which is displayed in the baseline view. Therefore, the clarity of the enlarged display view can be guaranteed without increasing the system bandwidth capacity, thereby improving the user experience.

[0035] In a third aspect, some embodiments provide a picture magnification device, including:

[0036] A capture module, configured to capture the currently displayed image in response to a zoom operation on a region of the image currently displayed on the display, to obtain a screenshot;

[0037] A first creation module is configured to create a base view by overlaying it on the currently displayed image, compress the screenshot to obtain a compressed screenshot, and display the compressed screenshot in the base view; wherein the view resolution of the base view is smaller than the image resolution of the screenshot;

[0038] a second creating module, configured to create an enlarged display view at a cursor position of the cursor in response to a pointing operation on the reference view; the cursor is displayed on an operation interface of the display, and the cursor position of the cursor in the operation interface is determined by a pointing position of the remote controller in three-dimensional space;

[0039] an acquisition module, configured to map a first area where the cursor is located in the reference view to a second area in the screenshot, and acquire a target image of the second area from the screenshot; the area pixel size of the second area is larger than the area pixel size of the first area;

[0040] The filling module is used to fill the target image into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

[0041] In the above embodiment, by responding to a zoom operation on an area of ​​the currently displayed screen on the display, the currently displayed screen is captured, thereby obtaining a screenshot containing the content of the currently displayed screen, providing a data basis for subsequent screen zooming. By superimposing a base view on the currently displayed screen and compressing the screenshot to obtain a compressed screenshot, the compressed screenshot is displayed in the base view, thereby reducing the bandwidth capacity requirements of the display system. By responding to a pointing operation on the base view, an enlarged display view is created at the cursor position, so that the enlarged display view has a follow-up feature, can respond to the movement of the cursor in real time, locate the area of ​​user interest, and improve the convenience of operation control. By mapping the first area where the cursor is located in the base view to the second area in the screenshot, obtaining a target image of the second area from the screenshot, and filling the target image into the enlarged display view, an enlarged display of the area where the cursor is located is achieved. Since the target image is extracted from the screenshot image, the image resolution of the screenshot image is greater than the view resolution of the baseline view, and the screenshot image is compressed to obtain a compressed screenshot image, which is displayed in the baseline view. Therefore, the clarity of the enlarged display view can be guaranteed without increasing the system bandwidth capacity, thereby improving the user experience.

[0042] In the fourth aspect, some embodiments further provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method provided in some embodiments of the third aspect or the fourth aspect are implemented.

[0043] In the fifth aspect, some embodiments further provide a computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the method provided in some embodiments of the third aspect or the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0045] Figure 1 A schematic diagram of an operation scenario between a display device and a control device in some embodiments;

[0046] Figure 2 A schematic diagram of the hardware configuration of a display device in some embodiments;

[0047] Figure 3 A schematic diagram of the hardware configuration of a control device in some embodiments;

[0048] Figure 4 A schematic diagram of software configuration of a display device in some embodiments;

[0049] Figure 5 A schematic diagram of a pointing operation of a pointing remote controller in some embodiments;

[0050] Figure 6 A schematic diagram of a click operation on a pointing remote controller in some embodiments;

[0051] Figure 7 A schematic diagram of a selection operation of a pointing remote controller in some embodiments;

[0052] Figure 8 A schematic diagram of a multi-select operation of a pointing remote controller in some embodiments;

[0053] Figure 9 A schematic diagram of a drag operation directed at a remote controller in some embodiments;

[0054] Figure 10 A schematic diagram of a sliding operation on a pointing remote controller in some embodiments;

[0055] Figure 11 A schematic diagram of a continuous sliding operation of a pointing remote controller in some embodiments;

[0056] Figure 12 A schematic diagram of a continuous reverse sliding operation of a pointing remote controller in some embodiments;

[0057] Figure 13A is a flowchart of a method for image magnification in some embodiments;

[0058] Figure 13B Schematic diagram of displaying an annotation floating layer view in some embodiments;

[0059] Figure 13C Schematic diagram of the display position of the function area menu in some embodiments;

[0060] Figure 13D Schematic diagram of display content of a function area menu in some embodiments;

[0061] Figure 13E A schematic diagram of the hierarchical relationship between the ribbon menu, annotation view, and content view in some embodiments;

[0062] Figure 13F A schematic diagram of the hierarchical relationship between an enlarged display view and a reference view in some embodiments;

[0063] Figure 13G A schematic diagram showing an enlarged display view in some embodiments;

[0064] Figure 14 Schematic diagram of the process of obtaining a target image in some embodiments;

[0065] Figure 15A A flowchart illustrating steps for creating an enlarged display view in some embodiments;

[0066] Figure 15B A schematic diagram of display adjustment for an enlarged display view in some embodiments;

[0067] Figure 16 is a flowchart of a target image filling step in some embodiments;

[0068] Figure 17 is a timing diagram of a picture magnification method in some other embodiments;

[0069] Figure 18 Schematic diagram of the flow of the image magnification method in some other embodiments;

[0070] Figure 19 4 is a structural block diagram of a picture magnification device in some embodiments.

[0071] Figure 20 This is a block diagram of the internal structure of a computer device. DETAILED DESCRIPTION

[0072] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0073] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0074] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0075] The terms "comprise," "comprises," and "having," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0076] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0077] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0078] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0079] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0080] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0081] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0082] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0083] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0084] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0085] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0086] For example, display 260 may display a content view and an annotation view, wherein the content view displays media content, and the annotation view displays annotations for the media content. The media content may include at least one of video content and image content. The annotation view is located above the content view, i.e., at the upper view level of the content view, thereby enabling annotations to be made to the media content in the content view in the annotation view.

[0087] For example, the display 260 may display a reference view, and the screenshot is compressed and displayed in the reference view. The screenshot may be obtained by intercepting the image currently displayed on the display 260 in response to a zoom operation on a region of the image currently displayed on the display 260 .

[0088] Exemplarily, the display 260 can display an operation interface; the operation interface has a cursor; and the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space.

[0089] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function. When the display device 200 supports ultra-wideband connection communication (UWB, Ultra-Wideband), the display device 200 needs to be provided with a communication device 220 including a UWB antenna array.

[0090] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0091] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0092] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0093] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0094] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0095] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0096] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0097] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0098] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs. Optionally, the control device 100 may include a pointing remote control. The user can control the pointing direction or position change of the pointing remote control in space in combination with key commands to more accurately and intuitively control the display device 100. For example, the pointing remote control can be used to control the position movement of the cursor in the display device 100 to implement operational control of various menu control interfaces of the display device 100; it can also be used to annotate in the annotation view of the display device 100. This embodiment does not impose any limitation on the specific type of the control device 100.

[0099] In some embodiments, as Figure 1As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0100] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0101] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0102] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0103] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC, or UWB module, to encode user input commands via the WiFi protocol, Bluetooth protocol, NFC protocol, or UWB protocol and transmit them to the display device 200. Specifically, user input commands encoded via the UWB protocol and transmitted to the display device 200 can control the pointing function.

[0104] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0105] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0106] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0107] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0108] The operating system can be divided into different modules or layers according to the functions implemented.

[0109] For example, Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0110] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0111] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0112] like Figure 4In the embodiment of the present application, the application framework layer includes a view system, managers, and content providers. The view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0113] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0114] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0115] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0116] like Figure 4 As shown, Figure 4 Some embodiments of this application provide Figure 1Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0117] The application layer mainly includes commonly used applications on the TV and the application framework. Common applications are mainly browser-based applications, such as HTML5 applications (HyperText Markup Language 5 applications, applications based on web technologies such as the fifth edition of Hypertext Markup Language) and native applications.

[0118] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0119] Native apps can support online or offline, message push or local resource access.

[0120] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware uses the basic services (functions) provided by system software to connect various parts of the application system or different applications on the network, enabling resource and function sharing.

[0121] The hardware layer primarily includes the Hardware Abstraction Layer (HAL) interface, hardware, and drivers. The HAL interface is a unified interface for all TV chipsets, while the specific logic is implemented by each chip. Drivers primarily include: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0122] In some embodiments, a display device is provided, comprising: a display configured to: display a user interface, the user interface including at least one control; the user interface also having a cursor, the position of the cursor on the user interface being determined by the position pointed to by the remote control in three-dimensional space.

[0123] Optionally, the user can control the display device to start up through voice, remote control, or the switch of the TV device. After the display device is started, the user interface corresponding to the homepage is displayed through the display. The user can switch to other user interfaces through voice or remote control, such as: the user interface corresponding to the TV series label, the user interface corresponding to the movie label, the user interface corresponding to a page provided by a certain application, etc. The embodiment of the present application does not limit this.

[0124] Optionally, among all the user interfaces displayed on the display, some user interfaces contain controls, while some user interfaces may not contain controls. The solution provided in the embodiment of the present application is aimed at user interfaces containing controls. The number of controls on a user interface containing controls may be only one or may be greater than one, and the embodiment of the present application does not limit this.

[0125] Optionally, the remote control used with the display device may be a remote control with a pointing function, hereinafter referred to as a pointing remote control. When the pointing function is enabled, the user interface displayed on the display also includes a cursor, and the position of the cursor on the user interface is determined by the position pointed to by the pointing remote control in three-dimensional space. In the embodiments of the present application, the position pointed to by the pointing remote control in three-dimensional space is also referred to as the position data of the pointing remote control in three-dimensional space. The specific implementation process for determining the position of the cursor on the user interface based on the position data of the pointing remote control is described below.

[0126] The position data of a pointing remote control in three-dimensional space may include: position coordinates and pointing direction. The position coordinates are the physical position of the pointing remote control relative to the display device (e.g., horizontal distance and vertical height from the display device). The pointing direction is the pointing angle of the pointing remote control (e.g., horizontal and vertical angles relative to the display device). The pointing remote control has a built-in gyroscope to detect the remote control's rotation angle and an accelerometer to detect the remote control's acceleration. Using these sensors, the pointing remote control can determine its position data in three-dimensional space in real time.

[0127] In some embodiments, after obtaining its own position data in three-dimensional space, the pointing remote control can send this position data to a display device. The display device can perform screen coordinate conversion based on this position data, thereby converting the position data of the pointing remote control in three-dimensional space into a screen coordinate system. The obtained screen coordinates can be used as the position of the cursor on the user interface, and the cursor can be drawn at this position, thereby displaying the cursor.

[0128] In some embodiments, the pointing remote control includes a coordinate conversion module. After obtaining its own position data in three-dimensional space, the pointing remote control can input the position data into the coordinate conversion module. The coordinate conversion module can perform screen coordinate conversion based on the position data, thereby converting the position data into a screen coordinate system to obtain screen coordinates. The screen coordinates can be used as the position of the cursor on the user interface, and the position of the cursor on the user interface is sent to the display device. After receiving the position of the cursor on the user interface, the display device draws the cursor at the position, thereby displaying the cursor. Exemplarily, the position of the cursor on the user interface is the coordinates (a, b), and the display device draws the cursor at the position with the coordinates (a, b) on the user interface, thereby displaying the cursor.

[0129] For example, see Figure 5 As shown, when the position data of the pointing remote control in three-dimensional space is A, the position of the cursor on the user interface is coordinates (a1, b1). When the position data of the pointing remote control in three-dimensional space is B, the position of the cursor on the user interface is coordinates (a2, b2). When the position data of the pointing remote control in three-dimensional space is C, the screen coordinates calculated using the above method exceed the screen range, and the display device no longer draws the cursor, so the cursor disappears.

[0130] See also Figure 6 As shown, the pointing remote control supports tapping. When the cursor hovers over a control, the user can press the touch area (confirmation key) on the pointing remote control, and the display device executes the corresponding logic in response to the operation. The controls here can be cards, buttons, input boxes, single choices, switches, dialog boxes, multiple choices, sliders, playback progress bars, scroll bars, drop-down menus, labels, lists, etc., and the embodiments of the present application do not limit this.

[0131] See also Figure 7 As shown, the pointing remote control supports selection. When the user interface displays multiple options and selection boxes corresponding to these multiple options, if the user wants to select the first option and the third option, the user can first control the cursor to hover over the selection box corresponding to the first option and press the touch area on the pointing remote control. At this time, the first option is selected; then, the user can control the cursor to hover over the selection box corresponding to the third option and press the touch area on the pointing remote control. At this time, the third option is selected, thereby completing the jump selection.

[0132] See also Figure 8As shown, the pointing remote control supports drag-and-drop multi-selection. When the user interface displays multiple options and selection boxes corresponding to these multiple options, if the user wants to select all options, the user can control the cursor to hover anywhere in the area above the first option, press the touch area on the pointing remote control and drag downward until the cursor moves to the area below the last option. At this time, all options are selected, thus completing the drag-and-drop multi-selection.

[0133] See also Figure 9 As shown, the pointing remote control supports dragging. When the user interface is playing a video and a playback progress bar is displayed, the user can control the cursor to hover over a certain position on the playback progress bar, and then press the touch area on the pointing remote control. The video played in the user interface will fast forward or rewind the video frame corresponding to the position, thereby completing the dragging of the playback progress. The playback progress bar in this example is only an example. Controls that support dragging also include sliders, scroll bars, labels, cards, lists, etc., and the embodiments of the present application are not limited to this.

[0134] See also Figure 10 As shown, the pointing remote control supports sliding. When a cursor is displayed on the user interface, the user can slide up, down, left or right on the touch area on the pointing remote control, and the display device will respond to these slides.

[0135] See also Figure 11 As shown, the pointing remote control supports continuous sliding. When a cursor is displayed on the user interface, the user can continuously slide up, down, left or right on the touch area on the pointing remote control. The display device will respond to these continuous slides and display a damped bone motion effect on the user interface. Figure 11 A schematic diagram of continuous upward sliding.

[0136] See also Figure 12 As shown, the pointing remote control supports continuous reverse sliding. When a cursor is displayed on the user interface, the user can slide in a certain direction and then in the opposite direction on the touch area on the pointing remote control. The display device will respond to the continuous reverse sliding and display a damped sliding effect on the user interface. Figure 12 A schematic diagram of sliding up and then sliding down.

[0137] With the continuous improvement of display technology, display technology has made great progress, and its application scenarios are becoming increasingly rich and diverse. For example, in the conference annotation scenario, participants can annotate the meeting content during the meeting, such as marking key points and recording ideas, which greatly enhances the interactivity of the meeting and the intuitiveness of information communication, allowing participants to participate in the meeting discussion more conveniently. For example, in scenarios such as teaching and lectures, users can mark on the display screen according to the needs of the presentation. In actual usage scenarios, in order to ensure that users can clearly obtain the content on the display screen, it is usually necessary to stretch or enlarge the display screen. However, the enlarged display screen often has the problem of insufficient clarity, making it difficult for users to clearly identify the annotation content, affecting the acquisition and understanding of key information, and reducing the overall user experience.

[0138] It should be noted that the term "in response to" used below indicates a state in which a corresponding event occurs or a condition is satisfied. It is understandable that the timing of executing the subsequent action executed in response to the event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is satisfied. For example, in some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; while in other cases, the subsequent action may not be executed until a period of time has passed after the event occurs or the condition is satisfied. "Trigger operation" refers to an action performed by a user on a visual interface by clicking, dragging, sliding, controlling cursor movement or other interactive methods. At the same time, the above-mentioned trigger operation can be implemented by a control device 100 such as a remote control or a mouse, or it can be implemented based on user touch. This embodiment does not impose any limitation on the specific control method of the trigger operation. Exemplarily, the remote control may include a pointing remote control.

[0139] In some alternative embodiments, see Figure 13A , provides a picture magnification method, applied to the controller 250, comprising the following steps:

[0140] S1310 . In response to a zoom-in operation on a region of a currently displayed image on the display, capture the currently displayed image to obtain a screenshot.

[0141] For example, the currently displayed screen includes media content and annotation content, the media content is displayed in the content view, and the annotation content is displayed in the annotation view; the annotation view is above the content view. This application does not impose any restrictions on the specific display content in the currently displayed screen.

[0142] The content view can be understood as a view used to display media content, which can include at least one of video content and image content. The annotation view can be understood as a view used to annotate the media content in the content view. The annotation view is located above the content view, i.e., it is overlaid on the content view, allowing annotations to be made on the media content in the content view within the annotation view.

[0143] The following is an exemplary description of the display methods of the content view and the media view. It should be noted that this should not be understood as a limitation on the specific display methods of the content view and the media view.

[0144] In some embodiments, in response to a media access operation, the display 260 can be controlled to display a content view and an annotation floating view; in response to a triggering operation on the annotation floating view, the display 260 can be controlled to display a ribbon menu and an annotation view.

[0145] The media access operation can be understood as an operation such as establishing, controlling, and interacting with a media stream transmission connection between an external device and the display device 100 through a preset interface or protocol. Optionally, the media access operation can include at least one of a switching operation for an HDMI (High Definition Multimedia Interface) channel and a screen projection initiation operation.

[0146] The annotation floating layer view can be understood as a graphical interface layer with annotation interaction properties. By triggering the annotation floating layer view, the function area menu and the annotation view for the annotation function can be displayed.

[0147] For example, the application layer of display device 200 may include a media application and a conference annotation application. In response to a media access operation, the media application may control display 260 to display a content view and send a notification message to the conference annotation application. In response to the notification message, the conference annotation application may control display 260 to display an annotation overlay view. The media application may include at least one of a live TV application and a converged screen projection application.

[0148] Optionally, the annotation pop-up layer can be set to a non-focusable and clickable state. "Non-focusable" can be understood as prohibiting the annotation pop-up layer view from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle, ensuring that the main content layer such as the content view can normally receive the target control instructions of the control device 100. Exemplarily, the target control instructions may include at least one control instruction such as volume adjustment, pause playback and page turning. "Clickable" can be understood as allowing the control device 100 to perform trigger operations on the annotation pop-up layer view.

[0149] Optionally, the annotation floating view can be displayed at a preset display position in the display 260. For example, the preset display position can be the edge of the display area of ​​the display 260 to minimize interference with the content view. Figure 13B The diagram shows the display of the annotation floating view. Figure 13B The example shows that the annotation floating layer view Figure 1 It can be displayed in the middle of the right side of the display screen of the display 260, thereby reducing the visual impact of the content. Figure 2 It should be noted that this embodiment does not impose any restrictions on the specific display position and specific presentation method of the annotation floating layer view. For example, the annotation floating layer can be set to a non-focusable state to prohibit the annotation floating layer from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle. For example, the annotation view can be created in a floating layer manner and loaded by the conference annotation application.

[0150] Among them, the function area menu can be understood as a menu interface for users to interact with annotation tools.

[0151] See also Figure 13C This is a diagram showing the display location of the ribbon menu. Figure 13C As shown in FIG, the display position of the function area menu 4 can correspond to the annotation floating layer view setting, that is, located at the edge of the display area. Figure 13C Also shown is the comment Figure 3 and cursor view Figure 5 Understandably, the criticism Figure 3 Can be displayed on top of the content view. Figure 5 That is, the display view of the cursor. Figure 5 It can be a global view displayed by the whole platform system service of the display device 200. The cursor position of the cursor view in the display screen can be controlled by pointing at at least one control device 100 such as a remote control and a mouse, or by touch. This embodiment does not impose any restrictions on the specific control method and specific presentation method of the cursor. For example, the cursor position in the operation interface is determined by the pointing position of the remote control in three-dimensional space. For example, the cursor view can use a circular cursor style by default.

[0152] See also Figure 13DFigure 4 is a schematic diagram of the display content of the ribbon menu. The ribbon menu 4 can display at least one of the following: an annotation control, an erase control, a clear screen control, a cursor control, a focus control, and a close control. The annotation control is used to annotate media content in the annotation drawing; the erase control is used to erase the annotated content; the clear screen control is used to clear the screen of annotated content; the cursor control is used to switch the annotation brush to the default cursor; the focus control is used to focus the selected content; and the close control is used to close the ribbon menu.

[0153] Continue to refer Figure 13D , the function area menu can also display a magnification control 6, which is used to magnify the annotation. It should be noted that this embodiment does not impose any restrictions on the specific content presented in the function area menu. Exemplarily, the function area menu can be set to a non-focusable state to prohibit the function area menu from capturing input from the control device 100 such as the remote control direction keys, keyboard or handle. Exemplarily, the function area menu can be created in a floating layer manner and loaded by the conference annotation application.

[0154] refer to Figure 13E The following is a diagram showing the hierarchical relationship between the function area menu, annotation view and content view. Figure 3 Located in the content view Figure 2 Above.

[0155] The following is an exemplary description of a method for obtaining a screenshot image. It should be noted that this should not be construed as limiting the specific method for obtaining a screenshot image.

[0156] The screenshot image can be understood as an image captured from the current screen displayed on the display in response to a region zoom-in operation, and includes the content of the current screen displayed.

[0157] In some embodiments, in response to a triggering operation on a zoom control in a function area menu, a screenshot of the current image displayed on the display may be obtained.

[0158] Optionally, in response to triggering the zoom control in the function area menu, the cursor and / or function area menu can be hidden; the current display image can be captured to obtain a screenshot. This achieves the hiding of visual elements unrelated to the desired zoomed-in display content, simplifies information presentation, and prevents the cursor or function area menu from obscuring the desired zoomed-in display content, facilitating the user to quickly and accurately obtain the desired information when zooming in on the display later.

[0159] Optionally, the platform interface may be called to capture the current image displayed on the display 260 to obtain a screenshot.

[0160] S13120. Create a base view by overlaying it on the currently displayed screen, compress the screenshot to obtain a compressed screenshot, and display the compressed screenshot in the base view; wherein the view resolution of the base view is smaller than the image resolution of the screenshot.

[0161] The display resolution can be understood as the physical pixel arrangement density of the display screen of the display 260, that is, the total number of pixels in the horizontal and vertical directions of the display screen. The image resolution can be understood as the total number of image pixels, that is, the total number of pixels in the horizontal and vertical directions of the image. Taking 4K display resolution as an example, 4K display resolution can be understood as the total number of horizontal pixels in the display screen is close to 4K (for example, 3840 or 4096, etc.), and the vertical pixels match a preset aspect ratio (for example, 16:9, or 17:9, etc.).

[0162] Optionally, the displayed image includes media content and annotation content, the media content is displayed in the content view, and the annotation content is displayed in the annotation view, with the annotation view being above the content view. Accordingly, a base view can be created by overlaying the annotation view.

[0163] Optionally, the image resolution of the screenshot image can be determined according to the display resolution of the content view and the annotation view. For example, when both the content view and the annotation view have a display resolution of 4K, the image resolution of the captured screenshot image can be 4K image resolution.

[0164] It is understandable that when the display resolutions of the content view and the annotation view are both high (for example, both are 4K display resolutions), the base view is output at the native resolution, and the system bandwidth will face the high load pressure of the multi-view data stream, resulting in a significant decrease in real-time rendering performance. Therefore, in some embodiments, the screenshot image can be compressed to obtain a compressed screenshot image, and the compressed screenshot image can be displayed in the base view, thereby reducing the requirements for the bandwidth capacity of the display system. Exemplarily, the screenshot image can be compressed to 2K and displayed in the base view. It should be noted that this embodiment does not impose any limitation on the specific value of the image resolution of the screenshot image.

[0165] In some embodiments, the compression ratio of the screenshot in the base view can be dynamically adjusted according to the bandwidth occupancy rate. For example, when the bandwidth occupancy rate is less than the occupancy rate threshold, the screenshot in the base view can be compressed with a first compression ratio; when the bandwidth occupancy rate is not less than the occupancy rate threshold, the screenshot in the base view can be compressed with a second compression ratio. The first compression ratio is less than the second compression ratio. It should be noted that the first compression ratio, the second compression ratio and the occupancy rate threshold can be set by technical personnel according to needs or experience, or determined through a large number of experiments, and this embodiment does not impose any restrictions on this. This embodiment also does not impose any restrictions on the specific method of determining the compression ratio.

[0166] S1330: In response to a pointing operation on the reference view, create an enlarged presentation view at the cursor position of the cursor.

[0167] The pointing operation on the reference view may be understood as an operation of controlling the cursor position of the cursor in the reference view.

[0168] In some embodiments, the pixel size of the magnified presentation view may be determined based on the pixel size of the baseline view. For example, the pixel size of the baseline view and the pixel size of the magnified presentation view may be in a preset ratio.

[0169] In other embodiments, the pixel size of the magnified display view can be preset, thereby creating a magnified display view of the corresponding pixel size at the cursor position. For example, the preset pixel size can be 300px (μixel, pixels) * 300px. The preset pixel size can be set by a technician based on needs or experience. This embodiment does not impose any restrictions on the specific pixel size of the magnified display view.

[0170] Optionally, the shape of the enlarged display view may be at least one of a circle and a rectangle. This embodiment does not impose any limitation on the specific shape of the enlarged display view.

[0171] In some embodiments, creating an enlarged display view at the cursor's position may include: creating the enlarged display view at the cursor's position in response to a confirmation operation on the cursor's position. For example, the user can confirm the cursor's position by pointing to a "Confirm" button on a remote control. The user can control the cursor's position by moving the remote control, and upon pressing the "Confirm" button, the display 260 creates the enlarged display view at the corresponding cursor position. In another optional embodiment, the enlarged display view may also be created directly at the cursor's position in response to a pointing operation on the reference view.

[0172] In some embodiments, an enlarged display view can be created in advance and set to be invisible; in response to a pointing operation on the base view, the enlarged display view is set to be visible, and the layout position of the enlarged display view is set to the cursor position of the cursor.

[0173] refer to Figure 13F This is a diagram showing the hierarchical relationship between the enlarged view and the base view. Figure 7 Located above the annotation view; zoom in on the presentation view Figure 8 Located at the base view Figure 7 , and below the Ribbon Menu 4.

[0174] S1340: Map the first area where the cursor is located in the reference view to the second area in the screenshot, and obtain a target image of the second area from the screenshot; the area pixel size of the second area is larger than the area pixel size of the first area.

[0175] In some embodiments, the mapping position of the cursor position in the screenshot and the regional pixel size of the second area can be determined; and the target image is obtained from the screenshot according to the mapping position and the regional pixel size of the second area.

[0176] It can be understood that because the image resolution of the screenshot is greater than the view resolution of the baseline view, after mapping the first area in the baseline view to the second area in the screenshot, the regional pixel size of the second area is greater than the regional pixel size of the first area. For example, if the image resolution of the screenshot is 4K, the view resolution of the baseline view is 2K, and the regional pixel size of the first area is 100px*100px, the resulting size of the second area is 200px*200px.

[0177] S1350: Fill the target image into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

[0178] In an optional embodiment, the target image may be filled into the enlarged display view according to pixel positions.

[0179] In another embodiment, the target image can be filled and drawn into the enlarged display view in a fitxy (stretch) manner. The fitxy manner can be understood as stretching the width and height of the target image so that the target image size is consistent with the view pixel size of the enlarged display view. Optionally, the target image can be evenly filled into the enlarged display view. Exemplarily, the target image can be stretched and filled into the enlarged display view in an equal proportion in a center-aligned manner.

[0180] refer to Figure 13G A schematic diagram showing an enlarged view. Figure 13G The reference view is shown in Figure 7 The media content and corresponding annotation content can be displayed in the Figure 8 The target image of the first area where the cursor is located is filled in, thereby achieving the enlargement of the media content and the corresponding annotation content in the first area where the cursor is located.

[0181] In the above embodiment, by responding to a zoom operation on an area of ​​the currently displayed screen on the display, the currently displayed screen is captured, thereby obtaining a screenshot containing the content of the currently displayed screen, providing a data basis for subsequent screen zooming. By superimposing a base view on the currently displayed screen and compressing the screenshot to obtain a compressed screenshot, the compressed screenshot is displayed in the base view, thereby reducing the bandwidth capacity requirements of the display system. By responding to a pointing operation on the base view, an enlarged display view is created at the cursor position, so that the enlarged display view has a follow-up feature, can respond to the movement of the cursor in real time, locate the area of ​​user interest, and improve the convenience of operation control. By mapping the first area where the cursor is located in the base view to the second area in the screenshot, obtaining a target image of the second area from the screenshot, and filling the target image into the enlarged display view, an enlarged display of the area where the cursor is located is achieved. Since the target image is extracted from the screenshot image, the image resolution of the screenshot image is greater than the view resolution of the baseline view, and the screenshot image is compressed to obtain a compressed screenshot image, which is displayed in the baseline view. Therefore, the clarity of the enlarged display view can be guaranteed without increasing the system bandwidth capacity, thereby improving the user experience.

[0182] Based on the technical solutions of the above embodiments, an optional embodiment is provided. In this optional embodiment, the step of obtaining the target image is refined.

[0183] See also Figure 14 The steps for obtaining the target image shown include:

[0184] S1410: Determine a mapping position of the cursor position in the screenshot image and a pixel size of the second area.

[0185] The mapping position may be understood as mapping the cursor position of the reference view to the corresponding position in the screenshot.

[0186] In some embodiments, a target ratio between the display resolution of the display 260 and the view resolution of the baseline view can be determined; the cursor position is mapped to the screenshot according to the target ratio to obtain a mapping position; and the ratio between the view pixel size of the enlarged display view and the preset magnification is multiplied by the target ratio as the regional pixel size of the second area.

[0187] The display resolution of the display 260 and the view resolution of the reference view can be obtained from the resolution information of the display device 200. For example, taking the display resolution as 4096*2160 and the view resolution of the reference view as 2048*1080 as an example, the target ratio between the display resolution and the view resolution of the reference view can be determined to be 2.

[0188] The preset magnification can be set by a technician based on their needs or experience, or determined through extensive experiments, and this embodiment does not impose any limitations on this. Optionally, a magnification setting page can be displayed in response to a triggering operation on a magnification setting control in the function area menu; and the preset magnification can be updated in response to a modification operation on the preset magnification on the magnification setting page.

[0189] In some embodiments, the cursor position can be multiplied by the target scale to obtain the mapping position. For example, if the cursor position is (x, y) and the target scale is r, the mapping position can be expressed as (rx, ry). Among them, the position of the cursor position in the pixel coordinate system can be determined by constructing a pixel coordinate system. The x-axis of the pixel coordinate system represents the horizontal pixel coordinate of the reference view, and the y-axis represents the vertical pixel coordinate of the reference view. For example, the cursor position (x, y) of the cursor can be captured by registering a hover event listener.

[0190] In some embodiments, the view pixel size of the enlarged presentation view may include at least one of a pixel width and a pixel height of the enlarged presentation view. The region pixel size of the second region may include at least one of a pixel width and a pixel height of the target image. The pixel width may be understood as the logical horizontal space occupied, and the pixel height may be understood as the logical vertical space occupied.

[0191] In some other embodiments, the view pixel size of the enlarged display view may include a pixel diameter of the enlarged display view, and the region pixel size of the second region may include a pixel diameter of the second region. For example, the pixel diameter of the second region may be determined according to the following formula:

[0192]

[0193] Among them, R t represents the pixel diameter of the second region; Rs Indicates the pixel diameter of the magnified display view; m indicates the preset magnification; and r indicates the target ratio.

[0194] The units of the view pixel size and the region pixel size may be logical pixels px.

[0195] S1420 : Taking the mapping position as the center, capture a target image of a pixel size of the second area from the screenshot image.

[0196] In some embodiments, the mapping position (rx, ry) can be used as the center and the pixel diameter R of the target image can be used as the center. t To capture the diameter, capture the target image from the screenshot.

[0197] By introducing a target scale, the coordinate mapping relationship between the display resolution and the baseline view resolution can be quantified. By mapping the cursor position to the fused view image according to the target scale, the mapping position can be adaptively determined. The ratio between the pixel size of the magnified display view and the preset magnification factor can be used to represent the required image size before mapping. By multiplying this ratio by the target scale, the pixel size of the second region can be quickly and accurately determined.

[0198] Based on the technical solutions of the above embodiments, an optional embodiment is provided. In this optional embodiment, the steps for creating the enlarged display view are refined.

[0199] See also Figure 15A The steps for creating the enlarged display view shown include:

[0200] S1510. In response to a pointing operation on the reference view, when the enlarged presentation view to be created at the cursor position at least partially exceeds the display boundary, determine, based on a view pixel size of the enlarged presentation view and a picture size of a picture currently displayed on the display, a position of the enlarged presentation view to be displayed without exceeding the display boundary.

[0201] The display boundary can be understood as the boundary of the image displayed by the display 260 .

[0202] In some embodiments, it may be determined whether the enlarged presentation view exceeds the display boundary based on the cursor position, the view pixel size of the base view, and the view pixel size of the enlarged presentation view.

[0203] refer to Figure 15B The display adjustment diagram of the enlarged display view is shown. Figure 15B The following example shows the zoomed display view to be created at the cursor position in different situations. Figure 8and zoomed in after adjustment Figure 9 The cursor is located at the zoomed-in view to be created. Figure 8 It can be understood that the enlarged display view to be created Figure 8 The situation of exceeding the display boundary may include at least one of exceeding the upper display boundary, exceeding the lower display boundary, exceeding the left display boundary, and exceeding the right display boundary.

[0204] Optionally, corresponding judgment conditions may be predefined for different situations to facilitate determining whether the enlarged display view exceeds the display boundary.

[0205] The following takes the coordinate origin of the coordinate system at the upper left vertex of the enlarged display view as an example, and provides an exemplary explanation of the judgment conditions corresponding to different situations. It should be noted that it should not be understood as a limitation on the specific judgment conditions and the specific construction method of the coordinate system. For example, the x-axis of the coordinate system can point from the origin of the coordinate system to the upper right vertex of the enlarged display view, and the y-axis of the coordinate system can point from the origin of the coordinate system to the lower left vertex of the enlarged display view, thereby forming a plane rectangular coordinate system. The x-axis represents the horizontal position, that is, the horizontal pixel position; the y-axis represents the vertical position, that is, the vertical pixel position.

[0206] For example, if the following conditions are met, the enlarged presentation view exceeds the left display boundary:

[0207]

[0208] Among them, w s Indicates the pixel width of the enlarged display view; x indicates the horizontal coordinate of the cursor position.

[0209] For example, if the following conditions are met, the enlarged display view exceeds the right edge of the display:

[0210]

[0211] Among them, w s Indicates the pixel width of the enlarged display view; x indicates the horizontal coordinate of the cursor position; w f Indicates the pixel width of the base view.

[0212] For example, when the enlarged display view is a circular view, the pixel width w of the enlarged display view is s , that is, the pixel diameter R of the enlarged display view s .

[0213] For example, if the following conditions are met, the enlarged display view exceeds the upper display boundary:

[0214]

[0215] Among them, hs Indicates the pixel height of the enlarged display view; y indicates the vertical coordinate of the cursor position.

[0216] For example, if the following conditions are met, the zoomed-in display view exceeds the lower display boundary:

[0217]

[0218] Among them, h s Indicates the pixel height of the enlarged display view; y indicates the vertical coordinate of the cursor position; h f Indicates the pixel height of the base view.

[0219] For example, when the enlarged display view is a circular view, the pixel height h of the enlarged display view is s , that is, the pixel diameter R of the enlarged display view s .

[0220] The following is an exemplary description of the method for determining the position to be displayed. It should be noted that this should not be understood as limiting the specific method for determining the position to be displayed.

[0221] Exemplarily, when the enlarged display view exceeds the left display boundary, the abscissa of the position to be displayed is set to: ws / 2; otherwise, the abscissa of the position to be displayed is set to x.

[0222] For example, when the zoomed-in display view exceeds the right edge of the display, the horizontal coordinate of the position to be displayed is set to: w f -ws / 2; otherwise, set the horizontal coordinate of the position to be displayed to x.

[0223] For example, when the zoomed-in display view exceeds the upper display boundary, the vertical coordinate of the position to be displayed is set to: h s / 2; otherwise, set the vertical coordinate of the position to be displayed to y.

[0224] For example, when the zoomed-in display view exceeds the lower boundary of the display, the vertical coordinate of the position to be displayed is set to: h f -h s / 2; otherwise, set the vertical coordinate of the position to be displayed to y.

[0225] S1520: Control the display to display an enlarged display view according to the position to be displayed.

[0226] For example, the display 260 may be controlled to create an enlarged presentation view at the position to be presented.

[0227] In the above embodiment, the display position is adjusted by determining the display position of the enlarged display view to be created, if the enlarged display view at the cursor position at least partially exceeds the display boundary, while ensuring that the enlarged display view does not exceed the display boundary. By controlling the display to display the enlarged display view based on the display position, the enlarged display view can be displayed within the display boundary, thereby improving the display quality.

[0228] Based on the technical solutions of the above embodiments, an optional embodiment is also provided. In this optional embodiment, the filling step of the target image is refined.

[0229] See also Figure 16 The filling steps of the target image shown include:

[0230] S1610: Obtain, from the screenshot image, a portion of the image that does not exceed the display boundary in the second area as the target image.

[0231] In some embodiments, it can be determined whether the target image in the area where the cursor is located exceeds the display boundary based on the mapping position of the cursor in the screenshot image and the regional pixel size of the second area.

[0232] Referring to the above, if the cursor position is (x, y) and the target scale is r, the mapping position can be expressed as (rx, ry).

[0233] With reference to the foregoing, the product of the ratio between the view pixel size of the enlarged display view and the preset magnification m and the target ratio r may be used as the region pixel size of the second region.

[0234] For example, if the following conditions are met, the target image exceeds the left display boundary:

[0235]

[0236] Among them, w s Indicates the pixel width of the magnified display view; x indicates the horizontal coordinate of the cursor position; m indicates the preset magnification, and r indicates the target ratio.

[0237] For example, if the following conditions are met, the target image exceeds the right display boundary:

[0238]

[0239] Among them, w s Indicates the pixel width of the magnified display view; x indicates the horizontal coordinate of the cursor position; m indicates the preset magnification; r indicates the target ratio; w c Indicates the pixel width of the screenshot image.

[0240] For example, when the enlarged display view is a circular view, the pixel width w of the enlarged display view is s , that is, the pixel diameter R of the aforementioned enlarged display view s .

[0241] For example, if the following conditions are met, the target image exceeds the upper display boundary:

[0242]

[0243] Among them, h s Indicates the pixel height of the magnified display view; y indicates the vertical coordinate of the cursor position; m indicates the preset magnification; and r indicates the target ratio.

[0244] For example, if the following conditions are met, the target image exceeds the lower display boundary:

[0245]

[0246] Among them, h s Indicates the pixel height of the magnified display view; y indicates the vertical coordinate of the cursor position; m indicates the preset magnification; r indicates the target ratio; h c Indicates the pixel height of the screenshot.

[0247] For example, when the enlarged display view is a circular view, the pixel height h of the enlarged display view is s , that is, the pixel diameter R of the aforementioned enlarged display view s .

[0248] S1620: Evenly fill the target image into the enlarged display view.

[0249] In some embodiments, the target image may be filled into the enlarged display view according to pixel positions.

[0250] In some embodiments, the target image may be stretched to fill the enlarged presentation view.

[0251] In some embodiments, the enlarged display view may be filled with a white canvas, the mapping position corresponding to the target image may be aligned to the center of the enlarged display view, and the target image may be evenly filled into the enlarged display view in a proportional filling manner.

[0252] In the above embodiment, the portion of the screenshot image within the area where the cursor is located that does not exceed the display boundary is obtained as the target image, thereby achieving the extraction of valid content within the portion of the screenshot image that does not exceed the display boundary. The target image is evenly filled into the enlarged display view, which is conducive to improving the display effect.

[0253] Based on the above embodiment, the screen magnification method can also be executed interactively by a media application, a system service, a conference annotation application, and an operating system. The media application can include at least one of a live TV application and a fusion screen projection application.

[0254] refer to Figure 17 Another image magnification method shown includes the following steps:

[0255] S1701. The media application sends a scene notification to the conference annotation application in response to a media access operation.

[0256] S1702: The conference annotation application controls the display to display an annotation floating view.

[0257] S1703: The conference annotation application sends a request to the operating system for obtaining the entire device information.

[0258] The whole device information includes the display resolution and the view resolution of the reference view.

[0259] S1704: The operating system sends the entire device information to the conference annotation application in response to the entire device information acquisition request.

[0260] S1705: The conference annotation application triggers a magnifying glass function in response to a zoom operation on a region of the image currently displayed on the display.

[0261] Among them, triggering the magnifying glass function is to trigger the magnifying control in the function area menu.

[0262] S1706. The conference annotation application hides the function menu.

[0263] S1707: The conference annotation application sends a cursor hiding request to the system service.

[0264] S1708. The conference annotation application sends a request for obtaining an image to the operating system.

[0265] S1709: The system service hides the cursor in response to the cursor hiding request.

[0266] S1710. The operating system sends the screenshot image to the conference annotation application in response to the image acquisition request.

[0267] The operating system responds to the image acquisition request and captures the currently displayed image to obtain a screenshot.

[0268] S1711. The conference annotation application obtains the hierarchical index position of the function area menu, inserts the base view and the magnified display view, and loads the screenshot.

[0269] S1712: In response to the pointing operation of the remote control on the reference view, the system service sends the coordinates of the hovering position of the cursor to the conference annotation application.

[0270] S1713: The conference annotation application determines the cursor position in the base view according to the hover position coordinates.

[0271] S1714. The conference annotation application creates an enlarged display view at the cursor position of the cursor.

[0272] S1715: The conference annotation application obtains a target image in the first area where the cursor is located from the screenshot image.

[0273] S1716. The conference annotation application fills the target image into the enlarged display view.

[0274] Based on the technical solutions of the above embodiments, Figure 18 As shown, another image magnification method is provided, and the image magnification method is described in detail, including the following steps:

[0275] S1801: In response to a media access operation, control the display to display an annotation floating layer view and a content view.

[0276] S1802: In response to a triggering operation on the annotation floating layer view, controlling the display to display a function area menu and the annotation view.

[0277] S1803: In response to a triggering operation on a magnification control in the function area menu, hiding the cursor and / or the function area menu.

[0278] S1804: Capture the current screen displayed on the monitor to obtain a screenshot.

[0279] S1805: Create a base view above the currently displayed screen, compress the screenshot to obtain a compressed screenshot, and display the compressed screenshot in the base view; wherein the view resolution of the base view is smaller than the image resolution of the screenshot.

[0280] S1806: In response to a pointing operation on the reference view, when the enlarged display view to be created at the cursor position at least partially exceeds the display boundary, determine a position of the enlarged display view to be displayed without exceeding the display boundary based on the view pixel size of the enlarged display view and the picture size of the picture currently displayed on the display.

[0281] S1807: Control the display to display an enlarged display view according to the position to be displayed.

[0282] S1808: Determine a target ratio between a display resolution of the display and a view resolution of the reference view.

[0283] S1809: Map the cursor position to the screenshot according to the target ratio to obtain a mapping position.

[0284] S1810: The product of the ratio of the view pixel size of the enlarged display view to the preset magnification and the target ratio is used as the region pixel size of the second region.

[0285] S1811: Taking the mapping position as the center, capture a target image of the pixel size of the second area from the screenshot image.

[0286] Among them, the image that does not exceed the display boundary can be obtained from the screenshot image as the target image;

[0287] S1812: Fill the target image evenly into the enlarged display view.

[0288] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0289] Based on the same inventive concept, embodiments of the present application also provide a screen magnification device for implementing the aforementioned screen magnification method. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more screen magnification device embodiments provided below can be found in the above-described limitations of the screen magnification method and will not be further elaborated here.

[0290] In an exemplary embodiment, Figure 19 As shown, a picture magnification device is provided, including: a capture module 1910, a first creation module 1920, a second creation module 1930, an acquisition module 1940 and a filling module 1950, wherein:

[0291] The capture module 1910 is configured to capture the currently displayed image in response to a zoom operation on a region of the currently displayed image on the display, and obtain a screenshot.

[0292] The first creation module 1920 is used to create a base view superimposed on the currently displayed screen, compress the screenshot image to obtain a compressed screenshot image, and display the compressed screenshot image in the base view; wherein the view resolution of the base view is smaller than the image resolution of the screenshot image.

[0293] The second creation module 1930 is used to create an enlarged display view at the cursor position of the cursor in response to a pointing operation on the reference view; the cursor is displayed on the operation interface of the display, and the cursor position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space.

[0294] The acquisition module 1940 is configured to map the first area where the cursor is located in the base view to the second area in the screenshot, and acquire a target image of the second area from the screenshot; the area pixel size of the second area is larger than the area pixel size of the first area.

[0295] The filling module 1950 is configured to fill the target image into the enlarged display view, wherein the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

[0296] In some embodiments, the acquisition module 1940 includes: a first determination unit, used to determine the mapping position of the cursor position in the screenshot image, and the regional pixel size of the second area; a first capture unit, used to capture a target image of the regional pixel size of the second area from the screenshot image with the mapping position as the center.

[0297] In some embodiments, the first determination unit includes: a first determination subunit, used to determine a target ratio between the display resolution of the display and the view resolution of the baseline view; a mapping subunit, used to map the cursor position to the screenshot according to the target ratio to obtain a mapping position; and a first processing subunit, used to use the ratio between the view pixel size of the enlarged display view and the preset magnification, multiplied by the target ratio, as the regional pixel size of the second area.

[0298] In some embodiments, the interception module 1910 includes: a first control unit, used to control the display to display the annotation floating view in response to a media access operation; a second control unit, used to control the display to display the function area menu in response to a triggering operation on the annotation floating view; a second interception unit, used to intercept the current display screen of the display in response to a triggering operation on the magnification control in the function area menu to obtain a screenshot.

[0299] In some embodiments, the second interception unit includes: a second processing subunit, which hides the cursor and / or the function area menu in response to a triggering operation of the magnification control in the function area menu; and a first interception subunit, which intercepts the current screen displayed on the display to obtain a screenshot.

[0300] In some embodiments, the present invention further includes: a first control module configured to control the display to display a content view in response to a media access operation, wherein the content view displays media content.

[0301] In some embodiments, the system further includes: a second control module for controlling the display to display the annotation view in response to a triggering operation on the annotation floating view, wherein the annotation view displays the annotation content.

[0302] In some embodiments, the second creation module 1930 includes: a second determination unit, for determining, in response to a pointing operation on the reference view, a position to be displayed in which the enlarged display view does not exceed the display boundary, based on the view pixel size of the enlarged display view and the picture size of the picture currently displayed on the display, when the enlarged display view to be created at the cursor position of the cursor at least partially exceeds the display boundary; and a third control unit, for controlling the display to display the enlarged display view according to the position to be displayed.

[0303] In some embodiments, the filling module 1950 includes: an acquisition unit for acquiring an image that does not exceed the display boundary in the two areas where the cursor is located from the screenshot image as a target image; and a filling unit for evenly stretching the target image and filling it into the enlarged display view.

[0304] Each module in the above-mentioned image magnification device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0305] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 20As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a method for magnifying an image is implemented. The display unit of the computer device is used to form a visually visible image, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse.

[0306] Those skilled in the art will understand that Figure 20 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0307] In one embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0308] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0309] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0310] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile memory and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a programmable logic unit (PLC), a data processing logic unit based on quantum computing, an artificial intelligence (AI) processor, and the like.

[0311] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0312] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: A display configured to display an operation interface; The operation interface has a cursor; The cursor position of the cursor in the operation interface is determined by the pointing position of the remote control in three-dimensional space; At least one controller, connected to the display, configured to: In response to a zoom operation on a region of a picture currently displayed on the display, capturing the picture currently displayed to obtain a screenshot; Creating a base view by overlaying it on the currently displayed image, compressing the screenshot to obtain a compressed screenshot, and displaying the compressed screenshot in the base view; wherein a view resolution of the base view is smaller than an image resolution of the screenshot; In response to a pointing operation on the reference view, creating an enlarged presentation view at a cursor position of the cursor; Mapping a first area where the cursor is located in the reference view to a second area in the screenshot, and obtaining a target image of the second area from the screenshot; wherein the area pixel size of the second area is larger than the area pixel size of the first area; The target image is filled into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

2. The display device according to claim 1, wherein When mapping a first area where a cursor is located in the reference view to a second area in the screenshot and acquiring a target image of the second area from the screenshot, the controller is configured to: Determining a mapping position of the cursor position in the screenshot and a region pixel size of the second region; Taking the mapping position as the center, a target image of the area pixel size of the second area is captured from the screenshot image.

3. The display device according to claim 2, wherein: When determining a mapping position of the cursor position in the screenshot and a pixel size of the second area, the controller is configured to: determining a target ratio between a display resolution of the display and a view resolution of the reference view; Mapping the cursor position to the screenshot according to the target ratio to obtain a mapping position; as well as, The product of the ratio of the view pixel size of the enlarged display view to the preset magnification and the target ratio is used as the region pixel size of the second region.

4. The display device according to any one of claims 1 to 3, characterized in that: When the controller executes a region zoom operation on a currently displayed image on the display and captures the currently displayed image to obtain a screenshot, the controller is configured to: In response to a media access operation, controlling the display to display an annotation floating layer view; In response to a triggering operation on the annotation floating layer view, controlling the display to display a function area menu; In response to a triggering operation on a zoom control in the function area menu, a current picture displayed on the display is captured to obtain a screenshot.

5. The display device according to claim 4, wherein: When the controller executes the capture of the current image displayed on the display to obtain a screenshot in response to a triggering operation on the magnification control in the function area menu, the controller is configured to: In response to a triggering operation on a magnification control in the function area menu, hiding the cursor and / or the function area menu; Capture the currently displayed image on the display to obtain a screenshot.

6. The display device according to claim 4, wherein: The controller is further configured to: In response to the media access operation, the display is controlled to display a content view, wherein media content is displayed in the content view.

7. The display device according to claim 4, wherein: The controller is further configured to: In response to a triggering operation on the annotation floating layer view, the display is controlled to display the annotation view, and the annotation content is displayed in the annotation view.

8. The display device according to any one of claims 1 to 3, characterized in that: When executing the creation of the enlarged presentation view at the cursor position of the cursor in response to the pointing operation on the reference view, the controller is configured to: In response to a pointing operation on the reference view, when the enlarged display view to be created at the cursor position at least partially exceeds the display boundary, determining, based on a view pixel size of the enlarged display view and a picture size of a picture currently displayed on the display, a position to be displayed of the enlarged display view without exceeding the display boundary; According to the position to be displayed, the display is controlled to display the enlarged display view.

9. The display device according to any one of claims 1 to 3, characterized in that: When executing the process of acquiring the target image in the second area from the screenshot image, the controller is configured to: Acquire, from the screenshot image, a portion of the image in the second area that does not exceed the display boundary as the target image; Accordingly, when filling the target image into the enlarged display view, the controller is configured to: The target image is evenly stretched and filled into the enlarged display view.

10. A method for image magnification, characterized in that: The method comprises: In response to a zoom operation on a region of a picture currently displayed on the display, capturing the currently displayed picture to obtain a screenshot; Creating a base view by overlaying it on the currently displayed image, compressing the screenshot to obtain a compressed screenshot, and displaying the compressed screenshot in the base view; wherein a view resolution of the base view is smaller than an image resolution of the screenshot; In response to a pointing operation on the reference view, creating an enlarged presentation view at a cursor position of a cursor, the cursor being displayed on an operation interface of the display, the cursor position in the operation interface being determined by a pointing position of a remote controller in three-dimensional space; Mapping a first area where the cursor is located in the reference view to a second area in the screenshot, and obtaining a target image of the second area from the screenshot; wherein the area pixel size of the second area is larger than the area pixel size of the first area; The target image is filled into the enlarged display view; the view pixel size of the enlarged display view is larger than the region pixel size of the first region.

Images