Display device and image expansion method

Abstract

The invention relates to a display device and an image expansion method. Comprising the steps of displaying an image expansion interface under the condition of entering an image expansion service, and displaying a first image in the image expansion interface; in response to an adjustment operation on the first image, displaying the first adjusted image in the image expansion interface, the adjustment operation including at least one of a position adjustment operation or a magnification operation; in response to the image expansion instruction, under the condition that a partial region in the first adjusted image is adjusted out of the image expansion interface and the first adjusted image meets an image expansion condition, determining image expansion parameters based on the position of the first adjusted image in the image expansion interface, and cutting the first adjusted image to obtain a part located in the image expansion interface, obtaining a first to-be-expanded image; and image expansion processing on the first to-be-expanded image based on the image expansion parameter is triggered to obtain an expanded image, the expanded image is displayed, and the aspect ratio of the expanded image is consistent with the aspect ratio of the image expansion interface. The image expansion efficiency can be improved.

Description

Technical Field

[0001] This application relates to the technical fields of display devices and image enlargement technologies, and in particular, to a display device and an image enlargement method. Background Art

[0002] With the rapid development of computer technology, image enlargement (sometimes simply referred to as "enlarging the image") has a wide range of applications in the field of images. Image enlargement refers to enhancing the content and adding new image content on the basis of the original image. Image enlargement can be used to enhance photographic works, restore old photos, improve the image quality of surveillance videos, and so on. In addition, image enlargement can also be used in fields such as imaging, driverless, and virtual reality to improve the quality and practicality of images. Therefore, it is expected that more possibilities can be brought to image processing based on image enlargement technology.

[0003] In traditional image enlargement technologies, either the position of the image cannot be adjusted, or the position of the image can only be adjusted within a fixed area, which limits the flexibility of image enlargement and affects the image enlargement efficiency. Summary of the Invention

[0004] This application provides a display device and an image enlargement method to solve the problem of inflexible image enlargement, thereby improving the image enlargement efficiency by enhancing the flexibility of image enlargement.

[0005] In a first aspect, some embodiments provide a display device, including: a display, a communication device, and a controller. Among them, the display is configured to display a user interface; the communication device is configured to establish a communication connection with a server; the controller is configured to: when entering the image enlargement service, control the display to display an image enlargement interface and display a first image in the image enlargement interface; in response to an adjustment operation on the first image, display a first adjusted image in the image enlargement interface, where the adjustment operation includes at least one of a position adjustment operation or a magnification operation; in response to an image enlargement instruction, when a partial area in the first adjusted image is adjusted outside the image enlargement interface and the first adjusted image meets the image enlargement condition, determine image enlargement parameters based on the position of the first adjusted image in the image enlargement interface, and crop a part located in the image enlargement interface from the first adjusted image to obtain a first image to be enlarged; trigger image enlargement processing on the first image to be enlarged based on the image enlargement parameters to obtain an enlarged image, and control the display to display the enlarged image, where the aspect ratio of the enlarged image is the same as the aspect ratio of the image enlargement interface.

[0006] In this embodiment, in response to the zoom-in instruction, when some regions in the first adjusted image are adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in condition, the zoom-in parameters are determined based on the position of the first adjusted image in the zoom-in interface, and the part located in the zoom-in interface is cropped from the first adjusted image to obtain the first image to be zoomed in. Therefore, when adjusting the image, the image is allowed to exceed the zoom-in interface, and the image region retained in the region can be cropped. When zooming in, the cropped image is zoomed in. Therefore, for the case where the user does not want to zoom in on the entire image, it helps to save the process of the user manually cropping the image, provides convenience for the user, improves the flexibility of zooming in, and further improves the zoom-in efficiency.

[0007] In a second aspect, some embodiments further provide a zoom-in method applied to the display device provided in the first aspect. The display device includes: a display, a communication device, and a controller. The method includes: when entering the zoom-in service, displaying a zoom-in interface and displaying a first image in the zoom-in interface; in response to an adjustment operation on the first image, displaying a first adjusted image in the zoom-in interface, where the adjustment operation includes at least one of a position adjustment operation or a magnification operation; in response to a zoom-in instruction, when some regions in the first adjusted image are adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in condition, determining the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, and cropping the part located in the zoom-in interface from the first adjusted image to obtain a first image to be zoomed in; triggering a zoom-in process on the first image to be zoomed in based on the zoom-in parameters to obtain a zoomed-in image, and displaying the zoomed-in image, where the aspect ratio of the zoomed-in image is the same as the aspect ratio of the zoom-in interface.

[0008] In this embodiment, in response to the zoom-in instruction, when some regions in the first adjusted image are adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in condition, the zoom-in parameters are determined based on the position of the first adjusted image in the zoom-in interface, and the part located in the zoom-in interface is cropped from the first adjusted image to obtain the first image to be zoomed in. Therefore, when adjusting the image, the image is allowed to exceed the zoom-in interface, and the image region retained in the region can be cropped. When zooming in, the cropped image is zoomed in. Therefore, for the case where the user does not want to zoom in on the entire image, it helps to save the process of the user manually cropping the image, provides convenience for the user, improves the flexibility of zooming in, and further improves the zoom-in efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0010] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application;

[0011] Figure 2 Schematic diagram of the hardware configuration of the display device provided by some embodiments of the present application;

[0012] Figure 3 Schematic diagram of the hardware configuration of the control device provided by some embodiments of the present application;

[0013] Figure 4 Schematic diagram of the software configuration of the display device provided by some embodiments of the present application;

[0014] Figure 5 Schematic diagram of the system architecture of the display device provided by some embodiments of the present application;

[0015] Figure 6 Schematic diagram of the flowchart of the zooming method provided by some embodiments of the present application;

[0016] Figure 7 Schematic diagram of the image viewing interface provided by some embodiments of the present application;

[0017] Figure 8 Schematic diagram of the positional relationship between the first adjusted image and the zooming interface provided by some embodiments of the present application;

[0018] Figure 9 Schematic diagram of the zooming interface provided by some embodiments of the present application;

[0019] Figure 10 Schematic diagram of a position of the first adjusted image in the zooming interface provided by some embodiments of the present application;

[0020] Figure 11 Schematic diagram of another position of the first adjusted image in the zooming interface provided by some embodiments of the present application;

[0021] Figure 12 Schematic diagram of the zooming waiting interface provided by some embodiments of the present application;

[0022] Figure 13 Schematic diagram of the zooming result interface provided by some embodiments of the present application;

[0023] Figure 14 A schematic flowchart of the image enlargement method provided for some other embodiments of the present application;

[0024] Figure 15 A schematic flowchart of the image enlargement method provided for some other embodiments of the present application;

[0025] Figure 16 A schematic diagram of the positions of the first adjusted image and the second adjusted image in the image enlargement interface provided for some embodiments of the present application;

[0026] Figure 17 A timing diagram of the image enlargement method provided for some embodiments of the present application. Detailed implementation manners

[0027] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0028] It should be noted that the brief description of the terms in the present application is only for facilitating the understanding of the following described implementation manners, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and general meanings.

[0029] The terms "first", "second", "third", etc. in the specification, claims and the above drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such used terms can be interchanged under appropriate circumstances.

[0030] The terms "comprising" and "having" and any variations thereof are intended to cover but not be exclusive of inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the clearly listed components, but may include other components not clearly listed or inherent to these products or devices.

[0031] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.

[0032] In the embodiments of the present application, the display device 200 generally refers to a device having the capabilities of screen display and data processing. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0033] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided for some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0034] The mobile terminal 300 can be used as a control device to perform human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 for data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and they can be connected and communicate through network communication protocols to achieve one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0035] As Figure 1 also shown, the display device 200 also communicates with the server 400 through various communication methods. The display device 200 is allowed to establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0036] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart TV, Internet Protocol Television (IPTV), etc.

[0037] Figure 2 Provided for some embodiments of the present application Figure 1 Hardware configuration block diagram of the display device 200 in

[0038] In some embodiments, the display device 200 may include at least one of a tuner-demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0039] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of environmental light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0040] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0041] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0042] The communication device 220 can enable the display device 200 to communicate with an external device or server 400 through a wireless or wired connection. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0043] In some embodiments, the controller 250 can include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0044] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different separate devices, that is, the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0045] In some embodiments, the user can input a user command on the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0046] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200 or an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0047] In some embodiments, the user input interface 280 can be used to receive instructions input by the user.

[0048] Figure 3 For some embodiments provided by the present application Figure 1 The hardware configuration block diagram of the control device in. As Figure 3 shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0049] The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing the role of an interaction intermediary between the user and the display device 200.

[0050] In some embodiments, the control device 100 may be an intelligent device. For example: the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0051] In some embodiments, as Figure 1 shown, after installing the application for controlling the display device 200, the mobile terminal 300 or other intelligent electronic devices can play a similar function to the control device 100.

[0052] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions between the external and the internal.

[0053] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near-field communication modules.

[0054] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a key 144, and other input interfaces.

[0055] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The communication interface 130 in the control device 100 is configured with modules such as WiFi, Bluetooth, NFC, etc., which can encode user input instructions through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol and send them to the display device 200.

[0056] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0057] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0058] To perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware resources and software resources in the display device 200. The operating system can (control the display device) provide a user interface, allowing the user to interact with the display device 200 and supporting the running of various applications.

[0059] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0060] The operating system can be divided into different modules or layers according to the functions implemented.

[0061] For example, as Figure 4 shown, in some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer, and the kernel layer.

[0062] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with the user based on the applications. At least one application can run in the application layer. These applications can be window programs, system setting programs, or clock programs, etc. that come with the operating system; or they can be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0063] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of the applications in the application layer. Applications can access the resources in the system and obtain system services during execution through the API interface.

[0064] As Figure 4 shown, in the embodiments of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of applications. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0065] In some embodiments, the activity manager is used to manage the life cycles of various applications and the usual navigation back functions, such as controlling the exit, opening, and backward movement of applications. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, shrinking the display window, jittering the display, distorting the display, etc.

[0066] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime library layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is to achieve.

[0067] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0068] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels included in the operating system and the specific level types can be in other forms.

[0069] In some embodiments, the operating system on the display device can be but is not limited to the Android system. As Figure 5 shown, a system architecture diagram of the display device is provided. The system architecture diagram includes an application layer, a framework layer, a Native (local service) layer, and an HW (hardware abstraction, Hardware Abstraction) layer. Among them, the application layer deploys an AI (Artificial Intelligence) image expansion application. The AI image expansion application includes an image decoding module, an image display module, a preprocessing module, an image expansion module, and a result display module. The image decoding module is used to decode the incoming image address according to the display support capabilities of the device to obtain the bitmap of the image. The image display module is used to display the bitmap obtained by the image decoding module on the interface, and is also used to receive user instructions for image adjustment. The image adjustment includes but is not limited to at least one of zooming in, zooming out, or panning. The preprocessing module is used to preprocess the display state of the adjusted image and convert it into expansion parameters that can be used by the image expansion module. The image expansion module is used to generate an image expansion request according to the expansion parameters obtained by the preprocessing module. The image expansion request is used to trigger the image expansion process. The image expansion request also carries the image to be expanded and executes the image expansion task, such as sending the image expansion request to the server and waiting for the generation of the expanded image result. Among them, the image expansion module can call the large model in the server to execute the image expansion task, that is, send the image expansion request to the server to obtain the expanded image result. The server provides an ability interface for image expansion and an ability interface for supporting the expansion range. The result display module is used to display the expanded image result obtained by the image expansion module. Among them, "reprocessing" means that the image can be adjusted again.

[0070] The framework layer includes BitmapFactory, View, and Canvas. Among them, BitmapFactory is a class provided by Android for decoding image files. It can decode image files in various formats (such as PNG, JPEG, WEBP, etc.) into Bitmap objects to facilitate image processing and display in the AI image enlargement application. View is the base class of all user interface components in Android. It represents a rectangular area on the screen and is responsible for drawing and event handling. Canvas is an abstract class that provides a canvas on which various graphics (such as text, lines, rectangles, circles, etc.) and bitmaps can be drawn.

[0071] The Native layer, also known as the native service layer, includes Skia and SurfaceFlinger. Skia is an open-source 2D graphics library used in the Android system for graphics and text rendering. The Skia library can be used for image decoding in the Android system. Skia provides image processing functions including image decoding, drawing, and processing. Among them, the decoding process includes: 1. Loading image data: Loading image data from files, resources, or the network; 2. Decoding using Skia: Decoding the image data into a bitmap (Bitmap) through the Skia library; 3. Displaying the picture: Drawing the decoded bitmap onto the screen. Various image formats can be efficiently processed through Skia in the Android system. BitmapFactory calls the corresponding functions of the Skia graphics library through JNI (Java Native Interface). SurfaceFlinger is responsible for synthesizing the window (Surface) data from different applications and sending it to the display device.

[0072] The HW (Hardware) layer includes OpenGL ES hal. OpenGL ES hal is a component in the Android system responsible for interacting with the GPU (Graphics Processing Unit). It provides an abstraction layer so that upper-layer applications and libraries can interact with different hardware through a unified interface, thus achieving hardware-accelerated graphics rendering.

[0073] In some embodiments, the present application provides a display device, including: a display and a controller; the controller is configured to: when entering an image expansion service, control the display to display an image expansion interface and display a first image in the image expansion interface; in response to an adjustment operation on the first image, display a first adjusted image in the image expansion interface, wherein the adjustment operation includes at least one of a position adjustment operation or a zoom operation; in response to an image expansion instruction, when a partial area in the first adjusted image is adjusted outside the image expansion interface and the first adjusted image meets the image expansion condition, determine the image expansion parameters based on the position of the first adjusted image in the image expansion interface, and crop the portion located in the image expansion interface from the first adjusted image to obtain the first image to be expanded; trigger image expansion processing of the first image to be expanded based on the image expansion parameters to obtain an expanded image, and control the display to display the expanded image, wherein the aspect ratio of the expanded image is consistent with the aspect ratio of the image expansion interface.

[0074] In the present embodiment, in response to the expansion instruction, a partial area in the first adjusted image is adjusted outside the expansion interface, and when the first adjusted image meets the expansion conditions, the expansion parameters are determined based on the position of the first adjusted image in the expansion interface, and the part located in the expansion interface is cropped from the first adjusted image to obtain the first image to be expanded. Therefore, when adjusting the image, the image is allowed to exceed the expansion interface, and the image area retained in the area can be cropped. When expanding the image, the cropped image is expanded. Therefore, for the case where the user does not want to expand the entire image, it helps to save the user the process of manually cropping the image, thereby providing convenience for the user, improving the flexibility of expanding the image, and thus improving the efficiency of expanding the image.

[0075] Based on this, in some embodiments, the present application provides a method for expanding an image, which is applied to a display device, such as Figure 6 As shown, the method includes:

[0076] Step 602: When entering the image expansion service, displaying an image expansion interface, and displaying a first image in the image expansion interface.

[0077] The size of the image expansion interface may be consistent with the screen size of the display, or the size of the image expansion interface may be smaller than the screen size. The image expansion service provides an image expansion function. The first image may be an image in any format, including but not limited to PNG, JPEG, WEBP or any bitmap format.

[0078] In some embodiments, the display device displays an application entry of an image processing application. In response to a trigger operation on the application entry, a first graphic code is displayed. The first graphic code is used to transmit an image to the display device by scanning the code. The display device receives a first original image transmitted to the display device by scanning the first graphic code. Herein, it may be a mobile device that scans the first graphic code, and one first original image or multiple different first original images may be transmitted to the display device. Multiple means at least two.

[0079] In some embodiments, the display device may display a first candidate image, and the first candidate image is the first original image. Alternatively, the controller in the display device may decode the first original image to obtain a bitmap corresponding to the first original image, and the first candidate image may be the bitmap corresponding to the first original image. Herein, the controller in the display device may decode the first original image according to a preset resolution threshold to obtain a bitmap corresponding to the first original image. The resolution of the bitmap corresponding to the first original image is less than or equal to the resolution threshold, and the resolution threshold is the screen resolution of the display device or the resolution of the UI (User Interface) displayed on the screen. The resolution threshold may be, but is not limited to, 3840x2160 and 1920X1080. For example, for a 4K TV, the resolution threshold may be 3840x2160, and for a 2K TV, the resolution threshold may be 1920X1080. The controller may use a third-party open-source library Glide to implement the decoding of the image.

[0080] In some embodiments, when the controller in the display device responds to selecting any one of the first candidate images displayed, it enters an enlarged image service, displays an enlarged image interface, and displays the selected first candidate image in the enlarged image interface after performing proportional scaling according to the size of the enlarged image interface. Herein, the first image is an image obtained by performing proportional scaling on the selected first candidate image.

[0081] In some embodiments, the enlarged image interface and the image viewing interface may be the same interface or two different interfaces, and the sizes of the enlarged image interface and the image viewing interface are the same. When the controller in the display device responds to selecting any one of the first candidate images, it controls the display to display the image viewing interface, and displays the first image obtained by performing proportional scaling on the selected first candidate image in the image viewing interface. When the first image is displayed in the image viewing interface, the controller responds to a menu display operation, displays a menu panel, and displays an enlarged image entry in the menu panel. In response to a trigger operation on the enlarged image entry, it enters the enlarged image service, displays the enlarged image interface, and displays the first image in the enlarged image interface. The menu display operation may be a voice command or an operation generated by a remote controller. The menu panel may be displayed on the upper layer of the image viewing interface, and other entries except the enlarged image entry may also be displayed in the menu panel.

[0082] As Figure 7 shown, the first image is displayed in the image viewing interface, and a menu panel is displayed on the upper layer of the image viewing interface. In the menu panel, "AI Picture Lab" is the name of the image processing application, the "AI Zoom-in" control is the entry for zooming in, the "AI Image to Animation" control is the entry for entering the image-to-animation service, and the image-to-animation service is used to generate animations from images or pictures. The "AI Ultra HD" control is the entry for entering the ultra-high-definition service, and the ultra-high-definition service is used to improve the clarity of images. The "Ongoing Task (0)" control is used to view the tasks being executed. The number 0 represents that the number of tasks being executed is 0, and the tasks can be image-to-animation tasks or zooming-in tasks, etc. The "Manage Pictures (20)" control is used to view the images or pictures being managed, that is, to save the images or pictures uploaded and transmitted to the display device. The number 20 represents that there are 20 pictures.

[0083] Step 604, in response to an adjustment operation on the first image, display the first adjusted image in the zoom-in interface, where the adjustment operation includes at least one of a position adjustment operation or a magnification operation.

[0084] Among them, the adjustment operation can also include a reduction operation, etc. The position adjustment operation is used to adjust the position of the first image in the zoom-in interface. The position adjustment operation can be a voice command or an operation generated by a remote control. Through the position adjustment operation, the first image can be moved in the zoom-in interface. The magnification operation is an operation to magnify and display the first image. The adjustment operation can be a series of operations on the first image and at least includes one position adjustment operation or one magnification operation. The first adjusted image is the image of the first image after the adjustment operation. There are various positional relationships between the first adjusted image and the zoom-in interface. For example, the first adjusted image can be completely displayed in the zoom-in interface, or a partial area of the first adjusted image is located outside the zoom-in interface. As Figure 8 shown, a diagram of the positional relationship between the first adjusted image and the zoom-in interface is displayed, Figure 8 which includes 9 diagrams from (a) to (i). Among them, the blank rectangular frame represents the zoom-in interface, and the rectangular frame filled with diagonal lines represents the picture, that is, the first adjusted image. In (a), (e), and (f), the first adjusted image is completely displayed in the zoom-in interface; in (b) to (d) and (g) to (i), a partial area of the first adjusted image is located outside the zoom-in interface, and the dark part in the first adjusted image represents the part retained in the zoom-in interface.

[0085] In some embodiments, when the zoom-in interface is displayed, the controller can also control the display to show operation prompt information. The operation prompt information is used to prompt how to operate the image in the zoom-in interface and how to start zooming in.

[0086] In some embodiments, the image in the enlarged image interface can be operated through a remote control. After clicking the enlarged image entry, the enlarged image interface is displayed, and a first image is displayed in the enlarged image interface, and operation prompt information is displayed. The operation prompt information is "Press the confirmation key to start AI image enlargement, press the left and right keys to adjust the size, and press the menu key to switch to position adjustment". When the menu key is pressed and switched, the operation prompt information becomes: Press the confirmation key to start AI image enlargement, press the arrow keys to adjust the position, and press the menu key to switch to size adjustment. The remaining number of image enlargement times for the current day can also be displayed in the operation prompt information. For example, after clicking the enlarged image entry, it can be displayed Figure 9 the enlarged image interface and the operation prompt information S1 in it. The image displayed in the enlarged image interface is the first image. When the menu key is pressed and switched, it switches from displaying the operation prompt information S1 to displaying the operation prompt information S2. Among them, "You can still experience 5 times today" means that the remaining number of image enlargement times is 5.

[0087] In some embodiments, in response to a reduction operation on the first image, when the distance from any side of the first image to the corresponding side of the enlarged image interface exceeds a distance threshold, the controller can control the display to display attention information such as "To ensure the generation effect, please leave enough original image content within the screen". The distance threshold can be set as needed, or the distance threshold can be determined by the image enlargement ability of the large model, which can be the maximum pixel distance supported by the large model at most. The unit of the distance threshold is pixel. Among them, when reducing or enlarging the first image, the center point of the screen can be used as a reference.

[0088] In some embodiments, the position adjustment operation is a direction key pressing operation. In response to a moving operation on the first image, before moving the first image, the controller calculates the position after moving, and calculates the distances from the four sides of the first image to the corresponding sides of the enlarged image interface if the first image is in the position after moving. If any of the distances exceeds the distance threshold, the controller refuses to respond to the direction key pressing operation, keeps the position of the first image unchanged, and displays a prompt information indicating that the movement cannot continue. For example, if the distance threshold is 1024 pixels, the prompt information indicating that the movement cannot continue can be: "The blank area between the picture edge and the screen edge exceeds 1024 pixels, and the movement cannot continue". Among them, both the first image and the enlarged image interface are rectangles. "The distances from the four sides of the first image to the corresponding sides of the enlarged image interface" includes: the distance from the left edge of the first image to the left edge of the enlarged image interface, the distance from the right edge of the first image to the right edge of the enlarged image interface, the distance from the upper edge of the first image to the upper edge of the enlarged image interface, and the distance from the lower edge of the first image to the lower edge of the enlarged image interface. Different distances in different directions can have different distance thresholds.

[0089] In some embodiments, a 3x1 matrix can be used to represent a point. The 3x1 matrix is, for example, x and y respectively represent the coordinates on the x-axis and y-axis, while 1 represents the default coordinate of the screen on the z-axis. If 1 is increased, the screen will move further away and the graphics will become smaller. In the display device, the controller can use a 3x3 matrix to implement the adjustment, i.e., transformation, of the first image. The 3x3 matrix matrix is, for example: Among them, MSCALE_X and MSCALE_Y mainly control scaling and rotation, MSKEW_X and MSKEW_Y mainly control shear transformation, MTRANS_X and MTRANS_Y mainly control translation transformation, and MPERSP_0, MPERSP_1, and MPERSP_2 are usually 0, 0, and 1 respectively, for keeping the z coordinate of the two-dimensional plane unchanged.

[0090] In some embodiments, the deformation processing of the image usually includes four basic transformations: translation transformation (Translate), rotation transformation (Rotate), scaling transformation (Scale), and shear transformation (Skew). The API provided by the Android system can be used to simplify the matrix operation, without having to set each element of the matrix every time. For example, the rotation transformation can be implemented using the interface matrix.setRotate(), the translation transformation can be implemented using the interface matrix.setTranslate(), the scaling transformation can be implemented using the interface matrix.setScale(), the shear transformation can be implemented using the interface matrix.setSkew(), and the pre-multiplication and post-multiplication operations of the matrix can be implemented using matrix.preX and matrix.postY.

[0091] Step 606: In response to the zoom-in instruction, when a partial area in the first adjusted image is adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in conditions, determine the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, and crop the part located in the zoom-in interface from the first adjusted image to obtain the first image to be zoomed in.

[0092] Among them, the zoom-in instruction can be, for example, an instruction triggered by pressing the confirmation key on the remote control. The zoom-in conditions include at least one of the following: the first adjusted image does not completely occupy the zoom-in interface, the style of the image is the set image style, and the distances from the four sides to the edges of the zoom-in interface do not exceed the distance threshold. The first image to be zoomed in is the part of the first adjusted image that remains in the zoom-in interface. For example, Figure 8 in (b) to (d) and (g) to (i) of, since a partial area of the first adjusted image is outside the zoom-in interface, the dark part of the first adjusted image is intercepted to obtain the first image to be zoomed in.

[0093] The enlarged image interface, the first adjusted image, and the first image to be enlarged are all rectangular. The left and right edges of the enlarged image interface are parallel to the left and right edges of the first adjusted image and the first image to be enlarged, and the upper and lower edges of the enlarged image interface are parallel to the upper and lower edges of the first adjusted image and the first image to be enlarged. The enlargement parameters include the left enlargement distance, the right enlargement distance, the upper enlargement distance, and the lower enlargement distance. The left enlargement distance is the distance between the left edge of the first image to be enlarged and the left edge of the enlarged image interface. The right enlargement distance is the distance between the right edge of the first image to be enlarged and the right edge of the enlarged image interface. The upper enlargement distance is the distance between the upper edge of the first image to be enlarged and the upper edge of the enlarged image interface. The lower enlargement distance is the distance between the lower edge of the first image to be enlarged and the lower edge of the enlarged image interface. The left enlargement distance represents the width of the image area to be enlarged on the left side of the first image to be enlarged. The right enlargement distance represents the width of the image area to be enlarged on the right side of the first image to be enlarged. The upper enlargement distance represents the width of the image area to be enlarged on the upper side of the first image to be enlarged. The lower enlargement distance represents the width of the image area to be enlarged on the lower side of the first image to be enlarged.

[0094] The enlargement parameters may further include the coordinates of at least two vertices of the four vertices of the first image to be enlarged in the target coordinate system. For example, it may include the coordinates of the upper left and lower right vertices in the target coordinate system respectively. The target coordinate system is a plane coordinate system constructed with the vertices of the enlarged image interface as the origin, and the positive direction of the X-axis of the target coordinate system is the direction from the origin to one vertex of the enlarged image interface, and the positive direction of the Y-axis is the direction from the origin to the other vertex of the enlarged image interface.

[0095] In some embodiments, as Figure 10 shown, the controller may establish a target coordinate system with the upper left corner of the enlarged image interface as the origin, and the positive direction of the X-axis of the target coordinate system is the direction from the origin to the upper right corner of the enlarged image interface, and the positive direction of the Y-axis of the target coordinate system is the direction from the origin to the lower left corner of the enlarged image interface. Figure 10 In, the changed picture represents the first adjusted image. The controller can obtain the X coordinate of the left edge of the first adjusted image in the target coordinate system (denoted as left or the left edge coordinate), the X coordinate of the right edge in the target coordinate system (denoted as right or the right edge coordinate), the Y coordinate of the upper edge in the target coordinate system (denoted as top or the upper edge coordinate), and the Y coordinate of the lower edge in the target coordinate system (denoted as bottom or the lower edge coordinate). Among them, W is the width of the enlarged image interface in the X-axis direction, and H is the height of the enlarged image interface in the Y-axis direction.

[0096] As Figure 11As shown, the dashed box represents the enlarged view interface, and the rectangular area filled with grids represents the picture, i.e., the first adjusted image. The upper left corner of the enlarged view interface is the origin (0, 0). The width of the enlarged view interface in the X-axis direction is 320, and the height in the Y-axis direction is 480. The upper left corner coordinates of the first adjusted image are (A, B), the upper right corner coordinates are (C, B), the lower left corner coordinates are (A, D), and the lower right corner coordinates are (C, D), where A = 150, B = 75, C = 260, D = 120, with the unit being pixels. Thus, left = 150, top = 75, right = 260, and bottom = 120.

[0097] In some embodiments, when only the first adjusted image is displayed in the enlarged view interface upon triggering the enlargement instruction, the controller can determine the left enlargement distance leftMargin, the right enlargement distance rightMargin, the upper enlargement distance topMargin, and the lower enlargement distance bottomMargin based on left, top, right, and bottom. Among them, if left is a non-negative number, then leftMargin = left; otherwise, leftMargin = 0. If right is less than W, then rightMargin = W - right; otherwise, rightMargin = 0. If top is a non-negative number, then topMargin = top; otherwise, topMargin = 0. If bottom is less than H, then bottomMargin = H - bottom; otherwise, bottomMargin = 0.

[0098] In some embodiments, the controller can determine whether there are partial areas of the first adjusted image outside the enlarged view interface based on left, top, right, and bottom, that is, whether there are partial areas hidden. For example, if left is a negative number, it indicates that there are partial areas on the left side of the first adjusted image outside the enlarged view interface. The same applies to right, top, and bottom, which will not be elaborated here. When left, right, top, and bottom are all non-negative numbers, it can be determined that the first adjusted image is fully displayed in the enlarged view interface.

[0099] In some embodiments, the controller can crop the area of the first adjusted image located in the enlarged view interface from the first adjusted image to obtain the first image to be enlarged. For example, if left is a non-negative number, it means that the left side of the first adjusted image is within the enlarged view interface and does not need to be cropped. If left is a negative number, it means that there are partial areas on the left side of the first adjusted image outside the enlarged view interface, so the left side needs to be cropped. The same applies to top, right, and bottom, which will not be elaborated here.

[0100] Specifically, the controller can determine, from the plane coordinate system where the first adjusted image is located, the starting cropping coordinate x in the X-axis direction, the cropping width w in the X-axis direction, the starting cropping coordinate y in the Y-axis direction, and the cropping width h in the Y-axis direction according to the reference left margin, reference right margin, reference upper margin, and reference lower margin. In the plane coordinate system where the first adjusted image is located, the origin is at the upper left corner of the first adjusted image, the positive direction of the X-axis is the direction from the upper left corner of the first adjusted image to the upper right corner of the first adjusted image, and the positive direction of the Y-axis is the direction from the upper left corner of the first adjusted image to the lower left corner of the first adjusted image.

[0101] Wherein, if left is negative, then x = ABS(left); otherwise, the left cropping coordinate x = 0, where ABS() is a function for calculating the absolute value; if right is less than W and left is negative, then w = right; if right is less than W and left is non-negative, then w = right - left; if right is greater than or equal to W and left is negative, then w = W; if right is greater than or equal to W and left is non-negative, then w = W - left; if top is negative, then y = ABS(top); otherwise, y = 0; if bottom is less than H and top is negative, then h = bottom; if bottom is less than H and top is non-negative, then h = bottom - top; if bottom is greater than or equal to H and top is negative, then h = H; if bottom is greater than or equal to and top is non-negative, then h = H - top. Thus, the controller can crop the image region between the straight line X = x, the straight line X = x + w, the straight line Y = y, and the straight line Y = y + h in the first adjusted image in the plane coordinate system where the first adjusted image is located to obtain the first image to be enlarged.

[0102] In some embodiments, if left, top, right, and bottom are all non-negative, it is determined that the first adjusted image is completely displayed in the enlargement interface. In this case, the controller can determine the enlargement parameters based on the position of the first adjusted image in the enlargement interface. For example, left is used as the left enlargement distance, top is used as the upper enlargement distance, W - right is used as the right enlargement distance, and H - bottom is used as the lower enlargement distance to obtain the enlargement parameters, and trigger the enlargement process of the first adjusted image based on the enlargement parameters to obtain the enlarged image. Among them, the enlargement parameters can also include the position of the first adjusted image in the target coordinate system, and the position of the first adjusted image in the target coordinate system can be represented by the coordinates of at least two vertices of the first adjusted image in the target coordinate system.

[0103] In some embodiments, when the first adjusted image occupies the entire enlarged image interface, the controller, in response to the enlargement instruction, displays a prompt message indicating that enlargement is not possible. For example, if the size of the enlarged image interface is the same as the screen size, the prompt message indicating that enlargement is not possible can be, for example, "The picture has covered the screen and cannot be enlarged."

[0104] In some embodiments, when the style of the first adjusted image is inconsistent with the set image style, the controller, in response to the enlargement instruction, displays a prompt message indicating that the style is not supported. For example, if the set image style is landscape, the prompt message indicating that the style is not supported can be "Currently, enlargement of landscape pictures is supported. Please change the picture to experience the enlargement function."

[0105] In some embodiments, if the remaining number of enlargement times for the day reaches 0, the controller, in response to the enlargement instruction, displays a prompt message indicating that there is no permission to enlarge, such as "The remaining number of times today is 0. Please come back tomorrow to experience it."

[0106] In some embodiments, when the controller responds to the enlargement instruction, if a part of the first adjusted image is adjusted outside the enlarged image interface, the first adjusted image meets the enlargement conditions, and the remaining number of enlargement times for the day is greater than 0, the controller crops the part located in the enlarged image interface from the first adjusted image to obtain a first image to be enlarged, and determines the enlargement parameters based on the position of the first image to be enlarged in the enlarged image interface.

[0107] Step 608: Trigger the enlargement process of the first image to be enlarged based on the enlargement parameters to obtain an enlarged image, and display the enlarged image, where the aspect ratio of the enlarged image is the same as the aspect ratio of the enlarged image interface.

[0108] Among them, the size of the enlarged image can be the same as the size of the enlarged image interface, and the size can be represented by resolution. For example, the size of the enlarged image and the enlarged image interface can both be 1920×1080.

[0109] In some embodiments, the controller may generate an image enlargement request and send the image enlargement request to the server. The image enlargement request carries the first image to be enlarged and enlargement parameters. In response to the image enlargement request, the server performs image enlargement processing on the first image to be enlarged based on the enlargement parameters, generates an enlarged image, and returns the enlarged image to the display device. The display device receives the enlarged image and displays the enlarged image. Among them, the server can use AI image enlargement technology to implement the image enlargement processing. AI image enlargement technology mainly relies on the development of deep learning and generative adversarial networks (GANs). AI image enlargement technology intelligently identifies images through artificial intelligence algorithms, predicts and generates the missing parts of the images according to the context and texture of the images, so as to expand the frame and perspective of the images. AI image enlargement tools can help users complete the background and expand the photo into a larger image. The working principle of AI image enlargement tools lies in using technologies such as deep learning and computer vision to understand and analyze the internal features of images, and then fill, extend or innovate the design of the image content. With the progress of technology, AI image enlargement technology can be combined with more advanced technologies to form a more intelligent creation tool.

[0110] In some embodiments, when a pressing operation of the confirmation key of the remote controller is detected, the controller controls the display to display an image enlargement waiting interface, as Figure 12 shown, a schematic diagram of an image enlargement waiting interface is provided. The remaining waiting duration can be displayed in the image enlargement waiting interface, such as "Estimated time: 5 seconds" in the figure. The remaining number of image enlargement times can also be displayed, such as "You can still experience 5 times today" in the figure. A cancel control can also be displayed in the image enlargement waiting interface, such as the control of "Cancel Generation" in the figure. When the "Cancel Generation" control is clicked, the image enlargement stops and the image enlargement waiting interface is closed. A "Background Generation" control can also be displayed in the image enlargement waiting interface. When the "Background Generation" control is clicked, the image enlargement waiting interface is closed, and after the enlarged image is obtained, it is prompted that the enlarged image has been generated.

[0111] In some embodiments, after the enlarged image is obtained, the controller in the display device closes the image enlargement waiting interface, controls the display to display an image enlargement result interface, and displays the enlarged image in the image enlargement result interface. The size of the image enlargement result interface is the same as the size of the image enlargement interface, for example, both are the screen size. As Figure 13 shown, a schematic diagram of the image enlargement result interface is shown, and the enlarged image is displayed in the image enlargement result interface. The enlarged image is fully displayed in it. Interaction controls can also be displayed in the image enlargement result interface. The interaction controls can be at least one of the "Compare and View" control, "AI Ultra HD" control, "Save Picture" control, "Share to Mobile Phone" control, etc. in the figure.

[0112] In the present embodiment, in response to the expansion instruction, a partial area in the first adjusted image is adjusted outside the expansion interface, and when the first adjusted image meets the expansion conditions, the expansion parameters are determined based on the position of the first adjusted image in the expansion interface, and the part located in the expansion interface is cropped from the first adjusted image to obtain the first image to be expanded. Therefore, when adjusting the image, the image is allowed to exceed the expansion interface, and the image area retained in the area can be cropped. When expanding the image, the cropped image is expanded. Therefore, for the case where the user does not want to expand the entire image, it helps to save the user the process of manually cropping the image. The operation is convenient, it provides convenience for the user, improves the flexibility of expanding the image, and thus improves the efficiency of expanding the image.

[0113] In some embodiments, Figure 14 As shown, a flowchart of a method for expanding a map in some embodiments is provided, including:

[0114] 1. Get the distance thresholds in the four directions of up, down, left and right.

[0115] 2. Get the resolution threshold.

[0116] 3. Decode the first original image transmitted to the display device based on the resolution threshold to obtain a decoded image.

[0117] 4. Scale the decoded image proportionally to obtain the first image, and display the first image in the center of ImageView, render ImageView to display the first image in the expanded image interface, and obtain the current matrix Matrix1.

[0118] The size of ImageView is consistent with the size of the image expansion interface, for example, the size of ImageView and the image expansion interface are both 1920×1080, in pixels. Matrix1 is used to perform proportional transformation on the bitmap of the first original image. By using Matrix1 to transform the bitmap of the first original image, the bitmap of the first original image can be scaled proportionally according to the size of ImageView to obtain the first image, so that at least one side of the first image fits with ImageView, for example, two horizontal sides fit with ImageView or two vertical sides fit with ImageView, etc.

[0119] 5. When a transformation operation (translation, enlargement or reduction) for the first image is triggered, the matrix Matrix1 is transformed based on the transformation operation to obtain a transformed matrix Matrix2.

[0120] 6. Adjust the first image using the transformed matrix Matrix2, obtain and display the first adjusted image, obtain the margins of the first adjusted image in the up, down, left, and right directions, and determine the enlargement parameters when the margins in the up, down, left, and right directions are all less than the distance thresholds in the corresponding directions and at least one distance is greater than 0.

[0121] 7. Crop the area within the enlargement interface from the first adjusted image to obtain the first image to be enlarged.

[0122] 8. Convert the first image to be enlarged into a first string.

[0123] 9. Submit the enlargement task.

[0124] 10. Wait to display the enlargement result.

[0125] In some embodiments, as Figure 15 shown, a flowchart of the enlargement method in some embodiments is provided, including:

[0126] 1. Decode the first original image transmitted to the display device based on the resolution threshold to obtain the bitmap of the first original image.

[0127] Among them, the resolution threshold can be, but is not limited to, 3840×2160 or 1920×1080, etc.

[0128] 2. Display the bitmap of the first original image on the ImageView in proportion, that is, scale the first original image in proportion according to the size of the ImageView to obtain the first image and display it on the ImageView, and obtain the current matrix Matrix1. The first image can be displayed in the enlargement interface by rendering the ImageView.

[0129] 3. After triggering the zoom in / zoom out / pan transformation for the first image, transform Matrix1 to obtain the transformed matrix Matrix2, and display the first adjusted image after the transformation of the first image.

[0130] 4. Based on the transformed matrix Matrix2 and the bitmap of the first original image, determine the left, right, top, and bottom of the first adjusted image in the 1920×1080 enlargement interface.

[0131] 5. Judge whether left >= 0 holds. If so, enter step 6. If not, enter step 7.

[0132] 6. The left edge of the first adjusted image is within the enlarged image interface, and the left side needs to be enlarged. The enlargement distance is leftMargin = left, and the starting cropping coordinate x in the X-axis direction is 0. Proceed to step 8.

[0133] 7. The left edge of the first adjusted image is outside the enlarged image interface, and the left side does not need to be enlarged. leftMargin = 0, the left side needs to crop the picture, and the starting cropping coordinate x in the X-axis direction is x = ABS(left). Proceed to step 8.

[0134] 8. Determine whether right < 1920 holds. If so, proceed to step 9; if not, proceed to step 10.

[0135] 9. The right edge of the first adjusted image is within the enlarged image interface, and the right side needs to be enlarged. The enlargement distance is rightMargin = 1920 - right. Proceed to step 11.

[0136] 10. The right edge of the first adjusted image is outside the enlarged image interface, and the right side does not need to be enlarged. rightMargin = 0, the right side needs to crop the picture. Proceed to step 12.

[0137] 11. Determine whether left >= 0 holds. If so, proceed to step 13; if not, proceed to step 14.

[0138] 12. Determine whether left >= 0 holds. If so, proceed to step 15; if not, proceed to step 16.

[0139] 13. The cropping width w in the X-axis direction is w = right - left. Proceed to step 17.

[0140] 14. w = right. Proceed to step 17.

[0141] 15. w = 1920 - left. Proceed to step 17.

[0142] 16. w = 1920. Proceed to step 17.

[0143] 17. Determine whether top >= 0 holds. If so, proceed to step 18; if not, proceed to step 19.

[0144] 18. The upper edge of the first adjusted image is within the enlarged image interface, and the upper side needs to be enlarged. The enlargement distance is topMargin = top, and the starting cropping coordinate y in the Y-axis direction is 0. Proceed to step 20.

[0145] 19. The upper edge of the first adjusted image is outside the image expansion interface, and the image does not need to be expanded in the upward direction. TopMargin=0, the starting cropping coordinate y in the Y-axis direction is ABS(top), and the process goes to step 20.

[0146] 20. Determine if bottom<1080. If so, proceed to step 21; if not, proceed to step 22.

[0147] 21. The lower edge of the first adjusted image is within the image expansion interface, and the image needs to be expanded in the downward direction. The expansion distance is bottomMargin=1080-bottom, and the process goes to step 23.

[0148] 22. The lower edge of the first adjusted image is outside the image expansion interface, and the image does not need to be expanded in the lower direction, bottomMargin=0, and the image needs to be cropped in the lower direction, and step 24 is entered.

[0149] 23. Determine whether top>=0 is true. If so, proceed to step 25; if not, proceed to step 26.

[0150] 24. Determine whether top>=0 is true. If so, proceed to step 27; if not, proceed to step 28.

[0151] 25. The cropping width in the Y-axis direction is h = bottom-top, and go to step 29.

[0152] 26. h=bottom, go to step 29.

[0153] 27. h = 1080-top, go to step 29.

[0154] 28. h=1080, go to step 29.

[0155] 29. Summarize the four parameters leftMargin, topMargin, rightMargin, and bottomMargin to get the image expansion parameters.

[0156] 30. Obtain a first adjusted image, and crop the first adjusted image according to x, y, w, and h to obtain a first image to be expanded.

[0157] Among them, the first adjusted image transBmp = creatBitmap(originalBmp, 0, 0, original.width, original.height, Matrix2), where originalBmp represents the bitmap of the first original image, original.width represents the width of the bitmap, original.height represents the height of the bitmap, and the first image to be enlarged dispalyBmp = creatBitmap(transBmp, x, y, w, h).

[0158] 31. Convert the first image to be enlarged into a base64 string to obtain the first string.

[0159] 32. Submit an image enlargement task based on the enlargement parameters and the first string.

[0160] Among them, the image enlargement task can be to send an image enlargement request, and the image enlargement task is used to request image enlargement processing using AI image enlargement technology.

[0161] In this embodiment, a solution for image enlargement using AI image enlargement technology on a display device is implemented, which improves the user experience of the display device. For the pictures uploaded by users, AI image enlargement is performed using the user-defined image enlargement range (i.e., the image enlargement distances in four directions), with convenient operation, rapid image enlargement, and reduced operation steps.

[0162] In some embodiments, the controller is further configured to: when displaying the first adjusted image, in response to an image addition operation, control the display to display the added second image in the image enlargement interface; in response to an adjustment operation on the second image, display the second adjusted image in the image enlargement interface; when the controller determines the enlargement parameters based on the position of the first adjusted image in the image enlargement interface, it is configured to: determine the enlargement parameters based on the positions of the first adjusted image and the adjusted image in the image enlargement interface respectively.

[0163] As Figure 16 shown, the changed picture A is the first adjusted image, and the changed picture B is the second adjusted image. A.left is the same as left above, A.right is the same as right above, A.top is the same as top above, and A.bottom is the same as bottom above. B.left is the X coordinate of the left edge of the second adjusted image in the target coordinate system, B.right is the X coordinate of the right edge of the second adjusted image in the target coordinate system, B.top is the Y coordinate of the upper edge of the second adjusted image in the target coordinate system, and B.bott.m is the Y coordinate of the lower edge of the second adjusted image in the target coordinate system. The image enlargement condition can also include that the first adjusted image and the second adjusted image do not overlap.

[0164] In some embodiments, when the controller responds to a zoom-in instruction, it further determines a second image to be zoomed in based on the second adjusted image. If the second adjusted image is fully displayed in the zoom-in interface, the second image to be zoomed in is the second adjusted image. If the second adjusted image is partially displayed in the zoom-in interface, the second image to be zoomed in is the part of the second adjusted image that is located in the zoom-in interface. The zoom parameters may include the positions of the first image to be zoomed in and the second image to be zoomed in in the target coordinate system respectively.

[0165] In this embodiment, since, when the first adjusted image is being displayed, in response to an image addition operation, the added second image is displayed in the zoom-in interface, it is thus possible to perform zooming on multiple images jointly during zooming, improving the flexibility and efficiency of zooming.

[0166] In some embodiments, when the controller determines the zoom parameters based on the positions of the first adjusted image and the adjusted image in the zoom-in interface respectively, it is configured to: determine a first position parameter based on the position of the first adjusted image in the zoom-in interface, where the first position parameter is used to characterize the position of the first image to be zoomed in in the zoom-in interface; determine a second position parameter based on the position of the second adjusted image in the zoom-in interface, where the second position parameter is used to characterize the position of the second image to be zoomed in in the zoom-in interface, and the second image to be zoomed in is the second adjusted image or the part of the second adjusted image that is located in the zoom-in interface; and determine the zoom parameters according to the first position parameter and the second position parameter.

[0167] The first position parameter includes the X coordinate ALeft of the left edge of the first image to be zoomed in, the X coordinate ARight of the right edge, the Y coordinate ATop of the upper edge, and the Y coordinate ABottom of the lower edge. The second position parameter includes the X coordinate BLeft of the left edge of the second image to be zoomed in, the X coordinate BRight of the right edge, the Y coordinate BTop of the upper edge, and the Y coordinate BBottom of the lower edge.

[0168] In some embodiments, the controller may take the smaller one of ALeft and BLeft as the left-side zooming distance, take the smaller one of W - ARight and W - BRight as the right-side zooming distance, take the smaller one of ATop and BTop as the upper-side zooming distance, and take the smaller one of H - ABottom and H - BBottom as the lower-side zooming distance.

[0169] In this embodiment, since the zoom parameters are determined according to the first position parameter and the second position parameter, the positional relationship between the first image to be zoomed in and the second image to be zoomed in can thus be determined based on the zoom parameters, which helps to keep the positional relationship between the first image to be zoomed in and the second image to be zoomed in unchanged during zooming.

[0170] In some embodiments, when the controller executes to trigger an enlargement process on a first image to be enlarged based on enlargement parameters to obtain an enlarged image, it is configured to: trigger a first enlargement process and a second enlargement process on the first image to be enlarged and a second image to be enlarged based on the enlargement parameters to obtain an enlarged image, where the second image to be enlarged is the second adjusted image or a part of the second adjusted image located in the enlargement interface; wherein, the enlarged image includes the first image to be enlarged and the second image to be enlarged, and the layout of the first image to be enlarged and the second image to be enlarged in the enlarged image is the same as the layout of the first image to be enlarged and the second image to be enlarged in the enlargement interface; the first enlargement process is used to generate the image content in a first area in the enlarged image, the first area is the area in the target rectangular frame other than the first image to be enlarged and the second image to be enlarged, and the target rectangular frame is the smallest rectangle in the enlargement interface that encloses the first image to be enlarged and the second image to be enlarged; the second enlargement process is used to generate the image content in a second area in the enlarged image, and the second area is the area outside the target rectangular frame in the enlarged image.

[0171] In some embodiments, the controller may send an enlargement request to the server, and the enlargement request carries the enlargement parameters, the first image to be enlarged, and the second image to be enlarged. The first image to be enlarged and the second image to be enlarged may be directly carried in the enlargement request, or the controller may convert the first image to be enlarged into a first string and convert the second image to be enlarged into a second string, and the first string and the second string may be carried in the enlargement request. Among them, the string may be a base64 string.

[0172] For example, the enlargement request carries: the first string A_base64, the upper left coordinate (ALeft, ATop) of the first image to be enlarged, the lower right coordinate (ARight, ABottom) of the first image to be enlarged, the second string B_base64, the upper left coordinate (BLeft, BTop) of the second image to be enlarged, the lower right coordinate (BRight, BBottom) of the second image to be enlarged, the left enlargement distance, i.e., min(ALeft, BLeft), the upper enlargement distance, i.e., min(ATop, BTop), the right enlargement distance, i.e., W - max(Aright, Bright), and the lower enlargement distance, i.e., H - max(ABottom, BBottom).

[0173] Of course, the controller may perform a first enlargement process and a second enlargement process on the first image to be enlarged and the second image to be enlarged based on the enlargement parameters locally to obtain an enlarged image.

[0174] In this embodiment, through the first enlargement process and the second enlargement process, a solution for enlarging an image using two images is realized, which improves the flexibility of enlargement.

[0175] In some embodiments, when the controller executes in response to an image addition operation to control the display to display the added second image in the enlarged image interface, it is configured to: control the display to display an image addition control; in response to an image addition operation triggered by the image addition control, determine the added second image, and control the display to display the second image in the enlarged image interface.

[0176] In some embodiments, the controller controls the display to display a second graphic code in response to a triggering operation on the image addition control. The second graphic code is used to transmit an image to the display device by scanning the code, and the second graphic code may be the same as or different from the first graphic code. The display device receives the second original image transmitted to the display device by scanning the second graphic code, and may control the display to display the second image, where the second image is the second original image, or the controller may decode the second original image to obtain a bitmap corresponding to the second original image, and the second image is the bitmap corresponding to the second original image.

[0177] In some embodiments, the controller controls the display to display a first candidate image in response to a triggering operation on the image addition control. Among the displayed first candidate images, there may or may not be a first candidate image corresponding to the first image. The controller controls the display to add and display the selected first candidate image in the enlarged image interface in response to selecting any first candidate image among the displayed first candidate images, and proportionally scales the selected first candidate image according to the size of the enlarged image interface to obtain a second image. The first image and the second image are the same image or different images.

[0178] In this embodiment, since the image addition control is displayed when the first adjusted image is displayed, new images can be conveniently and quickly added to the enlarged image interface, improving the efficiency of adding images.

[0179] In some embodiments, when the controller executes to control the display to display the enlarged image interface and display the first image in the enlarged image interface, it is configured to: control the display to display a first graphic code, where the first graphic code is used to transmit an image to the display device by scanning the code; receive the first original image transmitted to the display device by scanning the first graphic code; decode the first original image according to a preset resolution threshold to obtain a decoded image, where the resolution of the decoded image is less than or equal to the resolution threshold; proportionally scale the decoded image according to the size of the enlarged image interface to obtain the first image; control the display to display the enlarged image interface and display the first image in the enlarged image interface.

[0180] Among them, the controller can decode the first original image according to a preset resolution threshold to obtain a decoded image, and the decoded image can be a bitmap corresponding to the first original image. If the resolution of the first original image is less than or equal to the resolution threshold, the resolution of the decoded image is the same as that of the first original image; if the resolution of the first original image is greater than the resolution threshold, the resolution of the decoded image is obtained by reducing the resolution of the first original image. For example, if the resolution of the first original image is 4000x2000 (4000 represents the width and 2000 represents the height) and the resolution threshold is 3840x2160, it can be reduced according to the maximum side ratio, and the reduction coefficient is 3840 / 4000. Then, the width of the decoded image is (3840 / 4000) x 4000, and the height is (3840 / 4000) x 2000.

[0181] The size of the zoom-in interface can be represented by resolution. For example, it can be 1920×1080. If the size of the decoded image is 2000×1000, since 1920 / 2000 is less than 1080 / 1000, 1920 / 2000 is used as the scaling coefficient for equal-proportion scaling to scale the decrypted image. Thus, the width of the decrypted image is (1920 / 2000)×2000, and the height of the decrypted image is (1920 / 2000)×1000.

[0182] In some embodiments, multiple different first original images can be transmitted to the display device by scanning a code. "Multiple" means at least two. For each first original image, the controller in the display device decodes the first original image according to a preset resolution threshold to obtain a decoded image, and the decoded image is called the first candidate image. The controller can control the display to display the first candidate image. In response to selecting any first candidate image, the selected first candidate image is scaled proportionally and then displayed in the zoom-in interface, where the first image is the image obtained by scaling the selected first candidate image proportionally.

[0183] In this embodiment, transmitting images to the display device by scanning a code improves the efficiency of obtaining images. Since the resolution of the images transmitted to the display device can be arbitrary, in order to match the display, the images can be decoded and scaled before display, which improves the image display effect.

[0184] In some embodiments, when there are no other images in the zoom-in interface except the first adjusted image when the zoom-in instruction is triggered, when the controller executes to determine the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, it is configured to: based on the position of the first adjusted image in the zoom-in interface, determine the first edge distance, where the first edge distance represents the distance between the edge of the first image to be zoomed in and the edge of the zoom-in interface; determine the zoom-in parameters based on the first edge distance.

[0185] Among them, the first edge distance includes the distance between the left edge of the first image to be enlarged and the left edge of the enlargement interface (consistent with the left enlargement distance leftMargin mentioned above), the distance between the right edge of the first image to be enlarged and the right edge of the enlargement interface (consistent with the right enlargement distance rightMargin mentioned above), the distance between the upper edge of the first image to be enlarged and the upper edge of the enlargement interface (consistent with the upper enlargement distance topMargin mentioned above), and the distance between the lower edge of the first image to be enlarged and the lower edge of the enlargement interface (consistent with the lower enlargement distance bottomMargin mentioned above). The controller can use the first edge distance as the enlargement parameter, or can use the first edge distance and the size of the first image to be enlarged as the enlargement parameter.

[0186] In this embodiment, the enlargement parameter is determined according to the distance between the edge of the first image to be enlarged and the edge of the enlargement interface, so that the aspect ratio of the enlarged image generated according to the enlargement parameter is consistent with the aspect ratio of the enlargement interface.

[0187] In some embodiments, when the controller executes to trigger the enlargement process of the first image to be enlarged based on the enlargement parameter to obtain the enlarged image, it is configured to: perform string encoding on the first image to be enlarged to obtain a first string; generate an enlargement request based on the first string and the enlargement parameter, where the enlargement request carries the first string and the enlargement parameter; send the enlargement request to the server and receive the enlarged image returned by the server, where the enlarged image is an image generated by the server based on the enlargement parameter and the first string for enlargement processing.

[0188] Among them, if there is a first adjusted image and a second adjusted image in the enlargement interface when the enlargement instruction is triggered, the enlargement request further includes a second string, and the enlarged image is an image generated by the server through the first enlargement process and the second enlargement process.

[0189] In this embodiment, generating the enlarged image by the server can relieve the computing resources on the display device side and reduce the burden on the display device.

[0190] In some embodiments, the controller is further configured to: when the first adjusted image is entirely located in the enlargement interface and the first adjusted image meets the enlargement condition, determine the enlargement parameter according to the second edge distance between the edge of the first adjusted image and the edge of the enlargement interface; trigger the enlargement process of the first adjusted image based on the enlargement parameter to obtain the enlarged image.

[0191] Among them, the second edge distance includes the left edge distance, the right edge distance, the upper edge distance, and the lower edge distance. The left edge distance is the distance between the left edge of the first adjusted image and the left edge of the zoom-in interface; the right edge distance is the distance between the right edge of the first adjusted image and the right edge of the zoom-in interface; the upper edge distance is the distance between the upper edge of the first adjusted image and the upper edge of the zoom-in interface; the lower edge distance is the distance between the lower edge of the first adjusted image and the lower edge of the zoom-in interface.

[0192] In some embodiments, if there is no image other than the first adjusted image in the zoom-in interface when the zoom-in instruction is triggered, the controller may use the left edge distance as the left zoom-in distance, the right edge distance as the right zoom-in distance, the upper edge distance as the upper zoom-in distance, and the lower edge distance as the lower zoom-in distance, and use the left zoom-in distance, the right zoom-in distance, the upper zoom-in distance, and the lower zoom-in distance as the zoom-in parameters. The zoom-in parameters may also include the size of the first adjusted image.

[0193] In this embodiment, since the first adjusted image is entirely located within the zoom-in interface, it indicates that there are gaps between the four sides of the first adjusted image and the zoom-in interface. Therefore, the four sides of the first adjusted image can all be zoomed in. Thus, determining the zoom-in parameters based on the second edge distance between the edge of the first adjusted image and the edge of the zoom-in interface can fill the gaps with image content during zooming to obtain the zoomed-in image.

[0194] In some embodiments, as Figure 17 shown, a timing diagram corresponding to a zoom-in method is provided, including:

[0195] 1. The display shows the zoom-in interface and displays the first image in the zoom-in interface.

[0196] 2. The controller responds to the adjustment operation on the first image and displays the first adjusted image in the zoom-in interface.

[0197] 3. The controller receives the zoom-in instruction;

[0198] 4. When a part of the first adjusted image is adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in conditions in response to the zoom-in instruction, the controller determines the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, crops the part located in the zoom-in interface from the first adjusted image to obtain the first image to be zoomed in, and sends a zoom-in request to the server. The zoom-in request carries the zoom-in parameters and the first image to be zoomed in.

[0199] 5. The server responds to the zoom-in request, performs zoom-in processing on the first image to be zoomed in based on the zoom-in parameters to obtain the zoomed-in image, and returns the zoomed-in image.

[0200] 6. When the controller responds to the zoom-in instruction, and when the entire first adjusted image is located within the zoom-in interface and the first adjusted image meets the zoom-in condition, it determines the zoom-in parameters based on the distance between the edge of the first adjusted image and the edge of the zoom-in interface, sends a zoom-in request to the server, and the zoom-in request carries the zoom-in parameters and the first adjusted image.

[0201] 7. When the server responds to the zoom-in request, it performs zoom-in processing on the first adjusted image based on the zoom-in parameters to obtain the zoomed-in image, and returns the zoomed-in image.

[0202] 8. The controller controls the display to display the zoomed-in image.

[0203] It should be understood that although the steps in the flowcharts involved in the above embodiments are sequentially displayed according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least some of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least some of the steps or stages in other steps or other steps.

[0204] Based on the same inventive concept, the embodiments of the present application also provide a zoom-in device for implementing the above-mentioned zoom-in method. The solution provided by this device to solve the problem is similar to the solution described in the above method. For specific limitations, reference can be made to the limitations on the zoom-in method in the above text, and details will not be repeated here.

[0205] In some embodiments, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the steps of the above-mentioned zoom-in method.

[0206] In some embodiments, the present application also provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned zoom-in method.

[0207] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, a database, or other media used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include Read-Only Memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, Resistive Random Access Memory (ReRAM), Magnetoresistive Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene memory, etc. Volatile memory can include Random Access Memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, Artificial Intelligence (AI) processors, etc., without limitation.

[0208] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in the present application.

[0209] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation to the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A display device, characterized in that, Including: A display and a controller; The controller is configured to: When entering the zoom-in service, control the display to display a zoom-in interface and display a first image in the zoom-in interface; In response to an adjustment operation on the first image, display a first adjusted image in the zoom-in interface, where the adjustment operation includes at least one of a position adjustment operation or a zoom-in operation; In response to a zoom-in instruction, when a partial area in the first adjusted image is adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in condition, determine zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, and crop the part located in the zoom-in interface from the first adjusted image to obtain a first image to be zoomed in; Trigger a zoom-in process on the first image to be zoomed in based on the zoom-in parameters to obtain a zoomed-in image, and control the display to display the zoomed-in image, where the aspect ratio of the zoomed-in image is the same as the aspect ratio of the zoom-in interface.

2. The display device according to claim 1, wherein, The controller is further configured to: When displaying the first adjusted image, in response to an image addition operation, control the display to display an added second image in the zoom-in interface; In response to an adjustment operation on the second image, display a second adjusted image in the zoom-in interface; When the controller executes determining the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, it is configured to: Determine the zoom-in parameters based on the positions of the first adjusted image and the adjusted image in the zoom-in interface respectively.

3. The display device according to claim 2, wherein When the controller executes determining the zoom-in parameters based on the positions of the first adjusted image and the adjusted image in the zoom-in interface respectively, it is configured to: Determine a first position parameter based on the position of the first adjusted image in the zoom-in interface, where the first position parameter is used to characterize the position of the first image to be zoomed in in the zoom-in interface; Determine a second position parameter based on the position of the second adjusted image in the zoom-in interface, where the second position parameter is used to characterize the position of a second image to be zoomed in in the zoom-in interface, and the second image to be zoomed in is the second adjusted image or the part of the second adjusted image located in the zoom-in interface; Determine the zoom-in parameters according to the first position parameter and the second position parameter.

4. The display device according to claim 2, wherein When the controller executes triggering the zoom-in process on the first image to be zoomed in based on the zoom-in parameters to obtain a zoomed-in image, it is configured to: Trigger a first zoom-in process and a second zoom-in process on the first image to be zoomed in and the second image to be zoomed in based on the zoom-in parameters to obtain a zoomed-in image, where the second image to be zoomed in is the second adjusted image or the part of the second adjusted image located in the zoom-in interface; Among them, the enlarged image contains the first image to be enlarged and the second image to be enlarged, and the layout of the first image to be enlarged and the second image to be enlarged in the enlarged image is the same as their layout in the enlargement interface; The first enlargement process is used to generate the image content in the first area of the enlarged image. The first area is the area in the target rectangular frame except the first image to be enlarged and the second image to be enlarged. The target rectangular frame is the smallest rectangle in the enlargement interface that encloses the first image to be enlarged and the second image to be enlarged; The second enlargement process is used to generate the image content in the second area of the enlarged image. The second area is the area outside the target rectangular frame in the enlarged image.

5. The display device according to claim 2, wherein When the controller executes the response to the image addition operation and controls the display to display the added second image in the enlargement interface, it is configured as follows: Control the display to display an image addition control; In response to the image addition operation triggered by the image addition control, determine the added second image, and control the display to display the second image in the enlargement interface.

6. The display device according to any one of claims 1 to 5, characterized in that, When the controller executes the control to display the enlargement interface and display the first image in the enlargement interface, it is configured as follows: Control the display to display a first graphic code, which is used to transmit an image to the display device by scanning the code; Receive the first original image transmitted to the display device by scanning the first graphic code; Decode the first original image according to a preset resolution threshold to obtain a decoded image, where the resolution of the decoded image is less than or equal to the resolution threshold; Scale the decoded image proportionally according to the size of the enlargement interface to obtain the first image; Control the display to display the enlargement interface and display the first image in the enlargement interface.

7. The display device according to claim 1, characterized in that When there is no other image outside the first adjusted image in the enlargement interface when the enlargement instruction is triggered, when the controller executes the determination of the enlargement parameters based on the position of the first adjusted image in the enlargement interface, it is configured as follows: Based on the position of the first adjusted image in the enlargement interface, determine a first edge distance, where the first edge distance represents the distance between the edge of the first image to be enlarged and the edge of the enlargement interface; Determine the enlargement parameters based on the first edge distance.

8. The display device according to any one of claims 1 to 5 or 7, characterized in that, When the controller executes the trigger of the enlargement process for the first image to be enlarged based on the enlargement parameters to obtain the enlarged image, it is configured as follows: Perform string encoding on the first image to be enlarged to obtain a first string; Generate an enlargement request based on the first string and the enlargement parameters, where the enlargement request carries the first string and the enlargement parameters; Send the enlargement request to the server and receive the enlarged image returned by the server, where the enlarged image is the image generated by the server based on the enlargement parameters and the first string for enlargement processing.

9. The display device according to any one of claims 1 to 5 or 7, characterized in that, The controller is further configured as follows: When the overall first adjusted image is located within the zoom-in interface and the first adjusted image meets the zoom-in condition, determine the zoom-in parameters based on the second edge distance between the edge of the first adjusted image and the edge of the zoom-in interface; Trigger the zoom-in processing of the first adjusted image based on the zoom-in parameters to obtain a zoomed-in image.

10. A method for enlarging a graph, characterized in that, Applied to a display device, the method includes: When entering the zoom-in service, display the zoom-in interface and display a first image in the zoom-in interface; In response to an adjustment operation on the first image, display a first adjusted image in the zoom-in interface, where the adjustment operation includes at least one of a position adjustment operation or a magnification operation; In response to a zoom-in instruction, when a partial area of the first adjusted image is adjusted outside the zoom-in interface and the first adjusted image meets the zoom-in condition, determine the zoom-in parameters based on the position of the first adjusted image in the zoom-in interface, and crop the part located in the zoom-in interface from the first adjusted image to obtain a first image to be zoomed in; Trigger the zoom-in processing of the first image to be zoomed in based on the zoom-in parameters to obtain a zoomed-in image, and display the zoomed-in image, where the aspect ratio of the zoomed-in image is consistent with the aspect ratio of the zoom-in interface.

Images