Display device and display content adjusting method

Abstract

The invention relates to display equipment and a display content adjusting method, and relates to the technical field of display equipment. The display device includes: a display configured to display a display interface of a preview picture; the display interface comprises a first magnified picture of the preview picture and a thumbnail display area; the thumbnail display area comprises a position identification frame, and the position identification frame is used for representing the position of the first amplified picture in the preview picture; the controller is coupled with the display and is configured to control the display position identification frame of the display to move to a target position in response to an interaction operation on the target position in the thumbnail display area, and control the display to present a second magnified picture in the display interface; wherein the position of the second magnified picture in the preview picture is matched with the position of the moved position identification frame in the thumbnail display area. According to the method, the display position corresponding to the amplified picture in the preview picture can be efficiently and quickly moved, and the picture display content adjustment efficiency is effectively improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and particularly to a display device and a display content adjustment method. Background Art

[0002] Currently, display devices such as smart TVs can support zooming in on pictures when displaying pictures.

[0003] In related technologies, it is usually necessary for the user to use the remote control buttons to move the picture to adjust the displayed content of the picture, such as displaying other enlarged areas in the picture, which has the technical problem of low efficiency in adjusting the displayed content of the picture and affects the user's picture preview experience. Summary of the Invention

[0004] The present application provides a display device and a display content adjustment method to solve the technical problem of low efficiency in adjusting the displayed content of the picture.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] A display configured to display a display interface of a preview picture; the display interface includes a first enlarged picture of the preview picture and a thumbnail display area; the thumbnail display area includes a position identification frame for characterizing the position of the first enlarged picture in the preview picture;

[0007] A controller coupled to the display and configured to:

[0008] In response to an interaction operation on a target position in the thumbnail display area, control the display to display the position identification frame moving towards the target position, and control the display to present a second enlarged picture in the display interface;

[0009] Wherein, the position of the second enlarged picture in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

[0010] Technical Effect: By responding to an interaction operation on a target position in the thumbnail display area, controlling the display to display the position identification frame moving towards the target position, and controlling the display to present a second enlarged picture in the display interface, the adjustment and optimization of the displayed content in the preview picture zooming scenario are realized, the display position corresponding to the enlarged picture in the preview picture can be efficiently and quickly moved without the user manually pressing buttons, effectively improving the efficiency of adjusting the displayed content of the picture and helping to improve the picture preview display effect.

[0011] In some embodiments of the present application, the controller is configured to, in response to an interaction operation on a target position in the thumbnail display area, control the display to move the position identification frame to the target position and control the display to present a second enlarged image on the display interface, and is configured as follows:

[0012] In the picture preview and magnification mode, monitor the touch event corresponding to the interaction operation; the touch event includes at least one of a touch display screen event or a remote control pointing at the touch screen event;

[0013] In response to the monitored touch event, control the display to move the position identification frame to the target position and control the display to present a second enlarged image on the display interface.

[0014] Technical effect: By monitoring the touch event corresponding to the interaction operation in the picture preview and magnification mode, and then in response to the monitored touch event, controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged image on the display interface, accurate feedback of user interaction operations can be achieved for the picture preview and magnification mode.

[0015] In some embodiments of the present application, the controller is configured to control the display to move the position identification frame to the target position and control the display to present a second enlarged image on the display interface, and is configured as follows:

[0016] Obtain the touch coordinates of the interaction operation in the thumbnail display area;

[0017] According to the positional relationship between the touch coordinates and the position identification frame, control the display to move the position identification frame to the target position and control the display to present a second enlarged image on the display interface.

[0018] Technical effect: By obtaining the touch coordinates of the interaction operation in the thumbnail display area, and then according to the positional relationship between the touch coordinates and the position identification frame, controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged image on the display interface, it is possible to dynamically adjust the position of the position identification frame based on the positional relationship between the user's touch position and the position identification frame and synchronously display the enlarged image after displacement, which helps to optimize the user operation experience.

[0019] In some embodiments of the present application, the controller is configured to obtain the touch coordinates of the interaction operation in the thumbnail display area, and is configured as follows:

[0020] Determine the thumbnail display parameters; the thumbnail display parameters include the area size parameters of the thumbnail display area;

[0021] Based on the coordinate system established according to the regional dimension parameters, obtain the touch coordinates of the interactive operation in the thumbnail display area.

[0022] Technical effect: By determining the thumbnail display parameters, and then based on the coordinate system established according to the regional dimension parameters, obtaining the touch coordinates of the interactive operation in the thumbnail display area, it is possible to implement a touch screen event based on the thumbnail display waiting for a pointer, so as to accurately obtain the touch coordinates of the target position pointed to.

[0023] In some embodiments of the present application, the thumbnail display parameters further include the position parameters of the position identification frame, and the controller executes determining the thumbnail display parameters, which is configured to:

[0024] According to the magnification factor corresponding to the first enlarged picture, obtain the enlarged picture parameters of the preview picture after magnification;

[0025] Based on the coordinate system established according to the enlarged picture parameters, determine the starting coordinate position of the first enlarged picture in the preview picture;

[0026] According to the screen display parameters of the display, the enlarged picture parameters, and the regional dimension parameters, determine the identification dimension parameters of the position identification frame; the ratio relationship between the screen display parameters and the enlarged picture parameters corresponds to the ratio relationship between the identification dimension parameters and the regional dimension parameters;

[0027] Use the starting coordinate position and the identification dimension parameters as the position parameters of the position identification frame.

[0028] Technical effect: By obtaining the enlarged picture parameters of the preview picture after magnification according to the magnification factor corresponding to the first enlarged picture, then based on the coordinate system established according to the enlarged picture parameters, determining the starting coordinate position of the first enlarged picture in the preview picture, and further according to the screen display parameters of the display, the enlarged picture parameters, and the regional dimension parameters, determining the identification dimension parameters of the position identification frame, and using the starting coordinate position and the identification dimension parameters as the position parameters of the position identification frame, it is possible to accurately obtain the position parameters of the position identification frame based on the change situation of the display position of the enlarged picture in the preview picture.

[0029] In some embodiments of the present application, the controller executes controlling the display to move the position identification frame towards the target position according to the position relationship between the touch coordinates and the position identification frame, and controlling the display to present a second enlarged picture in the display interface, which is configured to:

[0030] Judge whether the touch coordinates are within the display range of the position identification frame;

[0031] When the touch coordinates are not within the display range, control the display to move the position identification frame towards the target position, and control the display to present a second enlarged picture on the display interface.

[0032] Technical effect: By judging whether the touch coordinates are within the display range of the position identification frame, and then when the touch coordinates are not within the display range, controlling the display to move the position identification frame towards the target position, and controlling the display to present a second enlarged picture on the display interface, it is possible to quickly judge whether displacement processing is triggered based on the display range of the position identification frame, which helps to improve the processing efficiency.

[0033] In some embodiments of the present application, the controller is further configured to:

[0034] Determine the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame based on the identification size parameter of the position identification frame in the position parameters of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, so as to obtain the display range.

[0035] Technical effect: By determining the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame based on the identification size parameter of the position identification frame in the position parameters of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, and obtaining the display range, it is possible to accurately obtain the display range of the position identification frame, providing data support for judging whether the touch coordinates are within the display range.

[0036] In some embodiments of the present application, the controller is further configured to:

[0037] If the abscissa in the touch coordinates is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter;

[0038] And the ordinate in the touch coordinates is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter;

[0039] Determine that the touch coordinates are within the display range.

[0040] Technical effect: By determining that the touch coordinates are within the display range if the abscissa in the touch coordinates is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter, and the ordinate in the touch coordinates is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter, it is possible to effectively and quickly judge whether the touch coordinates are within the display range to determine whether to perform position movement processing.

[0041] In some embodiments of the present application, when the touch coordinates are not within the display range, the controller is configured to control the display to move the position identification frame towards the target position and control the display to present a second enlarged picture in the display interface, which is configured as follows:

[0042] Combining the touch coordinates, the left display boundary parameter, the upper display boundary parameter, the right display boundary parameter, and the lower display boundary parameter, calculate the position display deviation data;

[0043] Using the position display deviation data, adjust the display position of the first enlarged picture in the preview picture, and control the display to present the second enlarged picture;

[0044] Using the position display deviation data, control the display to move the position identification frame towards the target position.

[0045] Technical effect: By combining the touch coordinates, the left display boundary parameter, the upper display boundary parameter, the right display boundary parameter, and the lower display boundary parameter, the position display deviation data is calculated. Then, using the position display deviation data, the display position of the first enlarged picture in the preview picture is adjusted, the display is controlled to present the second enlarged picture, and using the position display deviation data, the display is controlled to move the position identification frame towards the target position, which can efficiently and quickly move the display position corresponding to the enlarged picture in the preview picture and present the enlarged picture after displacement.

[0046] In some embodiments of the present application, the controller is configured to combine the touch coordinates, the left display boundary parameter, the upper display boundary parameter, the right display boundary parameter, and the lower display boundary parameter to calculate the position display deviation data, which is configured as follows:

[0047] Obtain the difference between the left display boundary parameter and the abscissa of the touch coordinates, or the difference between the right display boundary parameter and the abscissa, as the abscissa deviation;

[0048] Obtain the difference between the upper display boundary parameter and the ordinate of the touch coordinates, or the difference between the lower display boundary parameter and the ordinate, as the ordinate deviation;

[0049] Take the abscissa deviation and the ordinate deviation as the position display deviation data.

[0050] Technical effect: By obtaining the difference between the left display boundary parameter and the abscissa of the touch coordinate, or the difference between the right display boundary parameter and the abscissa as the abscissa deviation, and obtaining the difference between the upper display boundary parameter and the ordinate of the touch coordinate, or the difference between the lower display boundary parameter and the ordinate as the ordinate deviation, and then using the abscissa deviation and the ordinate deviation as the position display deviation data, the position display deviation data can be accurately calculated, providing data support for further position movement processing.

[0051] In some embodiments of the present application, the controller is configured to execute using the position display deviation data to adjust the display position of the first enlarged picture in the preview picture and control the display to present the second enlarged picture, and is configured as:

[0052] Combining the enlarged picture parameters after the preview picture is enlarged, the position display deviation data, and the area size parameters of the thumbnail display area to determine the first display position adjustment parameter for the first enlarged picture; the ratio relationship between the first display position adjustment parameter and the enlarged picture parameters corresponds to the ratio relationship between the position display deviation data and the area size parameters;

[0053] Adjust the display position of the first enlarged picture in the preview picture according to the first display position adjustment parameter, and control the display to present the second enlarged picture.

[0054] Technical effect: By combining the enlarged picture parameters after the preview picture is enlarged, the position display deviation data, and the area size parameters of the thumbnail display area to determine the first display position adjustment parameter for the first enlarged picture, and then adjusting the display position of the first enlarged picture in the preview picture according to the first display position adjustment parameter and controlling the display to present the second enlarged picture, the offset of the display position of the enlarged picture in the preview picture can be realized, improving the display effect in the preview picture enlargement scenario.

[0055] In some embodiments of the present application, the controller is configured to execute using the position display deviation data to control the display to move the position identification frame to the target position, and is configured as:

[0056] Determine the second display position adjustment parameter of the position identification frame according to the position display deviation data and the starting coordinate position of the first enlarged picture in the preview picture;

[0057] Control the display to move the position identification frame to the target position according to the second display position adjustment parameter.

[0058] Technical effect: By determining the second display position adjustment parameter of the position identification frame based on the position display deviation data and the starting coordinate position of the first enlarged image in the preview image, and then controlling the display of the position identification frame on the display to move to the target position according to the second display position adjustment parameter, the display deviation of the position identification frame can be realized, and the display effect in the enlarged scene of the preview image is improved.

[0059] In a second aspect, some embodiments further provide a display content adjustment method, which is applied to a display device. The display device includes a display and a controller, the controller is coupled to the display, and a display interface of a preview image is displayed on the display. The display interface includes a first enlarged image of the preview image and a thumbnail display area; the thumbnail display area includes a position identification frame, and the position identification frame is used to represent the position of the first enlarged image in the preview image. The method includes:

[0060] In response to an interaction operation on a target position in the thumbnail display area, controlling the display to display the position identification frame to move to the target position, and controlling the display to present a second enlarged image in the display interface;

[0061] Wherein, the position of the second enlarged image in the preview image matches the position of the moved position identification frame in the thumbnail display area.

[0062] Technical effect: By responding to an interaction operation on a target position in the thumbnail display area, controlling the display to display the position identification frame to move to the target position, and controlling the display to present a second enlarged image in the display interface, the adjustment and optimization of the display content in the enlarged scene of the preview image are realized, the display position corresponding to the enlarged image in the preview image can be moved efficiently and quickly without manual key operation by the user, the efficiency of adjusting the display content of the image is effectively improved, and the display effect of the image preview is helped to be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required to be used in the description of the embodiments of the present application or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other related drawings can be obtained based on these drawings without creative efforts.

[0064] Figure 1 It is a schematic diagram of an operation scenario between a display device and a control device provided by some embodiments of the present application;

[0065] Figure 2 It is a schematic diagram of the hardware configuration of a display device provided by some embodiments of the present application;

[0066] Figure 3 Schematic diagram of the hardware configuration of the control device provided for some embodiments of the present application;

[0067] Figure 4 Schematic diagram of the software configuration of the display device provided for some embodiments of the present application;

[0068] Figure 5 Schematic diagram of pointing to the cursor position of the remote control provided for some embodiments of the present application;

[0069] Figure 6 Schematic diagram of pointing to the click operation of the remote control provided for some embodiments of the present application;

[0070] Figure 7 Schematic diagram of pointing to the selection operation of the remote control provided for some embodiments of the present application;

[0071] Figure 8 Schematic diagram of pointing to the multiple - selection operation of the remote control provided for some embodiments of the present application;

[0072] Figure 9 Schematic diagram of pointing to the drag - and - drop operation of the remote control provided for some embodiments of the present application;

[0073] Figure 10 Schematic diagram of pointing to the sliding operation of the remote control provided for some embodiments of the present application;

[0074] Figure 11 Schematic diagram of pointing to the continuous sliding operation of the remote control provided for some embodiments of the present application;

[0075] Figure 12 Schematic diagram of pointing to the reverse sliding operation of the remote control provided for some embodiments of the present application;

[0076] Figure 13 Schematic diagram of the flowchart of the display content adjustment method provided for some embodiments of the present application;

[0077] Figure 14 Schematic diagram of the display interface provided for some embodiments of the present application;

[0078] Figure 15 Schematic diagram of the flowchart of the preview picture displacement process provided for some embodiments of the present application;

[0079] Figure 16 Schematic diagram of the interaction architecture provided for some embodiments of the present application;

[0080] Figure 17 Schematic diagram of the flowchart of the steps for obtaining touch coordinates to control displacement provided for some embodiments of the present application;

[0081] Figure 18 Schematic diagram of the movement of the position identification frame provided in some embodiments of the present application;

[0082] Figure 19 Schematic diagram of the movement of another position identification frame provided in some embodiments of the present application;

[0083] Figure 20 Signaling interaction diagram of the display content adjustment method provided in some embodiments of the present application. Detailed implementation manners

[0084] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0085] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the implementation manners described next, rather than intending to limit the implementation manners of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0086] The terms "first", "second", "third", etc. in the specification, claims and the above drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0087] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0088] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or / and software code that can perform functions related to the element.

[0089] In the embodiments of the present application, the display device 200 generally refers to a device with the capabilities of screen display and data processing. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0090] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided in some embodiments of the present application. As Figure 1As shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. For example, the control device 100 can be a remote control, a stylus, a handle, etc.

[0091] The mobile terminal 300 can be used as a control device to perform human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 for data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and the connection communication can be achieved through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0092] As Figure 1 As also shown, the display device 200 also communicates with the server 400 through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0093] The display device 200 can provide a broadcast reception television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.

[0094] Figure 2 For some embodiments of the present application Figure 1 The hardware configuration block diagram of the display device 200 in

[0095] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0096] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of environmental light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0097] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0098] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function. When the display device 200 supports ultra-wideband connection communication (UWB, Ultra-Wideband), the display device 200 needs to be provided with a communication device 220 including a UWB antenna array.

[0099] The communication device 220 can enable the display device 200 to communicate with an external device or server 400 in a wireless or wired connection manner. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0100] In some embodiments, the controller 250 can include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0101] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, that is, the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0102] In some embodiments, the user can input a user command on the graphical user interface (Graphical User Interface, GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0103] In some embodiments, the audio output device 270 may be the built-in speaker of the display device 200 or an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0104] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0105] Figure 3 For some embodiments provided by this application Figure 1 is the hardware configuration block diagram of the control device. As Figure 3 shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0106] The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing the role of an interaction intermediary between the user and the display device 200.

[0107] In some embodiments, the control device 100 may be an intelligent device. For example: the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0108] In some embodiments, as Figure 1 shown, after the mobile terminal 300 or other intelligent electronic devices install the application for controlling the display device 200, they can play a similar function to the control device 100.

[0109] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions between the external and internal.

[0110] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of other near-field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0111] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.

[0112] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The communication interface 130 configured in the control device 100, such as modules for WiFi, Bluetooth, NFC, UWB, etc., can encode user input instructions through the WiFi protocol, or the Bluetooth protocol, the NFC protocol, or the UWB protocol, and send them to the display device 200. Among them, when the user input instructions are encoded and sent to the display device 200 through the UWB protocol, the control of the pointing function can be realized.

[0113] In some embodiments, the control device 100 further includes a memory 190, which is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0114] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0115] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware resources and software resources in the display device 200. The operating system can (control the display device) provide a user interface, allowing the user to interact with the display device 200 and supporting the running of various application programs.

[0116] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0117] The operating system can be divided into different modules or layers according to the functions implemented. For example, as Figure 4 shown, in some embodiments, the system is divided into four layers, from top to bottom are the application layer (abbreviation "application layer"), the application framework layer (abbreviation "framework layer"), the system library layer, and the kernel layer.

[0118] In some embodiments, the application layer is used to provide services and interfaces for application programs, so that the display device 200 can run application programs and interact with the user based on the application programs. At least one application program can run in the application layer. These application programs can be window programs, system setting programs, or clock programs, etc. that come with the operating system; they can also be application programs developed by third-party developers. In specific implementation, the application program packages in the application layer are not limited to the above examples.

[0119] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of the applications in the application layer. Through the API interface, an application can access the resources in the system and obtain the services of the system during execution.

[0120] As Figure 4 shown, in the embodiments of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of applications. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The Activity Manager is used to interact with all the activities running in the system; the Location Manager is used to provide access to the system location service for system services or applications; the Package Manager is used to retrieve various information related to the application packages currently installed on the device; the Notification Manager is used to control the display and clearing of notification messages; the Window Manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0121] In some embodiments, the Activity Manager is used to manage the life cycles of various applications and the usual navigation back functions, such as controlling the exit, opening, and backward of applications. The Window Manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, shrinking the display window, jittering the display, and distorting the display, etc.

[0122] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime library layer, such as C / C++ instruction libraries, to implement the functions that the framework layer needs to achieve.

[0123] In some embodiments, the kernel layer is a functional level between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4As shown, a hardware driver can be configured in the kernel layer, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0124] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0125] In some embodiments, a display device is provided, and the display device includes: a display configured to display a user interface, the user interface includes at least one control; the user interface also has a cursor, and the position of the cursor on the user interface is determined by the position pointed by the remote control in the three-dimensional space.

[0126] Optionally, the user can start the display device by voice, remote control, or the switch of the TV device. After the display device is started, the user interface corresponding to the home page is displayed through the display. The user can switch to other user interfaces by voice or remote control, such as: the user interface corresponding to the TV drama label, the user interface corresponding to the movie label, the user interface corresponding to a certain page provided by a certain application, etc. The embodiments of the present application do not limit this.

[0127] Optionally, among all the user interfaces displayed by the display, some user interfaces include controls, and some user interfaces may not include controls. The solution provided in the embodiments of the present application is directed to the user interfaces that include controls. The number of controls on the user interfaces that include controls may be only one or may be more than one. The embodiments of the present application do not limit this.

[0128] Optionally, the remote control used in combination with the display device can be a remote control with a pointing function, hereinafter simply referred to as a pointing remote control. When the pointing function is turned on, the user interface displayed on the display also has a cursor, and the position of the cursor on the user interface is determined by the position pointed by the pointing remote control in the three-dimensional space. In the embodiments of the present application, the position pointed by the pointing remote control in the three-dimensional space is also referred to as the position data of the pointing remote control in the three-dimensional space. The specific implementation process of determining the position of the cursor on the user interface based on the position data of the pointing remote control is described below.

[0129] The position data indicating the position of the pointing remote control in the three-dimensional space may include: position coordinates and a pointing direction. Among them, the position coordinates are the physical position of the pointing remote control relative to the display device (for example, the horizontal distance and vertical height from the display device). The pointing direction is the pointing angle of the pointing remote control (for example, the horizontal angle and vertical angle relative to the display device). The pointing remote control is built-in with a gyroscope for detecting the rotation angle of the remote control and an accelerometer for detecting the moving acceleration of the remote control. Through these sensors, the pointing remote control can determine its own position data in the three-dimensional space in real time.

[0130] In some embodiments, after obtaining its own position data in the three-dimensional space, the pointing remote control may send the position data to the display device. The display device may perform screen coordinate conversion based on the position data, so as to convert the position data of the pointing remote control in the three-dimensional space into the screen coordinate system, and obtain the screen coordinates. The screen coordinates may be used as the position of the cursor on the user interface, and a cursor is drawn at this position, so as to display the cursor.

[0131] In some embodiments, the pointing remote control includes a coordinate conversion module. After obtaining its own position data in the three-dimensional space, the pointing remote control may input the position data into the coordinate conversion module. The coordinate conversion module may perform screen coordinate conversion based on the position data, so as to convert the position data into the screen coordinate system, obtain the screen coordinates, use the screen coordinates as the position of the cursor on the user interface, and send the position of the cursor on the user interface to the display device. After receiving the position of the cursor on the user interface, the display device draws a cursor at this position, so as to display the cursor. Exemplarily, the position of the cursor on the user interface is the coordinate (a, b), and the display device draws a cursor at the position with the coordinate (a, b) on the user interface, so as to display the cursor.

[0132] Exemplarily, refer to Figure 5 As shown, when the position data of the pointing remote control in the three-dimensional space is A, the position of the cursor on the user interface is the coordinate (a1, b1); when the position data of the pointing remote control in the three-dimensional space is B, the position of the cursor on the user interface is the coordinate (a2, b2). When the position data of the pointing remote control in the three-dimensional space is C, the screen coordinates calculated by the above method exceed the screen range, and the display device no longer draws the cursor, so the cursor disappears.

[0133] Refer to Figure 6As shown, the pointing remote control supports single-click. When the cursor hovers over a control, the user can press the touch area (confirmation button) on the pointing remote control, and the display device executes corresponding logic in response to this operation. Here, the control can be a card, button, input box, radio button, switch, dialog box, checkbox, slider, playback progress bar, scroll bar, drop-down menu, label, list, etc. The embodiments of the present application do not limit this.

[0134] See Figure 7 As shown, the pointing remote control supports selection. When there are multiple options and their corresponding selection boxes displayed in the user interface, if the user wants to select the first option and the third option, they can first control the cursor to hover over the selection box corresponding to the first option and press the touch area on the pointing remote control. At this time, the first option is selected. Then, the user can control the cursor to hover over the selection box corresponding to the third option and press the touch area on the pointing remote control. At this time, the third option is selected, thus completing the skip selection.

[0135] See Figure 8 As shown, the pointing remote control supports drag-and-select multiple. When there are multiple options and their corresponding selection boxes displayed in the user interface, if the user wants to select all options, they can control the cursor to hover over any position in the upper area of the first option, press the touch area on the pointing remote control and drag down until the cursor moves to the lower area of the last option. At this time, all options are selected, thus completing the drag-and-select multiple.

[0136] See Figure 9 As shown, the pointing remote control supports dragging. When a video is being played in the user interface and a playback progress bar is displayed, the user can control the cursor to hover over a certain position on the playback progress bar, and then press the touch area on the pointing remote control. The video played in the user interface will fast forward or rewind to the video frame corresponding to this position, thus completing the dragging of the playback progress. The playback progress bar in this example is just an example. Controls that support dragging also include sliders, scroll bars, labels, cards, lists, etc. The embodiments of the present application do not limit this.

[0137] See Figure 10 As shown, the pointing remote control supports swiping. When a cursor is displayed in the user interface, the user can swipe up, down, left, or right on the touch area of the pointing remote control, and the display device will execute the responses to these swipes.

[0138] See Figure 11As shown, the pointing remote control supports continuous sliding. When there is a cursor displayed on the user interface, the user can continuously slide up, down, left, or right on the touch area of the pointing remote control, and the display device will execute the response to these continuous slides and display a damping sliding effect on the user interface. Figure 11 It is a schematic diagram of continuous upward sliding.

[0139] See Figure 12 As shown, the pointing remote control supports continuous reverse sliding. When there is a cursor displayed on the user interface, the user can first slide in a certain direction and then slide in the opposite direction on the touch area of the pointing remote control, and the display device will execute the response to the continuous reverse slide and display a damping sliding effect on the user interface. Figure 12 It is a schematic diagram of first sliding up and then sliding down.

[0140] In some embodiments, as Figure 1 and 2 shown, the present application provides a display device 200, which may include a display 260 and a controller 250. The display 260 is configured to display a display interface for preview pictures; the display interface includes a first enlarged picture of the preview picture and a thumbnail display area; the thumbnail display area includes a position identification frame, and the position identification frame is used to represent the position of the first enlarged picture in the preview picture; wherein, as Figure 5 shown, the controller 250 is configured to execute the steps shown in Figure 13 the following.

[0141] Step S1301, in response to an interaction operation on a target position in the thumbnail display area, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0142] Wherein, the position of the second enlarged picture in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

[0143] As an example, the interaction operation on the target position can be a touch screen operation or a remote control pointing touch screen operation, and the response can be made by listening to the touch event corresponding to the interaction operation, and the touch event can include at least one of a touch screen event or a remote control pointing touch screen event.

[0144] Wherein, the target position can be in the thumbnail display area and outside the display range of the position identification frame.

[0145] Wherein, the thumbnail displayed in the thumbnail display area is the thumbnail corresponding to the preview picture, and the thumbnail display area floats on the presentation of the first enlarged picture.

[0146] Among them, the first enlarged screen and the second enlarged screen can be partial enlarged screens of preview pictures with the same display screen size but different display screen contents.

[0147] In practical applications, for the enlarged scene of the preview picture, such as Figure 14 shown, the picture size of the preview picture after enlargement is like the size of Picture 1 in Figure 14 , and the picture size of the preview picture after enlargement is larger than the display size of the display interface; the display interface is like the preview display area of Picture 2 in Figure 14 , and this area displays the first enlarged screen and the thumbnail display area (such as the thumbnail in Picture 3 in Figure 14 ). For example, the position identification frame in Figure 14 is used to represent the position of the first enlarged screen currently displayed on the display interface in the preview picture after enlargement, and the position identification frame can also be used to describe the proportion of the preview display area of Picture 2 in Picture 1.

[0148] In an example, based on the thumbnail display area in the display interface, in response to an interaction operation on the target position in the thumbnail display area, such as detecting a touch display screen operation or a remote control pointing at the touch screen operation, the position identification frame can be displayed on the display interface to move towards the target position, and a corresponding enlarged screen (i.e., the second enlarged screen) can be presented on the display interface according to the moved position identification frame.

[0149] For example, as Figure 14 shown, in the enlarged scene of the preview picture, based on the displayed thumbnail of Picture 3, the user can move the position identification frame in Picture 3 by pointing at and touching the display area of Picture 3, such as moving the position identification frame to the pointing and touching position, and then the corresponding enlarged display content in the preview picture can be adjusted according to the position of the moved position identification frame in Picture 3. Thus, it can be realized that in the enlarged scene of the preview picture, the corresponding display position of the enlarged screen in the preview picture can be quickly moved without the user manually pressing buttons to adjust the display content of the picture.

[0150] The technical solution of this embodiment realizes the adjustment and optimization of the display content in the enlarged scene of the preview picture by responding to the interaction operation on the target position in the thumbnail display area, controlling the display to move the position identification frame towards the target position, and controlling the display to present the second enlarged screen on the display interface. It can efficiently and quickly move the corresponding display position of the enlarged screen in the preview picture without the user manually pressing buttons, effectively improving the efficiency of adjusting the display content of the picture and helping to improve the preview display effect of the picture.

[0151] In some embodiments, in response to an interaction operation on a target position in the thumbnail display area, the controller is configured to control the display to move the position identification frame towards the target position and control the display to present a second enlarged image on the display interface, and the controller 250 is configured to perform the following steps:

[0152] In the picture preview magnification mode, listen for the touch event corresponding to the interaction operation; the touch event includes at least one of a touch display screen event or a remote control pointing at the touch screen event; in response to the monitored touch event, control the display to move the position identification frame towards the target position and control the display to present a second enlarged image on the display interface.

[0153] In a specific implementation, as Figure 15 shown, by triggering picture magnification processing during picture preview, an enlarged image of the picture and a picture thumbnail can be displayed, and then the touch screen event pointed to can be waited for based on the thumbnail; exemplarily, when the thumbnail is displayed, a pointing listening can be registered with the display platform to monitor the touch screen event pointed to, that is, in the picture preview magnification mode, listen for the touch event corresponding to the interaction operation, and then by responding to the monitored touch event, displacement processing can be performed on the corresponding position of the enlarged image of the preview picture based on the pointed target position.

[0154] In an alternative embodiment, as Figure 16 shown in the interaction relationship between the pointing touch event modules, its implementation is layered as follows:

[0155] 1. Pointing remote control: By providing a touch event callback interface to the service layer, supporting "press event", "move event" and "lift event", it can provide a pointing touch screen event, and then the service layer can implement position confirmation or trigger confirmation and other events based on the monitored related events;

[0156] 2. Adaptation layer: The pointing touch screen trajectory can be obtained based on the pointing remote control callback event and data management can be performed;

[0157] 3. Application layer: The display position calculation can be performed based on the determined pointing position, picture size and screen display size, and then effects such as picture zooming and position movement can be realized.

[0158] In this embodiment, by listening for the touch event corresponding to the interaction operation in the picture preview magnification mode, and then in response to the monitored touch event, controlling the display to move the position identification frame towards the target position and controlling the display to present a second enlarged image on the display interface, accurate feedback of user interaction operations can be achieved for the picture preview magnification mode.

[0159] In some embodiments, as Figure 17As shown, controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged picture in the display interface, the controller 250 is configured to execute as Figure 17 the steps shown.

[0160] Step S1701: Obtain the touch coordinates of the interactive operation in the thumbnail display area.

[0161] Step S1702: According to the positional relationship between the touch coordinates and the position identification frame, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0162] Specifically, when a pointed touch event (i.e., a touch event) is monitored, the position of the pointed target position in the current thumbnail can be obtained. For example, the position markers (raw x , raw y ) can be obtained, that is, the touch coordinates of the interactive operation in the thumbnail display area are obtained.

[0163] In one example, as Figure 15 shown, after obtaining the position markers based on the pointed touch event, the touch range can be further determined according to the position markers. For example, whether it is within the visible thumbnail range corresponding to the position identification frame, that is, according to the positional relationship between the touch coordinates and the position identification frame, displacement processing is performed on the corresponding position of the enlarged picture of the preview picture.

[0164] In this embodiment, by obtaining the touch coordinates of the interactive operation in the thumbnail display area, and then according to the positional relationship between the touch coordinates and the position identification frame, controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged picture in the display interface, it is possible to dynamically adjust the movement of the position identification frame based on the positional relationship between the user's touch position and the position identification frame, and synchronously display the enlarged picture after displacement, which helps to optimize the user operation experience.

[0165] In some embodiments, the controller 250 is configured to execute the following steps.

[0166] Determine the thumbnail display parameters; the thumbnail display parameters include the regional size parameters of the thumbnail display area; obtain the touch coordinates of the interactive operation in the thumbnail display area according to the coordinate system established based on the regional size parameters.

[0167] Exemplarily, for the parameters in the picture preview and magnification mode, as Figure 14 shown, the picture size of the preview picture is 1920X1080, and after being magnified by 1 time, the picture size is 3840X2160; for the picture display area, the maximum displayable area of the screen can be obtained based on the screen size, such as:

[0168] Preview width (Image display width) = screen width (Screen display width)

[0169] Preview height (Image display height) = screen height (Screen display height)

[0170] Regarding the thumbnail display parameters corresponding to the thumbnail display area, it may include the area size parameters of the thumbnail display area. For example, the thumbnail display size can be defined as Thumbnail width (Thumbnail display width) and Thumbnail height (Thumbnail display height). Furthermore, based on the coordinate system established according to the area size parameters, the touch coordinates of the interactive operation in the thumbnail display area can be obtained. For example, the position marker (raw x , raw y ) corresponds to the display range of the thumbnail, which is from (0, 0) to (Thumbnail width, Thumbnail height).

[0171] Optionally, the thumbnail display sizes Thumbnail width and Thumbnail height can be adjusted according to the display effect. For example, Thumbnail width = 480 and Thumbnail height = 270 can be defined.

[0172] In this embodiment, by determining the thumbnail display parameters and then obtaining the touch coordinates of the interactive operation in the thumbnail display area based on the coordinate system established according to the area size parameters, the touch screen event based on the thumbnail display waiting for a pointer can be realized to accurately obtain the touch coordinates of the target position pointed to.

[0173] In some embodiments, the thumbnail display parameters may further include the position parameters of the position identification frame. To determine the thumbnail display parameters, the controller 250 is configured to perform the following steps.

[0174] According to the magnification factor corresponding to the first magnified picture, obtain the magnified picture parameters after the preview picture is magnified; based on the coordinate system established according to the magnified picture parameters, determine the starting coordinate position of the first magnified picture in the preview picture; according to the screen display parameters of the display, the magnified picture parameters, and the area size parameters, determine the identification size parameters of the position identification frame; the ratio relationship between the screen display parameters and the magnified picture parameters corresponds to the ratio relationship between the identification size parameters and the area size parameters; use the starting coordinate position and the identification size parameters as the position parameters of the position identification frame.

[0175] In practical applications, if the image size of the preview image is 1920X1080, after being magnified by 1 time (i.e., the magnification factor corresponding to the first magnified picture), the image size becomes 3840X2160 (i.e., the magnified image parameters), which can be represented as imagewidth (the display width of the magnified image) and image height (the display height of the magnified image).

[0176] In one example, the thumbnail display parameters may further include the position parameters of the position identification frame. The position parameters include the starting coordinate positions, such as Location layout left and Location layout top, which are used to characterize the starting position of the position identification frame in the original image; the position parameters also include the identification size parameters of the position identification frame, such as Locationwidth (position width) and Location height (position height). The position parameters of the position identification frame can change with the change of the display position of the magnified picture in the preview image.

[0177] In another example, the ratio relationships of the parameters in the picture preview magnification mode are as follows (i.e., the ratio relationship between the screen display parameters and the magnified image parameters corresponds to the ratio relationship between the identification size parameters and the area size parameters):

[0178] Preview width / image width=Location width / Thumbnail width

[0179] Preview height / image height=Location height / Thumbnail height

[0180] In this embodiment, by obtaining the magnified image parameters after magnifying the preview image according to the magnification factor corresponding to the first magnified picture, and then determining the starting coordinate position of the first magnified picture in the preview image based on the coordinate system established by the magnified image parameters, and further determining the identification size parameters of the position identification frame according to the screen display parameters, magnified image parameters, and area size parameters of the display, and taking the starting coordinate position and the identification size parameters as the position parameters of the position identification frame, the position parameters of the position identification frame can be accurately obtained based on the change of the display position of the magnified picture in the preview image.

[0181] In some embodiments, according to the positional relationship between the touch coordinates and the position identification frame, controlling the display of the position identification frame on the display to move to the target position, and controlling the display to present the second magnified picture on the display interface, the controller 250 is configured to perform the following steps.

[0182] Determine whether the touch coordinate is within the display range of the position identification frame; in the case where the touch coordinate is not within the display range, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0183] Specifically, as Figure 15 shown, the touch range can be determined according to the position marker obtained from the pointed touch screen event, that is, to determine whether the touch coordinate is within the display range of the position identification frame. Furthermore, in the case where the touch coordinate is not within the display range, such as Figure 15 not within the visible thumbnail range corresponding to the position identification frame in [reference], displacement processing can be performed on the corresponding position of the enlarged picture of the preview picture based on the touch coordinate.

[0184] In this embodiment, by determining whether the touch coordinate is within the display range of the position identification frame, and then in the case where the touch coordinate is not within the display range, controlling the display to move the position identification frame to the target position, and controlling the display to present a second enlarged picture in the display interface, it is possible to quickly determine whether to trigger displacement processing based on the display range of the position identification frame, which helps to improve the processing efficiency.

[0185] In some embodiments, the controller 250 is further configured to perform the following steps.

[0186] Determine the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame according to the identification size parameter of the position identification frame in the position parameter of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, so as to obtain the display range.

[0187] In one example, the display range of the position identification frame can be represented in the following way:

[0188] Left boundary (i.e., display left boundary parameter): Location layout left

[0189] Upper boundary (i.e., display upper boundary parameter): Location layout top

[0190] Right boundary (i.e., display right boundary parameter): Location layout left + Location width

[0191] Lower boundary (i.e., display lower boundary parameter) Location layout top + Location height

[0192] In this embodiment, by determining the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame according to the identification size parameter of the position identification frame in the position parameters of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, and obtaining the display range, the display range of the position identification frame can be accurately obtained, providing data support for determining whether the touch coordinates are within the display range.

[0193] In some embodiments, the controller 250 is further configured to perform the following steps.

[0194] If the abscissa in the touch coordinates is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter; and the ordinate in the touch coordinates is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter; it is determined that the touch coordinates are within the display range.

[0195] Exemplarily, to determine whether the touch coordinates are within the display range of the position identification frame, the following method can be used for determination:

[0196] If(raw x >= Location layout left && raw x <= (Location layout left + Location width))

[0197] And,

[0198] If(raw y >= Location layout top && raw y <= (Location layout top + Locationheight))

[0199] It can be confirmed that the touch coordinates are within the display range of the position identification frame, and in this state, no position movement processing is performed.

[0200] In this embodiment, by determining that the touch coordinates are within the display range if the abscissa in the touch coordinates is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter, and the ordinate in the touch coordinates is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter, it can effectively and quickly determine whether the touch coordinates are within the display range to determine whether to perform position movement processing.

[0201] In some embodiments, when the touch coordinates are not within the display range, the controller 250 is configured to control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface, and perform the following steps.

[0202] Combine the touch coordinates, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter to calculate the position display deviation data; use the position display deviation data to adjust the display position of the first enlarged picture in the preview picture, and control the display to present the second enlarged picture; use the position display deviation data to control the display to move the position identification frame to the target position.

[0203] In a specific implementation, as Figure 15 shown, when it is determined that the touch coordinates are not within the visible thumbnail range corresponding to the position identification frame, position mapping processing can be performed to calculate the position display deviation data based on the touch coordinates, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter. Furthermore, the display displacement of the enlarged picture in the preview picture can be triggered, that is, use the position display deviation data to adjust the display position of the first enlarged picture in the preview picture to present the second enlarged picture. At the same time, use the position display deviation data to move the position identification frame to the target position.

[0204] For example, as Figure 18 shown, if it is determined that the touch coordinates corresponding to the target position of the interactive operation are not within the display range of the position identification frame, based on the calculated position display deviation data, the position identification frame can be moved to the left display area in the thumbnail display area (that is, the position identification frame moves to the target position), and the enlarged picture after the preview picture displacement processing (that is, the second enlarged picture) can be presented.

[0205] Another example, as Figure 19 shown, if it is determined that the touch coordinates corresponding to the target position of the interactive operation are not within the display range of the position identification frame, based on the calculated position display deviation data, the position identification frame can be moved to the upper display area in the thumbnail display area (that is, the position identification frame moves to the target position), and the enlarged picture after the preview picture displacement processing (that is, the second enlarged picture) can be presented.

[0206] In this embodiment, by combining the touch coordinates, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter, the position display deviation data is calculated. Furthermore, using the position display deviation data to adjust the display position of the first enlarged picture in the preview picture, controlling the display to present the second enlarged picture, and using the position display deviation data to control the display to move the position identification frame to the target position can efficiently and quickly move the display position corresponding to the enlarged picture in the preview picture and present the enlarged picture after displacement.

[0207] In some embodiments, position display deviation data is calculated by combining touch coordinates, display left boundary parameters, display upper boundary parameters, display right boundary parameters, and display lower boundary parameters, and the controller 250 is configured to perform the following steps.

[0208] Obtain the difference between the display left boundary parameter and the abscissa in the touch coordinates, or the difference between the display right boundary parameter and the abscissa, as the abscissa deviation; obtain the difference between the display upper boundary parameter and the ordinate in the touch coordinates, or the difference between the display lower boundary parameter and the ordinate, as the ordinate deviation; use the abscissa deviation and the ordinate deviation as the position display deviation data.

[0209] In one example, the thumbnail display area can be divided into four areas: left, right, upper, and lower for judgment, and the position display deviation data can be calculated in the following way (such as abscissa deviation Offset x and ordinate deviation Offset y ):

[0210] If(raw x <Location layout left) { / / Indicates the X-axis direction, the displayed picture moves to the right

[0211] Offset x = Location layout left - raw x}

[0212] If(raw x > Location layout right) { / / Indicates the X-axis direction, the displayed picture moves to the left

[0213] Offset x = Location layout right - raw x}

[0214] Otherwise, Offset x = 0 remains unchanged.

[0215] If(raw y <Location layout top) { / / Indicates the Y-axis direction, the displayed picture moves down

[0216] Offset y = Location layout top - raw y}

[0217] If(raw y > Location layout bottom) { / / Indicates the Y-axis direction, the displayed picture moves up

[0218] Offset y = Location layout bottom - raw y}

[0219] Otherwise, Offset y = 0 change.

[0220] In this embodiment, by obtaining the difference between the display left - boundary parameter and the abscissa of the touch coordinate, or the difference between the display right - boundary parameter and the abscissa, as the abscissa deviation, and obtaining the difference between the display upper - boundary parameter and the ordinate of the touch coordinate, or the difference between the display lower - boundary parameter and the ordinate, as the ordinate deviation, and then taking the abscissa deviation and the ordinate deviation as the position display deviation data, the position display deviation data can be accurately calculated, providing data support for further position - movement processing.

[0221] In some embodiments, the position display deviation data is used to adjust the display position of the first enlarged picture in the preview picture, and the controller 250 is configured to execute the following steps to control the display to present the second enlarged picture.

[0222] Combining the enlarged - picture parameters after the preview picture is enlarged, the position display deviation data, and the regional - size parameters of the thumbnail display area, determine the first display - position adjustment parameter for the first enlarged picture; the ratio relationship between the first display - position adjustment parameter and the enlarged - picture parameters corresponds to the ratio relationship between the position display deviation data and the regional - size parameters; adjust the display position of the first enlarged picture in the preview picture according to the first display - position adjustment parameter, and control the display to present the second enlarged picture.

[0223] In practical applications, according to the obtained position display deviation data, such as Offset x and Offset y , by converting them into the offset (offset information) of the display position of the enlarged picture moving on the preview picture, the offset of the display position of the enlarged picture in the preview picture is realized to present the second enlarged picture after displacement.

[0224] For example, the following method can be adopted for processing:

[0225] Preview layout offset x 、Preview layout offset y (i.e., the first display - position adjustment parameter);

[0226] The parameter conversion is as follows:

[0227] Preview layout offsetx / image width = offset x / Thumbnail width

[0228] Preview layout offset x = (offset x / Thumbnail width) * image width

[0229] Similarly:

[0230] Preview layout offset y / image height = offset y / Thumbnail height

[0231] Preview layout offset y = (offset y / Thumbnail height) * image height

[0232] That is, by combining the enlarged image parameters, position display deviation data after enlarging the preview image, and the regional dimension parameters of the thumbnail display area, the first display position adjustment parameter is determined, and the ratio relationship between the first display position adjustment parameter and the enlarged image parameters corresponds to the ratio relationship between the position display deviation data and the regional dimension parameters.

[0233] In this embodiment, by combining the enlarged image parameters, position display deviation data after enlarging the preview image, and the regional dimension parameters of the thumbnail display area, the first display position adjustment parameter for the first enlarged screen is determined, and then according to the first display position adjustment parameter, the display position of the first enlarged screen in the preview image is adjusted, and the display controls the display of the second enlarged screen, which can realize the offset of the display position of the enlarged screen in the preview image and improve the display effect in the preview image enlargement scenario.

[0234] In some embodiments, the position display deviation data is used to control the display position identification frame on the display to move to the target position, and the controller 250 is configured to perform the following steps.

[0235] According to the position display deviation data and the starting coordinate position of the first enlarged screen in the preview image, the second display position adjustment parameter of the position identification frame is determined; according to the second display position adjustment parameter, the display position identification frame on the display is controlled to move to the target position.

[0236] Exemplarily, the obtained position display deviation data (such as Offset xand Offset y ) Adjust the display deviation of the position identification frame to move the position identification frame to the target position. The second display position adjustment parameter can be obtained in the following manner:

[0237] Location layout left-offset x

[0238] Location layout top-offset y

[0239] In this embodiment, by determining the second display position adjustment parameter of the position identification frame according to the position display deviation data and the starting coordinate position of the first enlarged picture in the preview picture, and then controlling the display of the position identification frame on the display to move to the target position according to the second display position adjustment parameter, the display deviation of the position identification frame can be realized, and the display effect in the enlarged scene of the preview picture is improved.

[0240] In some embodiments, as Figure 13 shown, a display content adjustment method is provided. This method can be applied to a display device as Figure 1 shown. As Figure 1 shown, the display device may include a display 260 and a controller 250. The controller 250 is coupled to the display 260. The display 260 displays a display interface of the preview picture. The display interface includes a first enlarged picture of the preview picture and a thumbnail display area. The thumbnail display area includes a position identification frame, and the position identification frame is used to represent the position of the first enlarged picture in the preview picture. The method may include the following steps:

[0241] Step S1301, in response to an interaction operation on the target position in the thumbnail display area, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0242] Wherein, the position of the second enlarged picture in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

[0243] The technical solution of this embodiment realizes the adjustment and optimization of the display content in the enlarged scene of the preview picture by responding to the interaction operation on the target position in the thumbnail display area, controlling the display to move the position identification frame to the target position, and controlling the display to present a second enlarged picture in the display interface. It can efficiently and quickly move the display position corresponding to the enlarged picture in the preview picture without the need for the user to manually press buttons, effectively improving the efficiency of adjusting the display content of the picture and contributing to improving the picture preview display effect.

[0244] In some embodiments, the above display content adjustment method may further include the following steps:

[0245] In the picture preview zoom-in mode, monitor the touch event corresponding to the interactive operation; the touch event includes at least one of a touch display screen event or a remote control pointing at the touch screen event;

[0246] In response to the monitored touch event, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0247] In some embodiments, the above display content adjustment method may further include the following steps:

[0248] Obtain the touch coordinates of the interactive operation in the thumbnail display area;

[0249] According to the positional relationship between the touch coordinates and the position identification frame, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0250] In some embodiments, the above display content adjustment method may further include the following steps:

[0251] Determine the thumbnail display parameters; the thumbnail display parameters include the area size parameters of the thumbnail display area;

[0252] Obtain the touch coordinates of the interactive operation in the thumbnail display area according to the coordinate system established based on the area size parameters.

[0253] In some embodiments, the above display content adjustment method may further include the following steps:

[0254] According to the magnification factor corresponding to the first enlarged picture, obtain the enlarged picture parameters after the preview picture is enlarged;

[0255] Based on the coordinate system established by the enlarged picture parameters, determine the starting coordinate position of the first enlarged picture in the preview picture;

[0256] According to the screen display parameters of the display, the enlarged picture parameters, and the area size parameters, determine the identification size parameters of the position identification frame; the ratio relationship between the screen display parameters and the enlarged picture parameters corresponds to the ratio relationship between the identification size parameters and the area size parameters;

[0257] Take the starting coordinate position and the identification size parameters as the position parameters of the position identification frame.

[0258] In some embodiments, the above display content adjustment method may further include the following steps:

[0259] Determine whether the touch coordinate is within the display range of the position identification frame;

[0260] In the case where the touch coordinate is not within the display range, control the display to move the position identification frame to the target position, and control the display to present a second enlarged picture in the display interface.

[0261] In some embodiments, the above display content adjustment method may further include the following steps:

[0262] Determine the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame based on the identification size parameter of the position identification frame in the position parameter of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, to obtain the display range.

[0263] In some embodiments, the above display content adjustment method may further include the following steps:

[0264] If the abscissa in the touch coordinate is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter;

[0265] And the ordinate in the touch coordinate is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter;

[0266] Determine that the touch coordinate is within the display range.

[0267] In some embodiments, the above display content adjustment method may further include the following steps:

[0268] Combine the touch coordinate, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter to calculate position display deviation data;

[0269] Use the position display deviation data to adjust the display position of the first enlarged picture in the preview picture, and control the display to present the second enlarged picture;

[0270] Use the position display deviation data to control the display to move the position identification frame to the target position.

[0271] In some embodiments, the above display content adjustment method may further include the following steps:

[0272] Obtain the difference between the left display boundary parameter and the abscissa in the touch coordinates, or the difference between the right display boundary parameter and the abscissa, as the abscissa deviation;

[0273] Obtain the difference between the upper display boundary parameter and the ordinate in the touch coordinates, or the difference between the lower display boundary parameter and the ordinate, as the ordinate deviation;

[0274] Take the abscissa deviation and the ordinate deviation as the position display deviation data.

[0275] In some embodiments, the above display content adjustment method may further include the following steps:

[0276] Combine the enlarged picture parameters after the preview picture is enlarged, the position display deviation data, and the regional size parameters of the thumbnail display area to determine the first display position adjustment parameter for the first enlarged picture; the ratio relationship between the first display position adjustment parameter and the enlarged picture parameters corresponds to the ratio relationship between the position display deviation data and the regional size parameters;

[0277] Adjust the display position of the first enlarged picture in the preview picture according to the first display position adjustment parameter, and control the display to present the second enlarged picture.

[0278] In some embodiments, the above display content adjustment method may further include the following steps:

[0279] Determine the second display position adjustment parameter of the position identification frame according to the position display deviation data and the starting coordinate position of the first enlarged picture in the preview picture;

[0280] Control the display to display the position identification frame to move to the target position according to the second display position adjustment parameter.

[0281] In some embodiments, as Figure 20 shown, to better understand the above method, the following details an application example of the display device of the present application, which may include the following steps:

[0282] S2001, display the display interface of the preview picture; the display interface includes the first enlarged picture of the preview picture and the thumbnail display area, and the thumbnail display area includes a position identification frame.

[0283] S2002, in the picture preview magnification mode, listen for the touch event corresponding to the interactive operation.

[0284] S2003, trigger the pointed touch event.

[0285] In S2004, obtain the touch coordinates of the interactive operation in the thumbnail display area, and determine whether the touch coordinates are within the display range of the position identification frame.

[0286] In S2005, when the touch coordinates are not within the display range, calculate the position display deviation data according to the touch coordinates and the relevant parameters of the thumbnail display area.

[0287] In S2006, according to the position display deviation data, control the displacement processing of the position identification frame and adjust the display position of the first enlarged picture in the preview picture.

[0288] In S2007, display that the position identification frame moves to the target position and present the second enlarged picture.

[0289] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown according to the indications of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least a part of other steps or steps or stages in other steps.

[0290] Based on the same inventive concept, the embodiments of the present application also provide a display content adjustment device for implementing the above-mentioned display content adjustment method. The implementation solutions provided by this device to solve problems are similar to the implementation solutions described in the above method. Therefore, the specific limitations in one or more embodiments of the following display content adjustment device can refer to the limitations on the display content adjustment method in the above text, and will not be repeated here.

[0291] In an exemplary embodiment, a display content adjustment device is provided. This device can be applied to a display device as shown in Figure 1 shown, as shown in Figure 1 shown, the display device may include a display 260 and a controller 250. The controller 250 is coupled to the display 260. The display 260 displays a display interface of a preview picture. The display interface includes a first enlarged picture of the preview picture and a thumbnail display area. The thumbnail display area includes a position identification frame, and the position identification frame is used to represent the position of the first enlarged picture in the preview picture. It includes:

[0292] A display content adjustment module, configured to control the display to move a position identification frame to a target position and control the display to present a second enlarged picture on the display interface in response to an interaction operation on the target position in the thumbnail display area;

[0293] Wherein, the position of the second enlarged picture in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

[0294] Each module in the above display content adjustment device can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.

[0295] In one embodiment, a computer-readable storage medium is provided, storing a computer program, which when executed by a processor, causes the processor to execute the steps of the above display content adjustment method. Here, the steps of a display content adjustment method can be the steps in the display content adjustment method of each of the above embodiments.

[0296] In one embodiment, a computer program product is provided, including a computer program, which when executed by a processor, causes the processor to execute the steps of the above display content adjustment method. Here, the steps of a display content adjustment method can be the steps in the display content adjustment method of each of the above embodiments.

[0297] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of the relevant data need to comply with the relevant regulations.

[0298] Those of ordinary skill in the art can understand that all or part of the processes in the above-described embodiment methods can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above various methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in this application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in this application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., without limitation.

[0299] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered to be within the scope recorded in this application.

[0300] The above-described embodiments merely represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A display device, characterized in that, Including: A display configured to display a display interface for preview pictures; The display interface includes a first enlarged picture of the preview picture and a thumbnail display area; the thumbnail display area includes a position identification frame for characterizing the position of the first enlarged picture in the preview picture; A controller coupled to the display and configured to: In response to an interaction operation on a target position in the thumbnail display area, control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface; Wherein, the position of the second enlarged picture in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

2. The display device according to claim 1, wherein The controller executes, in response to an interaction operation on a target position in the thumbnail display area, controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged picture in the display interface, and is configured to: In the picture preview magnification mode, listen for a touch event corresponding to the interaction operation; the touch event includes at least one of a touch display screen event or a remote control pointing at a touch screen event; In response to the detected touch event, control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface.

3. The display device according to claim 1, wherein The controller executes controlling the display to move the position identification frame to the target position and controlling the display to present a second enlarged picture in the display interface, and is configured to: Obtain the touch coordinates of the interaction operation in the thumbnail display area; Based on the positional relationship between the touch coordinates and the position identification frame, control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface.

4. The display device according to claim 3, characterized in that, The controller executes obtaining the touch coordinates of the interaction operation in the thumbnail display area, and is configured to: Determine thumbnail display parameters; the thumbnail display parameters include the area size parameters of the thumbnail display area; Based on the coordinate system established according to the area size parameters, obtain the touch coordinates of the interaction operation in the thumbnail display area.

5. The display device according to claim 4, characterized in that, The thumbnail display parameters further include the position parameters of the position identification frame, and the controller executes determining the thumbnail display parameters, and is configured to: Based on the magnification factor corresponding to the first enlarged picture, obtain the enlarged picture parameters of the preview picture after magnification; Based on the coordinate system established by the enlarged picture parameters, determine the starting coordinate position of the first enlarged picture in the preview picture; Based on the screen display parameters of the display, the enlarged picture parameters, and the area size parameters, determine the identification size parameters of the position identification frame; the ratio relationship between the screen display parameters and the enlarged picture parameters corresponds to the ratio relationship between the identification size parameters and the area size parameters; Use the starting coordinate position and the identification size parameter as the position parameters of the position identification frame.

6. The display device according to claim 3, wherein The controller is configured to control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface according to the positional relationship between the touch coordinates and the position identification frame, which is configured as: Determine whether the touch coordinates are within the display range of the position identification frame; When the touch coordinates are not within the display range, control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface.

7. The display device according to claim 6, wherein The controller is further configured to: Determine the display left boundary parameter, display upper boundary parameter, display right boundary parameter, and display lower boundary parameter of the position identification frame based on the identification size parameter of the position identification frame in the position parameters of the position identification frame and the starting coordinate position of the first enlarged picture in the preview picture, so as to obtain the display range.

8. The display device according to claim 7, characterized in that, The controller is further configured to: If the abscissa in the touch coordinates is greater than or equal to the display left boundary parameter and less than or equal to the display right boundary parameter; And the ordinate in the touch coordinates is greater than or equal to the display upper boundary parameter and less than or equal to the display lower boundary parameter; Determine that the touch coordinates are within the display range.

9. The display device according to claim 7, characterized in that, The controller is configured to control the display to move the position identification frame to the target position and control the display to present a second enlarged picture in the display interface when the touch coordinates are not within the display range, which is configured as: Calculate position display deviation data by combining the touch coordinates, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter; Use the position display deviation data to adjust the display position of the first enlarged picture in the preview picture and control the display to present the second enlarged picture; Use the position display deviation data to control the display to move the position identification frame to the target position.

10. The display device according to claim 9, characterized in that, The controller is configured to calculate position display deviation data by combining the touch coordinates, the display left boundary parameter, the display upper boundary parameter, the display right boundary parameter, and the display lower boundary parameter, which is configured as: Obtain the difference between the display left boundary parameter and the abscissa in the touch coordinates, or the difference between the display right boundary parameter and the abscissa, as the abscissa deviation; Obtain the difference between the display upper boundary parameter and the ordinate in the touch coordinates, or the difference between the display lower boundary parameter and the ordinate, as the ordinate deviation; Use the abscissa deviation and the ordinate deviation as the position display deviation data.

11. The display device according to claim 9, characterized in that, The controller is configured to use the position display deviation data to adjust the display position of the first enlarged picture in the preview picture and control the display to present the second enlarged picture, which is configured as: Determine a first display position adjustment parameter for the first enlarged screen in combination with the enlarged picture parameters after enlarging the preview picture, the position display deviation data, and the area size parameters of the thumbnail display area; the ratio relationship between the first display position adjustment parameter and the enlarged picture parameters corresponds to the ratio relationship between the position display deviation data and the area size parameters; Adjust the display position of the first enlarged screen in the preview picture according to the first display position adjustment parameter, and control the display to present the second enlarged screen.

12. The display device according to claim 9, wherein The controller is configured to execute using the position display deviation data to control the display to move the position identification frame to the target position, and is configured as: Determine a second display position adjustment parameter of the position identification frame according to the position display deviation data and the starting coordinate position of the first enlarged screen in the preview picture; Control the display to move the position identification frame to the target position according to the second display position adjustment parameter.

13. A method for adjusting display content, characterized in that, Applied to a display device, the display device includes a display and a controller, the controller is coupled to the display, and the display shows a display interface of a preview picture, and the display interface includes a first enlarged screen of the preview picture and a thumbnail display area; The thumbnail display area includes a position identification frame, and the position identification frame is used to represent the position of the first enlarged screen in the preview picture. The method includes: In response to an interactive operation on the target position in the thumbnail display area, control the display to move the position identification frame to the target position, and control the display to present a second enlarged screen in the display interface; Wherein, the position of the second enlarged screen in the preview picture matches the position of the moved position identification frame in the thumbnail display area.

Images