Display device and cursor display method

Abstract

The embodiment of the invention provides a display device and a cursor display method, and the method comprises the steps: obtaining first position information of a mouse cursor on a user interface through responding to a first movement operation of moving a mouse by a user, calculating the distance between the mouse cursor and the screen edge of a display based on the first position information and the screen size of the display, and displaying the distance between the mouse cursor and the screen edge of the display. And under the condition that the distance between the mouse cursor and the screen edge of the display meets the boundary condition, rotating the mouse cursor style, and drawing the rotated mouse cursor, thereby controlling the display to display the rotated mouse cursor on the user interface. When it is detected that the distance between the mouse cursor and the screen edge of the display meets the boundary condition, the mouse cursor is subjected to real-time rotation transformation, so that the rotated mouse cursor is all located in the user interface. Based on rotation of the same mouse cursor, the display device does not need to pre-store image resources of multiple sets of mouse cursors at different angles, so that the memory capacity of the display device is saved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a cursor display method. BACKGROUND

[0002] For a large-screen display device, a user often watches from a position far away from the display device. For this far-distance watching mode, the user can perform a far-distance interaction operation with the display device through an external device. Taking a mouse as an example, the user can move the mouse by hand to synchronize the movement of a mouse cursor corresponding to the mouse in a user interface of the display device.

[0003] Since the cursor response point of the mouse cursor is in the upper left corner, the display device limits the movement of the cursor response point in the user interface corresponding to the screen. In the process of moving the mouse cursor by the user, when the mouse cursor moves to the edge region of the screen of the display device, such as the right edge or the lower edge, a large area of the mouse cursor moves out of the user's visual area, resulting in that the position of the mouse cursor cannot be clearly seen at the far-distance position.

[0004] Based on this, the display device can prestore multiple sets of image resources of the mouse cursor at different angles, so that when the mouse cursor moves to the edge region, the display device can display the image resources at different angles to overcome the situation that a large area of the mouse cursor moves out of the user's visual area. However, this way of pre-storing multiple sets of image resources will occupy additional memory, resulting in performance loss of the display device. SUMMARY

[0005] To solve the problem that the display device pre-stores multiple sets of cursor image resources at different angles when adjusting the angle of the cursor, resulting in performance loss of the display device.

[0006] In a first aspect, some embodiments of the present application provide a display device, comprising:

[0007] a display configured to display a user interface;

[0008] an external device interface configured to communicate with an external device; wherein the external device comprises a mouse;

[0009] a controller coupled to the display and the external device interface, and configured to:

[0010] in response to a first movement operation of the user moving the mouse, acquire first position information of a mouse cursor on the user interface;

[0011] based on the first position information and a screen size of the display, calculate a distance between the mouse cursor and an edge of the screen of the display;

[0012] In a case that a distance between the mouse cursor and a screen edge of the display meets a boundary condition, a mouse cursor style is rotated, and a rotated mouse cursor is drawn; wherein a display range of the rotated mouse cursor on a user interface is greater than a display range of the mouse cursor on the user interface before rotation.

[0013] The display is controlled to display the rotated mouse cursor on the user interface.

[0014] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application solve the problem of cursor moving out of the visible area during long-distance operation by dynamically rotating the cursor style. When the controller detects that the distance between the mouse cursor and the screen edge of the display meets the boundary condition, the mouse cursor is rotated in real time, rather than replacing multiple sets of resources in advance. After rotation, the display range of the mouse cursor on the user interface is greater than the display range of the mouse cursor on the user interface before rotation. For example, the tail of the arrow cursor is turned to the inside of the screen to avoid the main body of the cursor being blocked by the screen edge. This embodiment only needs to store the basic cursor style and rotate the cursor style, thereby reducing memory occupation and reducing the performance loss of the display device caused by image resource loading.

[0015] In some embodiments, the screen edge of the display includes a screen lower edge and a screen right edge, and the controller is configured to calculate the distance between the mouse cursor and the screen edge of the display based on the first position information and the screen size, specifically configured to:

[0016] calculate a first distance between the mouse cursor and the screen right edge of the display based on a first coordinate in the first position information and a screen width in the screen size;

[0017] calculate a second distance between the mouse cursor and the screen lower edge of the display based on a second coordinate in the first position information and a screen height in the screen size.

[0018] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application judge the display area of the screen right edge and the screen lower edge, which are two high-frequency occlusion areas of the mouse cursor. The controller can calculate the first distance from the right edge by combining the coordinate data in the first position information with the screen width, and calculate the second distance from the lower edge by combining the screen height. This double-distance independent calculation mechanism with the right edge and the lower edge of the screen edge ensures that the display device can simultaneously identify the critical state in both directions when the user moves the mouse to the lower right corner of the screen, thereby avoiding the response delay of single-side detection.

[0019] In some embodiments, the controller performs, in a case that a distance between the mouse cursor and a screen edge of the display satisfies a boundary condition, rotating the mouse cursor style, in particular configured to:

[0020] A preset threshold is set, the preset threshold including a first preset threshold in a screen width direction and a second preset threshold in a screen height direction;

[0021] In a case that a first distance between the mouse cursor and a right edge of the screen is less than the first preset threshold, and a second distance between the mouse cursor and a lower edge of the screen is less than the second preset threshold, the mouse cursor style is rotated at a first angle;

[0022] In a case that the first distance between the mouse cursor and the right edge of the screen is less than the first preset threshold, and the second distance between the mouse cursor and the lower edge of the screen is greater than or equal to the second preset threshold, the mouse cursor style is rotated at a second angle;

[0023] In a case that the first distance between the mouse cursor and the right edge of the screen is greater than or equal to the first preset threshold, and the second distance between the mouse cursor and the lower edge of the screen is less than the second preset threshold, the mouse cursor style is rotated at a third angle.

[0024] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application set different rotation strategies according to different mouse cursor moving positions. In a case that a first distance between the mouse cursor and a right edge of the screen is less than a preset threshold, and a second distance between the mouse cursor and a lower edge of the screen is less than the preset threshold, the mouse cursor style is rotated at a first angle. In a case that the first distance is less than the preset threshold, and the second distance is greater than or equal to the preset threshold, the mouse cursor style is rotated at a second angle. In a case that the first distance is greater than or equal to the preset threshold, and the second distance is less than the preset threshold, the mouse cursor style is rotated at a third angle. Thus, the mouse cursor is rotated at different angles according to different positions of the mouse cursor.

[0025] In some embodiments, the preset threshold is determined based on an icon size of the mouse cursor.

[0026] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application set a preset threshold based on an icon size of the mouse cursor. In a case that the mouse cursor is at a position away from a screen edge by a preset multiple of the icon size, the mouse cursor is rotated at a preset angle. Thus, unnecessary rotation effects of the mouse cursor in a user interface are avoided.

[0027] In some embodiments, the controller is further configured to, in a case that a distance between the mouse cursor and a screen edge of the display satisfies a boundary condition, rotate the mouse cursor style, and draw the rotated mouse cursor, specifically configured to:

[0028] The controller is further configured to, in a case that a distance between the mouse cursor and a screen edge of the display satisfies a boundary condition, rotate the mouse cursor style with a target point in a graphical surface where the mouse cursor is located as a rotation point;

[0029] Based on a rotation angle of the mouse cursor, determine an offset amount between a cursor response point of the mouse cursor and the target point;

[0030] Based on the offset amount, determine an offset position of the target point, and draw the rotated mouse cursor based on the offset position of the target point.

[0031] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application rotate with a target point of a mouse cursor as a rotation point, then calculate an offset amount between a cursor response point and the target point, and reposition and draw a position of the mouse cursor according to the offset amount, to ensure the click accuracy of the event processing logic of the mouse cursor.

[0032] In some embodiments, in a case that a distance between the mouse cursor and a screen edge of the display does not satisfy the boundary condition, draw the mouse cursor style, and control the display to display the drawn mouse cursor on a user interface.

[0033] The above technical solutions have the following beneficial effects or advantages. Some embodiments of the present application automatically switch back to a default style when the distance between the cursor and the screen edge does not satisfy the boundary condition, to avoid visual interference caused by invalid rotation.

[0034] In some embodiments, the display state of the display includes a landscape state or a portrait state, and the controller is further configured to, based on the first position information and a screen size of the display, determine the distance between the mouse cursor and the screen edge of the display, and further configured to:

[0035] Based on the first position information and a screen size corresponding to the display state of the display, determine the distance between the mouse cursor and the screen edge of the display.

[0036] The above technical scheme has the following beneficial effects or advantages: some embodiments of the present application determine the distance between the mouse cursor and the screen edge of the display according to the first position information and the screen size corresponding to the display state of the display when the display state of the display changes, so as to determine the position of the mouse cursor according to the screen size of different display states, so as to adaptively calibrate the accuracy of recognizing the position of the mouse cursor according to the rotated display.

[0037] In some embodiments, the controller is further configured to:

[0038] In response to a rotation operation of rotating the screen of the display, the mouse cursor controller acquires and stores the rotated screen size;

[0039] The mouse cursor controller is controlled to transmit the rotated screen size to the pointer controller;

[0040] The pointer controller is controlled to update the screen size of the display as the rotated screen size.

[0041] The above technical scheme has the following beneficial effects or advantages: some embodiments of the present application control the mouse cursor controller and the pointer controller in cooperation, update and transmit the rotated screen size in real time when the screen is rotated, update the position of the mouse cursor according to the rotated screen size, and solve the misplacement of the mouse cursor display caused by the change of the screen direction.

[0042] In some embodiments, the controller is further configured to:

[0043] In the case that the display device is connected with at least one external display screen, in response to a second movement operation of the user moving the mouse, the second position information of the mouse cursor on the user interface and the identification of the target display screen where the mouse cursor is located are acquired; wherein the target display screen includes the external display screen;

[0044] According to the identification and size correspondence relationship of the target display screen, the screen size of the target display screen is determined; wherein the size correspondence relationship includes a plurality of display screen identifications and the screen size corresponding to each display screen identification;

[0045] Based on the second position information and the screen size of the target display screen, the distance between the mouse cursor and the screen edge of the target display screen is calculated;

[0046] In the case that the distance between the mouse cursor and the screen edge of the target display screen meets the boundary condition, the mouse cursor style is rotated, and the rotated mouse cursor is drawn;

[0047] The target display screen is controlled to display the rotated mouse cursor on a user interface.

[0048] The above technical solution has the following beneficial effects or advantages. In some embodiments of the present application, when the display device is connected to at least one external display screen, the controller first obtains the second position information of the mouse cursor on the user interface and the identifier of the target display screen in response to the second movement operation of the user moving the mouse, and then dynamically calls the screen size of the target display screen according to the size correspondence, thereby calculating the distance between the mouse cursor and the screen edge of the external display screen. If the distance meets the boundary condition, the mouse cursor style is rotated in real time and the rotated mouse cursor is drawn.

[0049] In a second aspect, some embodiments of the present application provide a cursor display method, applied to the display device described in the first aspect, the method comprising:

[0050] In response to a first movement operation of the user moving the mouse, obtaining first position information of the mouse cursor on the user interface;

[0051] Calculating a distance between the mouse cursor and an edge of the display screen based on the first position information and the screen size of the display;

[0052] When the distance between the mouse cursor and the edge of the display screen satisfies a boundary condition, rotating the mouse cursor style and drawing the rotated mouse cursor; wherein the display range of the rotated mouse cursor on the user interface is larger than the display range of the mouse cursor on the user interface before the rotation;

[0053] The display is controlled to display the rotated mouse cursor on a user interface.

[0054] As can be seen from the above technical solutions, some embodiments of the present application provide a display device and a cursor display method, wherein the method obtains first position information of the mouse cursor on the user interface in response to a first movement operation of the user moving the mouse, calculates the distance between the mouse cursor and the screen edge of the display based on the first position information and the screen size of the display, and rotates the mouse cursor style when the distance between the mouse cursor and the screen edge of the display satisfies the boundary condition, and draws the rotated mouse cursor, thereby controlling the display to display the rotated mouse cursor on the user interface. When the present application detects that the distance between the mouse cursor and the screen edge of the display satisfies the boundary condition, the mouse cursor is rotated and transformed in real time, so that the rotated mouse cursor is completely located within the user interface, so that when the mouse cursor is located at the edge of the screen, the user can clearly see the position of the mouse cursor. At the same time, based on the rotation of the same mouse cursor, the present application does not need to pre-store multiple sets of mouse cursor image resources at different angles, thereby saving the memory of the display device and improving the operating performance of the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0056] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0057] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0058] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0059] Figure 4 This is a schematic diagram of a mouse cursor moving out of a user interface in some embodiments of the present application;

[0060] Figure 5 A flowchart of a method for executing a cursor display on a display device provided in some embodiments of the present application;

[0061] Figure 6 A timing diagram of a cursor display method executed by a display device provided in some embodiments of the present application;

[0062] Figure 7 This is a schematic diagram of the mouse cursor in the screen display coordinate system;

[0063] Figure 8 Schematic diagram of a first embodiment for calculating the distance between a mouse cursor and a screen edge in some embodiments of the present application;

[0064] Figure 9 A schematic diagram of a second embodiment of calculating the distance between a mouse cursor and a screen edge in some embodiments of the present application;

[0065] Figure 10 A schematic diagram of calculating the distance between a mouse cursor and a screen edge of a display for some embodiments of the present application;

[0066] Figure 11 This is a schematic diagram of a first embodiment of rotating a mouse cursor in some embodiments of the present application;

[0067] Figure 12 This is a schematic diagram of a second embodiment of rotating a mouse cursor in some embodiments of the present application;

[0068] Figure 13 A schematic diagram of a third embodiment of rotating a mouse cursor in some embodiments of the present application;

[0069] Figure 14 This is a schematic diagram of determining a mouse cursor offset according to a target point on a layer surface in some embodiments of the present application;

[0070] Figure 15 A schematic diagram illustrating updating the offset at a first preset angle in some embodiments of the present application;

[0071] Figure 16 A schematic diagram illustrating updating the offset at a second preset angle in some embodiments of the present application;

[0072] Figure 17 A schematic diagram of updating the offset at a third preset angle in some embodiments of the present application;

[0073] Figure 18 A flowchart of the underlying logic for rotating a mouse cursor in some embodiments of the present application;

[0074] Figure 19 Schematic diagram of a display device in different display states provided by some embodiments of the present application;

[0075] Figure 20 A flowchart of querying the screen size when a display device is connected to an external display screen provided in some embodiments of the present application. DETAILED DESCRIPTION

[0076] The embodiments will be described in detail below with reference to examples thereof as illustrated in the accompanying drawings. In the following description, like reference characters designate like or similar elements in different views of the drawings. The embodiments described in the following examples do not represent all of the implementations consistent with the present application. Rather, they are merely examples consistent with some aspects of the present application as detailed in the appended claims.

[0077] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following description of the embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood in accordance with their ordinary and customary meanings.

[0078] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0079] The terms "include" and "have" and any variations thereof are intended to cover but not exclusively include, for example, a product or device that includes a series of components, and is not necessarily limited to all components clearly listed, but can include other components that are not clearly listed or inherent to such products or devices.

[0080] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code capable of performing a function associated with that element.

[0081] In the embodiments of the present application, the display device 200 generally refers to a device having the ability to display pictures and process data. For example, the display device 200 includes but is not limited to a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0082] Figure 1 The schematic diagram of the operation scenario between the display device and the external device is provided for some embodiments of the present application. As shown in Figure 1 , a user can operate the display device 200 through an external device. For example, a mouse, a gamepad, a VR device remote control, etc.

[0083] As shown in Figure 1 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0084] The display device 200 can provide a broadcast receiving television function, and can additionally provide a smart network television function supporting a computer function, including but not limited to a network television, a smart television, an Internet protocol television (IPTV), and the like.

[0085] Figure 2 The display device 200 provided in some embodiments of the present application Figure 1 A hardware configuration block diagram of the display device 200 is shown in FIG. 2.

[0086] In some embodiments, the display device 200 can include at least one of a tuning demodulator 210, a communication component 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0087] In some embodiments, the detector 230 is configured to collect signals of an external environment or an external interaction. For example, the detector 230 can include a light receiver configured to collect an ambient light intensity, or an image collector such as a camera configured to collect an external environment scene, a user attribute, or a user interaction gesture, or a sound collector such as a microphone configured to receive an external sound.

[0088] In some embodiments, the display 260 includes a display function component configured to present a picture, and a driving component configured to drive an image display. The display 260 is configured to receive an image signal output from the controller 250 and display the image signal. For example, the display 260 can be configured to display a video content, an image content, a menu control interface component, and a user control UI interface.

[0089] In some embodiments, the communication component 220 is configured to communicate with an external device or a server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication components 220 according to different supported communication manners. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication component 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication component 220 including a Bluetooth function.

[0090] The communication component 220 can be configured to connect the display device 200 to the external device or the server 400 in a wireless or wired manner. The wired connection can be achieved by connecting the display device 200 to the external device through a data line, an interface, or the like. The wireless connection can be achieved by connecting the display device 200 to the external device through a wireless signal or a wireless network. The display device 200 can be directly connected to the external device, or can be indirectly connected to the external device through a gateway, a router, a connection device, or the like.

[0091] In some embodiments, the controller 250 can include at least one of a central processor, a video processor, an audio processor, a graphic processor, a power processor, a first interface to an n-th interface for input / output, and the controller 250 controls the operation of the display device and responds to the user's operation by controlling various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0092] In some embodiments, the controller 250 and the tuner-demodulator 210 can be located in different separate devices, i.e., the tuner-demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0093] In some embodiments, the user can input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0094] In some embodiments, the audio output device 270 can be a native speaker of the display device 200, or can be an audio output device connected to the display device 200. For the audio output device connected to the display device 200, the display device 200 can also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0095] In some embodiments, the user input interface 280 can be used to receive instructions from the user input.

[0096] In some embodiments, the device interface 240 can also include an external device interface. Based on the interaction mode between the external device and the display device 200, the display device 200 can include a plurality of external device interfaces of different connection types. For example, in the case of wired connection between the external device and the display device 200, the display device 200 can establish a wired communication connection with the external device through the hardware interface of the external device interface. In the case of wireless connection between the external device and the display device 200, the display device 200 can establish a wireless communication connection with the external device through the communication interface of the external device interface.

[0097] The external device can be connected to the display device 200 through the external device interface of the display device 200 to realize the interaction tasks such as signal transmission and data transmission between the external device and the display device 200 through the external device interface.

[0098] The display device 200 can display an operation identifier corresponding to the external device in the user interface in a state of being communicatively connected with the external device. For example, the operation identifier can be a focus identifier or a cursor. Taking the external device as a mouse as an example, the operation identifier can be a mouse cursor. The user can control the position of the mouse cursor in the user interface by moving the mouse to perform an interactive operation.

[0099] To perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0100] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0101] The operating system can be divided into different modules or levels according to the implemented functions. For example, as shown in FIG. 2, in some embodiments, the system is divided into four layers from top to bottom, namely, an application layer (referred to as “application layer” for short), an application framework layer (referred to as “framework layer” for short), a system library layer, and a kernel layer. Figure 3

[0102] In some embodiments, the application layer is used to provide services and interfaces for application programs, so that the display device 200 can run application programs and interact with the user based on the application programs. At least one application program can be run in the application layer. These application programs can be window programs, system setting programs, or clock programs provided by the operating system, or can be application programs developed by third-party developers. In specific implementation, the application programs in the application layer are not limited to the above examples.

[0103] The framework layer provides application programming interfaces (APIs) and programming frameworks for application programs. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center that decides which application program in the application layer to act. The application program can access resources in the system and obtain services of the system through the API interface in execution.

[0104] For example, as shown in FIG. 2, in some embodiments, the framework layer includes a window manager, a resource manager, a package manager, a telephony manager, a location manager, a connectivity manager, a notification manager, a content provider, and a security manager. Figure 3 ​As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0105] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0106] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0107] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0108] It should be noted that the above examples are only a simple division of the operating system functions, and do not constitute a limitation on the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device, the type of the operating system, and other factors, the number and specific type of the levels contained in the operating system can be in other forms.

[0109] In some embodiments, the display device 200 can include different screen sizes to present different visual effects, adapt to different application scenarios and user needs. In order to improve the visual effect, the display device 200 of different screen sizes corresponds to different optimal viewing distances. Compared with the display device 200 with a small screen, the user often watches the display device 200 with a large screen from a position far away from the display device 200.

[0110] It should be noted that large and small screens are a relative concept, which can be determined by the screen size of the display device 200 in the preset application scenario. For example, when the screen size is greater than the preset size threshold, the corresponding display device 200 is a large-screen display device 200. When the screen size is less than or equal to the preset size threshold, the corresponding display device 200 is a small-screen display device 200.

[0111] For this viewing mode, the user can interact with the display device 200 at a distance through an external device. Taking a mouse as an example, the user can hold the mouse and control the mouse to move. When the sensor of the mouse detects that the mouse is in a moving state, a moving event is generated and sent to the display device 200 through a communication connection. The display device 200 can respond to the moving event and synchronously move the position of the mouse cursor in the user interface.

[0112] The operation identifier of the external device can include a response point, which is located in the operation identifier. The response point is an effective position point for interacting with the responsive control in the user interface. For example, when the cursor response point of the mouse cursor is located in the area of the first control in the user interface, the user can click the left mouse button once. At this time, the display device 200 responds to the click event uploaded by the mouse and selects the first control based on the position of the cursor response point.

[0113] The cursor response point can move in the user interface displayed by the display device 200, so that the user can click the corresponding effective position in the user interface through the mouse. When the mouse cursor moves to the edge area of the screen of the display device, such as the right edge or the lower edge or the lower right corner, the screen edge of the display 260 will block the mouse cursor,

[0114] Figure 4 The interface partial enlargement diagram for the mouse cursor located in the lower right corner of the user interface.

[0115] As shown in Figure 4 the dashed part of the mouse cursor is the mouse cursor area moving out of the user interface, and the solid part of the mouse cursor is the visible range of the mouse cursor in the user interface. Due to the shielding of the right edge and the lower edge of the screen to the mouse cursor, when the mouse cursor is near the edge of the screen, a large area of the mouse cursor will move out of the corresponding visible area of the user interface, resulting in a smaller visible range of the mouse cursor, and the user cannot see the position of the mouse cursor in the user interface at a long distance.

[0116] Therefore, the display device 200 can pre-store multiple sets of image resources of the mouse cursor at different angles. When the mouse cursor moves to the edge area, the display device 200 can display image resources at different angles, so that a large area of the mouse cursor is located in the corresponding visible area of the user interface, thereby improving the visibility of the mouse cursor when it is located at the edge of the user interface.

[0117] However, this pre-storing multiple sets of image resources will additionally occupy the memory of the display device 200, resulting in performance loss of the display device 200.

[0118] To solve the problem that the display device pre-stores multiple sets of cursor image resources at different angles when adjusting the angle of the cursor, resulting in performance loss of the display device, some embodiments of the present application provide a display device 200, which includes a display 260 configured to display a user interface, an external device interface configured to communicate with an external device, and a controller 250 configured to execute a cursor display method.

[0119] It should be noted that the present embodiment is exemplarily described by taking the external device as a mouse, and the external device is not limited to this, and other external devices can also adopt the cursor display method of the present embodiment, which will not be described in detail hereinafter.

[0120] Figure 5 The flowchart of the display device provided by some embodiments of the present application executing the cursor display method is shown in the following. Figure 6 The timing diagram of the display device provided by some embodiments of the present application executing the cursor display method is shown in the following. Figure 5 and Figure 6 The method includes the following contents:

[0121] S100: In response to a first moving operation of the user moving the mouse, first position information of the mouse cursor on the user interface is acquired.

[0122] When the user performs the first moving operation on the mouse, the sensor built-in in the mouse will monitor the moving distance and the moving direction of the mouse in real time. The mouse can convert the moving track information into a digital signal and then send it to the display device 200 through communication connection.

[0123] The controller 250 of the display device 200 can parse the movement trajectory information in the digital signal, and move the mouse cursor from a current display position to a target display position in the user interface according to the movement trajectory information.

[0124] In some embodiments, a key is further arranged on the mouse, and the user can perform a key+movement operation on the mouse according to the key. For example, the user can perform a first movement operation on the mouse in a state of long pressing the left key of the mouse. Based on the response effect of the left key of the mouse, the controller 250 can move the mouse cursor and respond to the control instruction generated by the left key of the mouse according to the movement trajectory of the mouse in the user interface.

[0125] After the mouse cursor moves to the target display position, the controller 250 can obtain first position information of the mouse at the target display position, so as to facilitate subsequent judgment of the distance between the mouse cursor and the edge of the screen of the display 260. The first position information can be generated according to the current position information of the mouse cursor and the digital signal. When the mouse cursor is displayed in the user interface, the controller 250 can store the position information of the mouse cursor in the memory through the view system, so as to facilitate calling of the position information of the mouse cursor when the mouse cursor is subsequently moved.

[0126] The first position information can include various forms of representation. For example, the first position information can be represented by cursor response point coordinates of the mouse cursor.

[0127] The cursor response point coordinates include a horizontal coordinate and a vertical coordinate in a screen display coordinate system. The horizontal coordinate is used to represent the width of the mouse cursor in the user interface, and the vertical coordinate is used to represent the height of the mouse cursor in the user interface. In the screen display coordinate system, the top vertex of the left upper corner of the screen can be the coordinate axis origin. Based on the coordinate axis origin, the horizontal direction of the screen is the X axis of the screen display coordinate system, and the vertical direction of the screen is the Y axis of the screen display coordinate system.

[0128] S200: calculating the distance between the mouse cursor and the edge of the screen of the display based on the first position information and the screen size of the display.

[0129] After obtaining the first position information, the controller 250 can obtain the screen size of the display 260. The screen size can include the screen width and the screen height of the display 260.

[0130] After obtaining the screen size, the controller 250 can map the edge of the screen of the display 260 to the screen display coordinate system according to the screen size.

[0131] Figure 7 The schematic diagram of the mouse cursor in the screen display coordinate system.

[0132] As Figure 7As shown, different screen edges correspond to a line segment in the screen display coordinate system respectively, and the line segments are connected in sequence to form a display area corresponding to the user interface, i.e. Figure 7 The area formed by the dashed line portion in the middle. The controller 250 can calculate the distance between the mouse cursor and different line segments respectively to determine the distance between the mouse cursor and the screen edge of the display 260.

[0133] In some embodiments, in order to improve the accuracy of calculating the distance between the mouse cursor and the screen edge of the display 260, the controller 250 can determine a reference point within the mouse cursor. For example, the controller 250 can determine the reference point according to at least the following two ways.

[0134] The first way is that, as shown in FIG. 3B, the controller 250 can take the center point of the mouse cursor as the reference point to determine the distance to the screen edge of the display 260. The controller 250 can traverse the pixel points within the mouse cursor to determine the center point of the mouse cursor. Then, the controller 250 can calculate the distance between the center point of the mouse cursor and each line segment in the screen display coordinate system, i.e. the distance between the mouse cursor and the screen edge of the display 260. Figure 8 The second way is that, as shown in FIG. 3C, the controller 250 can take the pixel point closest to each line segment as the reference point to determine the distance to the screen edge of the display 260. For example, when the controller 250 needs to determine the distance between the mouse cursor and the lower edge of the screen, it can traverse the pixel points within the mouse cursor, calculate the straight-line distance between each pixel point and the lower edge of the screen respectively, and take the pixel point closest to the lower edge of the screen as the reference point. The straight-line distance corresponding to the reference point is the distance between the mouse cursor and the lower edge of the screen.

[0135] Figure 9 In the second way, when calculating the distance between the mouse cursor and different screen edges, the controller 250 can take the pixel point closest to the corresponding screen edge as the reference point. For example, when calculating the distance between the mouse cursor and the left edge of the screen, the pixel point closest to the left edge of the screen is taken as the reference point. When calculating the distance between the mouse cursor and the right edge of the screen, the pixel point closest to the right edge of the screen is taken as the reference point.

[0136] In the second way, when calculating the distance between the mouse cursor and different screen edges, the controller 250 can take the pixel point closest to the corresponding screen edge as the reference point. For example, when calculating the distance between the mouse cursor and the left edge of the screen, the pixel point closest to the left edge of the screen is taken as the reference point. When calculating the distance between the mouse cursor and the right edge of the screen, the pixel point closest to the right edge of the screen is taken as the reference point.

[0137] S300: In the case that the distance between the mouse cursor and the screen edge of the display meets the boundary condition, rotate the mouse cursor style, and draw the rotated mouse cursor.

[0138] ​When the mouse cursor is close to the edge of the screen, part of the mouse cursor can move out of the visual area of the user interface, causing the user to be unable to see the position of the cursor. Therefore, the controller 250 needs to rotate the mouse cursor style when the mouse cursor moves to the edge of the screen of the display 260 to meet the boundary condition, and draw the rotated mouse cursor in the user interface.

[0139] The boundary condition can be a condition for determining that the mouse cursor needs to be rotated, which is preset by the controller 250 according to the size of the screen. When the user moves the mouse, the controller 250 updates the position of the mouse cursor in the user interface, and then determines whether the distance between the updated mouse cursor and the edge of the screen meets the boundary condition. If so, the controller 250 rotates the mouse cursor style to display the rotated mouse cursor.

[0140] If the distance between the mouse cursor and the edge of the screen does not meet the boundary condition, the controller 250 does not perform the rotation operation on the mouse cursor style.

[0141] Through rotation, the controller 250 can rotate the part of the mouse cursor that moves out of the visual area of the user interface into the visual area of the user interface, and the display range of the mouse cursor on the user interface after rotation is larger than that before rotation, so that the user can see the position of the mouse cursor.

[0142] In some embodiments, the controller 250 can perform a rotation operation on the mouse cursor style according to a preset angle, which can be a specific angle such as 30°, 45°, 60°, 90°, or 180°, or an angle with any value. Based on the position of the mouse cursor and the display range after rotation, the controller 250 can determine the angle at which the mouse cursor needs to be rotated to make the display range after rotation the maximum display range. The controller 250 can also set the rotation direction of the mouse cursor style, such as clockwise or counterclockwise. Among them, based on different rotation directions, the rotation angle can also be different.

[0143] S400: The controller controls the display to display the rotated mouse cursor on the user interface.

[0144] After drawing the rotated mouse cursor, the controller 250 can control the display 260 to display the rotated mouse cursor on the user interface, so that the user can see the adjusted user interaction according to the rotated mouse cursor in the user interface.

[0145] Based on the above technical solutions, the embodiment solves the problem of the cursor moving out of the visible area during long-distance operation by dynamically rotating the cursor style. The controller performs real-time rotation transformation on the mouse cursor when it is detected that the distance between the mouse cursor and the edge of the screen of the display meets the boundary condition. After rotation, the display range of the mouse cursor on the user interface is greater than the display range of the mouse cursor on the user interface before rotation, for example, the tail of the arrow cursor is turned to the inside of the screen to avoid the main body of the cursor being blocked by the edge of the screen. Compared with pre-storing multiple sets of image resources of mouse cursors, the embodiment reduces the image resources of the mouse cursors to be stored by performing rotation operation on a single mouse cursor, reduces memory occupation, and reduces performance loss of the display device 200 caused by image resource loading.

[0146] In some embodiments, the display device 200 includes multiple screen edges, such as the upper edge, the lower edge, the left edge, and the right edge. The upper edge and the lower edge correspond to the screen width of the screen size, and the left edge and the right edge correspond to the screen height of the screen size.

[0147] When the distance between the mouse cursor and at least one screen edge meets the boundary condition, the controller 250 can rotate the mouse cursor style. To this end, the controller 250 needs to determine the distance between the mouse cursor and the edge of the screen of the display according to the screen height and the screen width.

[0148] Based on this, step S200 can include steps S210-S220.

[0149] S210: Based on the first coordinate in the first position information and the screen width in the screen size, calculate the first distance between the mouse cursor and the right edge of the screen of the display.

[0150] The first position information can include a first coordinate and a second coordinate, the first coordinate can be the horizontal coordinate of the reference point of the mouse cursor, and the second coordinate can be the vertical coordinate of the reference point of the mouse cursor. The controller 250 can determine the first distance between the mouse cursor and the right edge of the screen of the display according to the first coordinate and the screen width in the screen size. In the screen display coordinate system, the horizontal coordinate of the right edge of the screen can be the screen width, and the horizontal coordinate of the left edge of the screen can be 0.

[0151] Figure 10 The diagram for calculating the distance between the mouse cursor and the edge of the screen of the display for some embodiments of the present application. Referring to Figure 10 The controller 250 can determine the first distance between the mouse cursor and the right edge of the screen of the display 260 by calculating the difference between the horizontal coordinate of the right edge of the screen and the first coordinate. For example, when the horizontal coordinate of the right edge of the screen is x1 and the first coordinate is x2, the first distance can be represented as x1-x2.

[0152] S220: Calculate the second distance between the mouse cursor and the lower edge of the screen based on the second coordinate in the first position information and the screen height in the screen size.

[0153] Continuing to refer to Figure 10 In the screen display coordinate system, the ordinate of the upper edge of the screen can be 0, and the absolute value of the ordinate of the lower edge of the screen can be the screen height. The controller 250 can determine the second distance between the mouse cursor and the lower edge of the screen 260 by calculating the difference between the ordinate of the lower edge of the screen and the second coordinate. For example, when the abscissa of the lower edge of the screen is y1 and the second coordinate is y2, the second distance can be represented as |y1-y2|.

[0154] It should be noted that in the above embodiments, the mouse cursor orientation is taken as an example of the upper left corner. When the mouse cursor orientation is the upper left corner, the mouse cursor will move out of the visible area of the user interface when moving to the right edge of the screen and the lower edge of the screen. When the mouse cursor moves to the left edge of the screen and the upper edge of the screen, the left edge of the screen and the upper edge of the screen will limit the cursor response point of the upper right corner of the mouse cursor from moving out of the visible area of the user interface, so the mouse cursor will always be located to the right of the left edge of the screen and below the upper edge of the screen, and will not move out of the visible area of the user interface from the left edge of the screen and the upper edge of the screen.

[0155] In some embodiments, when the display device 200 runs an application, the application will display the mouse cursor symmetrically in the corresponding user interface based on different positions of the mouse cursor. For example, when the mouse cursor is located in the left area of the user interface, the mouse cursor is flipped symmetrically, at which time the orientation of the mouse cursor is changed from the upper left corner to the upper right corner. In the left area of the user interface, when the mouse cursor moves to the left edge of the screen and the lower edge of the screen, the mouse cursor moves out of the visible area of the user interface.

[0156] Therefore, the controller 250 can also calculate the distance between the mouse cursor and the left edge of the screen synchronously according to the first distance. When the reference point is the center point of the mouse cursor, the controller 250 can calculate the difference between the screen width and the first distance to obtain the distance between the mouse cursor and the left edge. When the reference point is the pixel point of the mouse cursor closest to the left edge of the screen, the controller 250 can calculate the screen width minus the first distance and the width of the mouse cursor, respectively, to obtain the distance between the mouse cursor and the left edge. The width of the mouse cursor is the coordinate difference between the maximum abscissa of the pixel point and the minimum abscissa of the pixel point in the mouse cursor.

[0157] Based on the above technical solution, this embodiment determines the display area of ​​the mouse cursor that is frequently blocked by the right edge and the bottom edge of the screen. The controller 250 can obtain the coordinate data in the first position information, calculate the first distance from the right edge in combination with the screen width, and calculate the second distance from the bottom edge in combination with the screen height. This mechanism of independently calculating the distances to the right and bottom edges of the screen ensures that when the user moves the mouse toward the lower right corner of the screen, the display device 200 can simultaneously identify the critical state of the two directions, avoiding the delayed rotation of the mouse cursor caused by the response of unilateral detection.

[0158] In some embodiments, the controller 250 may set a variety of different boundary conditions based on the first distance and the second distance, and different boundary adjustments may correspond to different rotation angles. If the first distance and / or the second distance meet the boundary conditions, the controller 250 may rotate the mouse cursor style according to the rotation angle corresponding to the boundary conditions.

[0159] Based on this, step S300 may include steps S310-S340.

[0160] S310: Setting a preset threshold, where the preset threshold includes a first preset threshold in the screen width direction and a second preset threshold in the screen height direction.

[0161] Controller 250 may determine a preset threshold based on the image size relative to the mouse cursor. Based on the screen width and screen height, the preset threshold may include a first preset threshold in the screen width direction and a second preset threshold in the screen height direction. The second preset threshold may be used to determine the first distance and the second preset threshold to determine the second distance. Image size may include width and length. Controller 250 may determine the preset threshold based on a preset multiple of the image size. For example, 1 / 3 of the width may be set as the first preset threshold, and 1 / 3 of the height may be set as the second preset threshold.

[0162] S320: When the first distance between the mouse cursor and the right edge of the screen is less than a preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is less than a preset threshold, rotate the mouse cursor style according to the first angle.

[0163] In some embodiments, before rotating the mouse cursor style, the user interface may be divided into regions to determine the user interface partition where the mouse cursor is located. Controller 250 may divide the user interface according to a preset screen width and screen height, for example, dividing the user interface into four user interface partitions in the shape of a Chinese character "田" (a Chinese character for "田"), each partitioning the user interface into 1 / 2 the screen width and 1 / 2 the screen height.

[0164] For example, when the mouse cursor enters the lower right corner of the user interface partition, the controller 250 can perform a determination on the first distance of the mouse cursor and the second distance of the mouse cursor by a preset threshold. In a case where the first distance between the mouse cursor and the right edge of the screen is less than the preset threshold and the second distance between the mouse cursor and the lower edge of the screen is less than the preset threshold, it is indicated that the mouse cursor is located at the angle formed by the right edge of the screen and the lower edge of the screen, i.e., the lower right corner of the user interface. In the lower right corner of the user interface, part of the mouse cursor can be out of the visual area of the user interface, such as part of the mouse cursor being located to the right of the right edge of the screen and to the lower side of the lower edge of the screen, so that the user cannot see the position of the mouse cursor.

[0165] In this case, the controller 250 can rotate the mouse cursor pattern by a first angle as shown in FIG. 6A, so that the rotated mouse cursor is displayed again in the visual area of the user interface, to facilitate the user to watch the mouse cursor. Figure 11

[0166] In some embodiments, the controller 250 can set a corresponding rotation angle according to the area where the mouse cursor is located, so that the visual range of the mouse cursor after rotation based on the angle is maximum. To this end, the controller 250 can traverse the visual range of the mouse cursor after rotation by each angle in a case where the mouse cursor is located in the lower right corner of the screen, and set the angle corresponding to the maximum visual range as the first angle.

[0167] S330: In a case where the first distance between the mouse cursor and the right edge of the screen is less than the preset threshold and the second distance between the mouse cursor and the lower edge of the screen is greater than or equal to the preset threshold, rotate the mouse cursor pattern by a second angle.

[0168] When the mouse cursor is located in the lower right corner of the user interface partition or the upper right corner of the user interface partition, the controller 250 can perform a determination on the first distance of the mouse cursor and the second distance of the mouse cursor by a preset threshold. In a case where the first distance between the mouse cursor and the right edge of the screen is less than the preset threshold and the second distance between the mouse cursor and the lower edge of the screen is greater than or equal to the preset threshold, it is indicated that the mouse cursor is located in the right edge area of the screen. In the right edge area of the screen, part of the mouse cursor is located to the right of the right edge of the screen, i.e., out of the visual area of the user interface, so that the user cannot see the mouse cursor on the right edge of the screen. At this time, the controller 250 can rotate the mouse cursor pattern by a second angle.

[0169] The controller 250 can traverse the visual range of the mouse cursor after rotation by each angle in a case where the mouse cursor is located in the right edge of the screen, and set the angle corresponding to the maximum visual range as the second angle.

[0170] ​In this case, the controller 250 may Figure 12 The second angle shown rotates the mouse cursor style so that the rotated mouse cursor is again displayed within the visible area of ​​the user interface, making it easier for the user to view the mouse cursor.

[0171] S340: When the first distance between the mouse cursor and the right edge of the screen is greater than or equal to a preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is less than the preset threshold, rotate the mouse cursor style according to a third angle.

[0172] When the mouse cursor is located in the user interface partition in the lower left corner or the user interface partition in the lower right corner, the controller 250 can perform a judgment on the first distance and the second distance of the mouse cursor based on a preset threshold. When the first distance between the mouse cursor and the right edge of the screen is greater than or equal to the preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is less than the preset threshold, it means that the mouse cursor is located in the bottom edge area of ​​the screen. In the bottom edge area of ​​the screen, part of the mouse cursor may be located to the right of the bottom edge of the screen, that is, moved out of the visible area of ​​the user interface, and the user cannot see the mouse cursor clearly at the bottom edge of the screen. At this time, the controller 250 can rotate the mouse cursor style according to the second angle.

[0173] When the mouse cursor is at the bottom boundary of the screen, the controller 250 may traverse the visible range of the mouse cursor after being rotated at various angles, and set the angle corresponding to the maximum visible range as the third angle.

[0174] In this case, the controller 250 may Figure 13 The third angle shown rotates the mouse cursor style so that the rotated mouse cursor is displayed again within the visible area of ​​the user interface, making it easier for the user to view the mouse cursor.

[0175] It should be noted that Figure 11-13 The mouse cursor style is rotated under the assumption that the entire mouse cursor is within the user interface and that boundary conditions are met. In actual applications, the mouse cursor may also partially move outside the user interface. In this case, the mouse cursor style can also be rotated using steps S320-S340.

[0176] In some embodiments, before the controller 250 rotates the mouse cursor pattern, a target point for rotation can be set. During the rotation of the mouse cursor pattern, the mouse cursor pattern can be rotated around the target point. For example, the controller 250 can use the cursor response point or the center point of the mouse cursor as the target point for rotation.

[0177] In some embodiments, the controller 250 can also update the mouse cursor according to the rotation angle corresponding to the different edge regions when the mouse cursor moves between the different edge regions. For example, when the mouse cursor is located in the lower edge region of the screen, the controller 250 rotates the mouse cursor style according to a third angle. In response to the user moving the mouse to the right, the first distance between the mouse cursor and the right edge decreases. When the first distance is less than a preset threshold, the controller 250 completes the operation of moving the mouse cursor from the lower edge region of the screen to the lower right corner region of the screen. At this time, the controller 250 needs to update the moved mouse cursor according to the first angle.

[0178] In some embodiments, the controller 250 can rotate according to the first angle based on the original mouse cursor style. In this process, the controller 250 needs to rotate the current (located in the lower edge region of the screen) mouse cursor in the opposite direction by the third angle to reset. After resetting the mouse cursor, the controller 250 rotates the mouse cursor according to the rotation direction corresponding to the lower right corner region of the screen by the first angle to complete the rotation angle update of the mouse cursor.

[0179] In an alternative implementation, the controller 250 can also calculate the difference between the two rotation angles before and after the movement. Using the above example, the controller 250 can calculate the angle difference between the first angle and the third angle, and continue to rotate the mouse cursor style based on the angle difference and the rotation direction to update the moved mouse cursor.

[0180] Based on the above technical solutions, different rotation strategies are set according to the different mouse cursor movement positions. When the first distance between the mouse cursor and the right edge of the screen is less than the preset threshold, and the second distance between the mouse cursor and the lower edge of the screen is less than the preset threshold, the mouse cursor style is rotated according to the first angle. When the first distance is less than the preset threshold and the second distance is greater than or equal to the preset threshold, the mouse cursor style is rotated according to the second angle. When the first distance is greater than or equal to the preset threshold and the second distance is less than the preset threshold, the mouse cursor style is rotated according to the third angle. Thus, according to the different positions of the mouse cursor, the mouse cursor is rotated according to different angles, and the visible range of the mouse cursor after performing the rotation in different positions is improved.

[0181] In some embodiments, as Figure 14As shown, the controller 250 can also set a target point in the graphical surface where the mouse cursor is located. The graphical surface corresponds to a single view coordinate system, and the view coordinate system takes the top-left corner of the graphical surface as the origin. In order to transfer the event processing logic of the cursor response point of the mouse cursor to the application view layer corresponding to the user interface, the controller 250 needs to offset the cursor response point to the origin of the view coordinate system. Based on this, the controller 250 can calculate the offset between the cursor response point and the target point. The offset can include a horizontal coordinate offset and a vertical coordinate offset in the view coordinate system.

[0182] When the target point is the origin of the view coordinate system, after the controller 250 rotates the mouse cursor style, the relative positions of the target point and the cursor response point do not change, but since the position of the cursor response point changes, the controller 250 also needs to update the offset between the cursor response point and the target point based on the rotation angle of the mouse cursor.

[0183] Figure 14 The offset of the mouse cursor after rotation provided by some embodiments of the present application is shown in the figure.

[0184] As shown in the figure, Figure 14 the mouse cursor in the dashed line part is the mouse cursor before rotation, and the mouse cursor in the solid line part is the mouse cursor after rotation. The rectangular frame outside the mouse cursor is the layer area where the mouse cursor is located. hotSportX is the horizontal coordinate offset of the mouse cursor before performing rotation, and hotSportY is the vertical coordinate offset of the mouse cursor before performing rotation. Since the position of the cursor response point of the mouse cursor changes after rotation, the offset also changes. Referring back to Figure 14 , hotSportX' is the horizontal coordinate offset of the mouse cursor after performing rotation, and hotSportY' is the vertical coordinate offset of the mouse cursor after performing rotation. The controller 250 can update the offset of the mouse cursor before performing rotation according to the offset of the mouse cursor after rotation.

[0185] It should be noted that Figure 14 the offset shown in the figure is only used as an example to illustrate one angle, and offsets for other rotation angles can be calculated in the same way as described above, which will not be described here again.

[0186] In some embodiments, the first angle, the second angle, and the third angle can be specific angle values selected based on a preset angle range. The first angle, the second angle, and the third angle can be 30°, 45°, 60°, 90°, and 180°, respectively. The controller 250 can combine trigonometric functions to calculate the horizontal coordinate offset and the vertical coordinate offset when the rotation angle is a special angle value.

[0187] The first angle, the second angle, and the third angle can also be other angle values other than the special angle values. For other angle values, the offset of the cursor response point when the other angle values are rotated can be calculated according to the rotation angle and a trigonometric function.

[0188] In some embodiments, as shown in FIG. 6, the rotation angle θ = a + 90° is taken as a non-special angle for an exemplary illustration. The controller 250 can calculate the included angle b between the straight line between the cursor response point and the target point and the Y-axis of the view coordinate system according to hotSportX and hotSportY. The included angle b = arctan(hotSportX / hotSportY). Figure 15

[0189] Based on the expression of the included angle b, the final expression is which is the offset of the horizontal coordinate after rotation. which is the offset of the vertical coordinate after rotation.

[0190] As shown in FIG. 7, the rotation angle θ = a + 180° is taken as another non-special angle for an exemplary illustration. Figure 16 which is the offset of the horizontal coordinate after rotation.

[0191]

[0192] which is the offset of the vertical coordinate after rotation.

[0193] As shown in FIG. 8, the rotation angle θ = a + 180° is taken as another non-special angle for an exemplary illustration. Figure 17 which is the offset of the horizontal coordinate after rotation. which is the offset of the vertical coordinate after rotation.

[0194] After obtaining the offsets, the controller 250 can offset the horizontal coordinate of the rotated mouse cursor according to the horizontal coordinate offset, and offset the vertical coordinate of the rotated mouse cursor according to the vertical coordinate offset, so as to determine the offset position of the target point, and draw the rotated mouse cursor based on the offset position.

[0195] Based on the above technical solutions, the target point of the layer surface where the mouse cursor is located is taken as the rotation point for rotation, and then the offsets of the cursor response point and the target point in different coordinate systems are calculated, and the position of the mouse cursor is repositioned and drawn according to the offsets, so as to ensure the click accuracy of the event processing logic of the mouse cursor.

[0196] ​​​In some embodiments, the method further comprises step S500.

[0197] S500: in the case that the distance between the mouse cursor and the edge of the display screen does not satisfy the boundary condition, drawing the mouse cursor style and controlling the display to display the drawn mouse cursor on the user interface.

[0198] After the controller 250 obtains the first distance and the second distance, if the first distance is greater than or equal to the preset threshold value and the second distance is greater than or equal to the preset threshold value, it indicates that the mouse cursor is located in the non-screen edge area, and the mouse cursor style can be directly drawn, and the drawn mouse cursor can be displayed on the user interface.

[0199] In some embodiments, when the mouse cursor moves from satisfying the boundary condition to not satisfying the boundary condition, the controller 250 can perform a reset operation on the mouse cursor style, that is, rotate the same angle in the opposite direction based on the rotation direction, thereby resetting the rotated mouse cursor, and controlling the display 260 to display the reset mouse cursor on the user interface.

[0200] Based on the above technical solutions, when the distance between the cursor and the edge of the screen does not satisfy the boundary condition, the default style is automatically switched back, avoiding visual interference caused by invalid rotation.

[0201] In some embodiments, the controller 250 can also update the screen size according to the display state change of the display 260. The display state of the display 260 includes a horizontal screen state and a vertical screen state. In different display states, the screen size of the display 260 is also different. Based on this, step S200 further comprises step S230.

[0202] S230: determining the distance between the mouse cursor and the edge of the screen of the display based on the first position information and the screen size corresponding to the display state of the display.

[0203] When the display state is a horizontal screen state, the controller 250 can obtain the horizontal screen size of the display 260 in the horizontal screen state, and based on the horizontal coordinate and the vertical coordinate of the first position information, determine the distance between the mouse cursor and the edge of the screen of the display according to the horizontal screen width size and the horizontal screen height size.

[0204] When the display state is a vertical screen state, the controller 250 can obtain the vertical screen size of the display 260 in the vertical screen state, and based on the vertical coordinate and the vertical coordinate of the first position information, determine the distance between the mouse cursor and the edge of the screen of the display according to the vertical screen width size and the vertical screen height size.

[0205] Wherein, the way to determine the distance between the mouse cursor and the edge of the screen of the display can refer to steps S210-S220, which will not be repeated here.

[0206] Based on the above technical solutions, the embodiment can determine the distance between the mouse cursor and the edge of the screen of the display 260 according to the first position information and the screen size corresponding to the display state of the display 260, so as to determine the position of the mouse cursor according to the screen size of different display states, so as to adaptively calibrate the accuracy of recognizing the position of the mouse cursor according to the rotated display 260.

[0207] In some embodiments, the display device 200 can include a mouse cursor controller (MouseCursorController) and a pointer controller (SpriteController) in the view system. The rotation of the mouse cursor style performed by the controller 250 can be implemented through the mouse cursor controller and the pointer controller. The following describes the underlying logic of the display device 200 for controlling the rotation of the mouse cursor based on the mouse cursor controller and the pointer controller.

[0208] As shown in Figure 18 , the controller 250 can receive the mouse upload movement event through the mouse cursor controller. The mouse cursor controller analyzes the movement trajectory and the position after movement of the mouse in the user interface in response to the movement event, and at the same time, obtains the screen size of the display 260, and sends the movement trajectory, the position after movement, and the screen size to the pointer controller for subsequent processing. The pointer controller is responsible for drawing the mouse cursor. After receiving the display size, the pointer controller can send the drawing information of the mouse cursor to the display processor according to the drawing logic corresponding to the boundary condition according to the movement trajectory, the position after movement, and the screen size, and display the drawn mouse cursor through the display 260.

[0209] In some embodiments, when the user rotates the display 260, the controller 250 can update the display state of the display 260 in response to the rotation operation of rotating the screen of the display 260. When the display state changes, the controller 250 controls the mouse cursor controller to obtain and store the screen size after rotation. For example, as shown in Figure 19 , when the display state changes from the horizontal state, i.e., the (a) display state in Figure 19 , to the vertical state, i.e., the (b) display state in Figure 19 , the controller 250 controls the mouse cursor controller to obtain and store the screen size corresponding to the vertical state.

[0210] The mouse cursor controller transmits the rotated screen size to the pointer controller. After receiving the rotated screen size, the pointer controller can update the screen size of the display 260 to the rotated screen size. Since the screen size changes, the pointer controller needs to update the screen display coordinate system according to the rotated display 260. In the new screen display coordinate system, the rotated screen width is the screen length before rotation, and the rotated screen length is the screen width before rotation.

[0211] After updating the screen display coordinate system, the pointer controller can recalculate the distance between the mouse cursor and the edge of the display 260 screen according to the first position information and the rotated screen size to determine whether the boundary condition is met. If the boundary condition is met, the controller 250 can perform steps S320-S340 to perform corresponding rotation operations on the mouse cursor. If the boundary condition is not met, the controller 250 can perform step S500 to control the display 260 to display the drawn mouse cursor on the user interface.

[0212] Based on the above technical solutions, the present embodiment realizes real-time updating and transmission of the rotated screen size through the cooperative control of the mouse cursor controller and the pointer controller during screen rotation, so as to update the position of the mouse cursor according to the rotated screen size, and solves the misalignment of the mouse cursor display caused by the change of the screen direction.

[0213] In some embodiments, the display device 200 can also connect an external display screen to synchronize the display of the user interface through the external display screen. The display device 200 can establish a connection relationship in a preset format with the external display screen through a display interface in the device interface 240, such as connecting through an HDMI data line to transmit picture data based on HDMI. The external display screen can display the same user interface as the display device 200, or can combine with the display device 200 to display the same user interface, that is, the external display screen displays a part of the user interface, and the display device 200 displays another part of the user interface.

[0214] In the case where the display device 200 is connected to at least one external display screen, the controller 250 can obtain the second position information of the mouse cursor on the user interface and the identifier of the target display screen where the mouse cursor is located in response to the second movement operation of the user moving the mouse. The target display screen includes the external display screen.

[0215] As Figure 20As shown, the controller 250 can obtain the size correspondence relationship on the external display screen when the display device 200 is connected to the external display screen. The size correspondence relationship includes a plurality of display screen identifiers and the screen size corresponding to each display screen identifier. When the mouse cursor is located on the target display screen, the screen size corresponding to the target display screen can be queried in the size correspondence relationship according to the display screen identifier of the target display screen.

[0216] The controller 250 can transmit the screen size corresponding to the target display screen to the pointer controller through the mouse cursor controller, so as to update the original screen size to the screen size corresponding to the target display screen through the pointer controller. After the update is completed, the controller 250 can calculate the distance between the mouse cursor and the screen edge of the target display screen based on the second position information and the screen size of the target display screen through the pointer controller.

[0217] In the case where the distance between the mouse cursor and the screen edge of the target display screen meets the boundary condition when the mouse cursor moves, the mouse cursor style is rotated, and the rotated mouse cursor is drawn, so that the target display screen displays the rotated mouse cursor on the user interface.

[0218] Wherein, the distance between the mouse cursor and the screen edge of the target display screen is calculated, and the mouse cursor style is rotated according to whether the boundary condition is met. The details can be referred to the foregoing embodiments, which will not be described here.

[0219] Based on the above technical solutions, when the display device is connected to at least one external display screen, the controller first obtains the second position information of the mouse cursor on the user interface and the identifier of the target display screen in response to the second moving operation of the user moving the mouse, and then dynamically calls the screen size of the target display screen according to the size correspondence relationship, so as to calculate the distance between the mouse cursor and the screen edge of the external display screen. If the distance meets the boundary condition, the mouse cursor style is rotated in real time and the rotated mouse cursor is drawn, which improves the visual range of the mouse cursor in the external display screen, and at the same time, can avoid the rotation operation of the mouse cursor being triggered by mistake in the scenario of multiple display screens.

[0220] Based on the display device 200 provided in the foregoing embodiments, some embodiments of the present application further provide a cursor display method applied to the display device 200. The method comprises:

[0221] S100: In response to a first moving operation of a user moving a mouse, first position information of a mouse cursor on a user interface is obtained;

[0222] S200: Based on the first position information and the screen size of the display, the distance between the mouse cursor and the screen edge of the display is determined;

[0223] S300: in a case where the distance between the mouse cursor and the edge of the screen of the display meets the boundary condition, rotating the mouse cursor style, and drawing the rotated mouse cursor; wherein the display range of the rotated mouse cursor on the user interface is larger than the display range of the mouse cursor on the user interface before being rotated.

[0224] S400: controlling the display to display the rotated mouse cursor on the user interface.

[0225] It can be known from the above technical solutions that some embodiments of the present application provide a display device and a cursor display method. The method obtains first position information of a mouse cursor on a user interface in response to a first moving operation of a user moving a mouse, calculates a distance between the mouse cursor and an edge of a screen of a display based on the first position information and a screen size of the display, rotates a mouse cursor style in a case where the distance between the mouse cursor and the edge of the screen of the display meets a boundary condition, and draws a rotated mouse cursor, thereby controlling the display to display the rotated mouse cursor on the user interface. The present application rotates the mouse cursor in real time when it is detected that the distance between the mouse cursor and the edge of the screen of the display meets the boundary condition, so that the rotated mouse cursor is entirely located within the user interface, and the user can clearly see the position of the mouse cursor when the mouse cursor is located at the edge of the screen. Meanwhile, the present application can not pre-store multiple sets of image resources of the mouse cursor at different angles based on the rotation of the same mouse cursor, thereby saving the memory amount of the display device and improving the operation performance of the display device.

[0226] The same and similar parts among various embodiments in the specification can be referred to each other, and will not be described here again.

[0227] Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the method of various embodiments or some parts of the embodiments of the present application.

[0228] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit the present application; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can still be modified, or some or all of the technical features can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0229] The foregoing description has been presented for the purpose of illustration and description. It is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Modifications and variations are possible in light of the above teachings or can be acquired from practice of the embodiments. The described embodiments were chosen and described in order to best explain the principles of the embodiments and its practical application. This enables others skilled in the art to best use the embodiments in various embodiments and with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; An external device interface, configured to communicate with an external device; wherein the external device includes a mouse; a controller coupled to the display and the external device interface and configured to: In response to a first movement operation of the user moving the mouse, obtaining first position information of the mouse cursor on the user interface; Calculating a distance between the mouse cursor and an edge of the display screen based on the first position information and the screen size of the display; When the distance between the mouse cursor and the edge of the display screen satisfies a boundary condition, rotating the mouse cursor style and drawing the rotated mouse cursor; wherein the display range of the rotated mouse cursor on the user interface is larger than the display range of the mouse cursor on the user interface before the rotation; The display is controlled to display the rotated mouse cursor on a user interface.

2. The display device according to claim 1, wherein The screen edge of the display includes a bottom screen edge and a right screen edge, and the controller calculates the distance between the mouse cursor and the screen edge of the display based on the first position information and the screen size of the display, and is specifically configured as follows: Calculate a first distance between the mouse cursor and a right edge of the display screen based on the first coordinate in the first position information and the screen width in the screen size; A second distance between the mouse cursor and a bottom edge of the display screen is calculated based on the second coordinate in the first position information and the screen height in the screen size.

3. The display device according to claim 2, wherein The controller executes rotating the mouse cursor style when the distance between the mouse cursor and the screen edge of the display satisfies a boundary condition, and is specifically configured as follows: Setting a preset threshold, wherein the preset threshold includes a first preset threshold in a screen width direction and a second preset threshold in a screen height direction; When the first distance between the mouse cursor and the right edge of the screen is less than the first preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is less than the second preset threshold, rotating the mouse cursor style according to the first angle; When the first distance between the mouse cursor and the right edge of the screen is less than the first preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is greater than or equal to the second preset threshold, rotating the mouse cursor style according to a second angle; When the first distance between the mouse cursor and the right edge of the screen is greater than or equal to the first preset threshold, and the second distance between the mouse cursor and the bottom edge of the screen is less than the second preset threshold, the mouse cursor style is rotated according to a third angle.

4. The display device according to claim 3, wherein The preset threshold is determined based on the icon size of the mouse cursor.

5. The display device according to claim 1, wherein The controller executes rotating the mouse cursor style and drawing the rotated mouse cursor when the distance between the mouse cursor and the screen edge of the display satisfies a boundary condition, and is specifically configured as follows: The controller executes, when the distance between the mouse cursor and the edge of the display screen satisfies a boundary condition, rotating the mouse cursor style with a target point in the graphic surface where the mouse cursor is located as a rotation point; determining an offset between a cursor response point of the mouse cursor and the target point based on a rotation angle of the mouse cursor; An offset position of the target point is determined based on the offset amount, and the rotated mouse cursor is drawn based on the offset position of the target point.

6. The display device according to any one of claims 1 to 5, characterized in that: The controller is further configured to: When the distance between the mouse cursor and the edge of the display screen does not meet the boundary condition, a mouse cursor pattern is drawn, and the display is controlled to display the drawn mouse cursor on the user interface.

7. The display device according to any one of claims 1 to 5, characterized in that: The display state of the display includes a horizontal screen state or a vertical screen state, and the controller determines the distance between the mouse cursor and the screen edge of the display based on the first position information and the screen size of the display, and is further configured to: The distance between the mouse cursor and the screen edge of the display is determined based on the first position information and the screen size corresponding to the display state of the display.

8. The display device according to claim 7, wherein: The controller is further configured to: In response to a rotation operation of rotating the screen of the display, controlling the mouse cursor controller to obtain and store a size of the screen after rotation; Controlling the mouse cursor controller to transmit the rotated screen size to the pointer controller; The pointer controller is controlled to update the screen size of the display to the rotated screen size.

9. The display device according to any one of claims 1 to 5, characterized in that: The controller is further configured to: When the display device is connected to at least one external display screen, in response to a second movement operation of the user moving the mouse, obtaining second position information of the mouse cursor on the user interface and an identifier of a target display screen where the mouse cursor is located; wherein the target display screen includes the external display screen; Determine the screen size of the target display screen according to the corresponding relationship between the identifier and size of the target display screen; wherein the corresponding relationship includes multiple display screen identifiers and the screen size corresponding to each of the display screen identifiers; Calculating the distance between the mouse cursor and the screen edge of the target display screen based on the second position information and the screen size of the target display screen; When the distance between the mouse cursor and the screen edge of the target display screen satisfies the boundary condition, rotating the mouse cursor style and drawing the rotated mouse cursor; The target display screen is controlled to display the rotated mouse cursor on a user interface.

10. A cursor display method, characterized in that: The method is applied to a display device, the display device comprising a display configured to display a user interface; an external device interface configured to communicate with an external device; wherein the external device comprises a mouse; and a controller coupled to the display and the external device interface. The method comprises: In response to a first movement operation of the user moving the mouse, obtaining first position information of the mouse cursor on the user interface; Calculating a distance between the mouse cursor and an edge of the display screen based on the first position information and the screen size of the display; When the distance between the mouse cursor and the edge of the display screen satisfies a boundary condition, rotating the mouse cursor style and drawing the rotated mouse cursor; wherein the display range of the rotated mouse cursor on the user interface is larger than the display range of the mouse cursor on the user interface before the rotation; The display is controlled to display the rotated mouse cursor on a user interface.

Images