Cursor prompt method and host

Abstract

The embodiment of the present application provides a cursor prompt method and a host, in which a cursor search operation is detected and the position information of the cursor is obtained; a first visual indication element is displayed on a first display screen according to the position information of the cursor, and the first visual indication element is used to indicate the position of the cursor; the first display screen is a display screen other than the display screen to which the cursor belongs; it is determined that a first termination condition is satisfied, and the display of the first visual indication element is terminated. The embodiment of the present application can enable a user to find a cursor on a display screen relatively quickly in a multi-screen sharing keyboard and mouse scenario, thereby enhancing the user experience.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a cursor prompt method and a host. Background Art

[0002] The multi-screen sharing keyboard and mouse scenario refers to using a set of keyboard and mouse to control multiple displays at the same time. The most common multi-screen sharing keyboard and mouse scenarios are the extended screen scenario and the keyboard and mouse sharing scenario. Multi-screen display can help users improve work efficiency, but when using a set of keyboard and mouse, it is often difficult to find the cursor on the display interface of the display because there are too many displays.

[0003] When using a single display screen, the user can find the cursor's position on the display screen by shaking the mouse to make the cursor shake. However, in a multi-screen scenario, since there are multiple displays, if the user is not facing the correct display screen, it is difficult to find the shaking cursor, which greatly increases the difficulty for the user to find the cursor. Summary of the invention

[0004] The present application provides a cursor prompt method and a host, which can enable a user to find the cursor on the display screen relatively quickly in a multi-screen shared keyboard and mouse scenario, thereby enhancing the user experience.

[0005] In a first aspect, an embodiment of the present application provides a cursor prompt method, which is applied to a host, comprising:

[0006] Detecting a cursor search operation and obtaining cursor position information;

[0007] Displaying a first visual indication element on a first display screen according to the position information of the cursor, the first visual indication element being used to indicate the position of the cursor; the first display screen is a display screen other than the display screen to which the cursor belongs;

[0008] It is determined that the first end condition is met, and the display of the first visual indication element is ended.

[0009] In this method, a cursor search operation is detected, and a first visual indication element is displayed on a display screen other than the display screen to which the cursor belongs to indicate the cursor position, thereby enabling the user to find the cursor on the display screen relatively quickly in a multi-screen shared keyboard and mouse scenario, thereby enhancing the user experience.

[0010] In a possible implementation, the first visual indication element includes a first graphic, and the first graphic has a direction pointing to the cursor position; or,

[0011] The first visual indication element includes an animation having a directional directivity pointing to the cursor position.

[0012] In a possible implementation, the animation includes: a second graphic and a first motion trajectory of the second graphic, the second graphic having a direction directivity pointing to a cursor position, and / or the first motion trajectory of the second graphic having a direction directivity pointing to a cursor position.

[0013] In a possible implementation, determining that the first end condition is satisfied includes:

[0014] The end of the cursor seek operation is detected; or,

[0015] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0016] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0017] In a possible implementation, the first visual indication element includes an animation, and before the first visual indication element is displayed on the first display screen, the method further includes:

[0018] Displaying a visual reminder element on the first display screen; the visual reminder element includes a second graphic;

[0019] It is determined whether the second end condition is satisfied.

[0020] In a possible implementation, determining that the second end condition is satisfied includes:

[0021] The end of the cursor seek operation is detected; or,

[0022] It is determined that the display time of the visual reminder element reaches a second preset time.

[0023] In a possible implementation, determining that the first end condition is satisfied includes:

[0024] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0025] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0026] In a possible implementation, the first visual indication element includes a first graphic; and displaying the first visual indication element on the first display screen according to the position information of the cursor includes:

[0027] Obtaining location information of a first location;

[0028] Determine a first direction according to the position information of the first position and the position information of the cursor, the first direction being the direction from the first position to the position of the cursor;

[0029] The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at a first position.

[0030] In a possible implementation, obtaining location information of the first location includes:

[0031] Obtaining position information of a preset first pixel on the first display screen; calculating position information of a first intersection according to the position information of the cursor and the position information of the first pixel, and using the position information of the first intersection as the position information of the first position; the first intersection is the intersection of a first straight line and a sideline of the first display screen, and the first straight line is a straight line passing through the position of the cursor and the first pixel; or,

[0032] Acquire position information of a preset second pixel point on a first edge line of the first display screen, and use the position information of the second pixel point as position information of the first position, wherein the first edge line is the edge line of the first display screen closest to the position of the cursor; or,

[0033] The position information of a preset third pixel point on the first display screen is obtained, and the position information of the third pixel point is used as the position information of the first position.

[0034] In a possible implementation, the first visual indication element includes an animation, and the second graphic included in the animation has a directional directivity pointing to the cursor position;

[0035] Displaying a first visual indication element on a first display screen according to the position information of the cursor includes:

[0036] Acquire position information of a preset fourth pixel point on the first display screen;

[0037] The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

[0038] In a possible implementation, the first visual indication element includes an animation, and the first motion track included in the animation has a direction directivity pointing to the cursor position;

[0039] Displaying a first visual indication element on a first display screen according to the position information of the cursor includes:

[0040] Acquire position information of a preset fourth pixel point on the first display screen;

[0041] Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0042] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is used as a first motion trajectory to display a first visual indication element.

[0043] In a possible implementation, the first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position;

[0044] Displaying a first visual indication element on a first display screen according to the position information of the cursor includes:

[0045] Acquire position information of a preset fourth pixel point on the first display screen;

[0046] Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0047] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction in which the fourth pixel point points to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

[0048] In a possible implementation manner, the display screen to which the cursor belongs is adjacent to the first display screen, and further includes:

[0049] Determine whether the second graphic included in the first visual indication element moves to the second intersection, and display the second visual indication element on the display screen to which the cursor belongs, the second visual indication element including: a second motion trajectory of the second graphic and the second graphic, the second motion trajectory being a second vector with the third intersection as the starting point and the position of the cursor as the end point, the third intersection being the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

[0050] In a possible implementation, after the cursor search operation is detected, the method further includes:

[0051] A display interface and / or a cursor is highlighted with a preset effect on the display screen to which the cursor belongs.

[0052] In a second aspect, an embodiment of the present application provides a cursor prompt method, which is applied to a host, comprising:

[0053] Receive the position information of the cursor, which is sent after the host to which the cursor belongs detects the cursor seek operation;

[0054] Displaying a first visual indication element on a display screen corresponding to the host according to the position information of the cursor, where the first visual indication element is used to indicate the position of the cursor;

[0055] It is determined that the first end condition is met, and the display of the first visual indication element is ended.

[0056] In the method, a cursor search operation is detected, and a first visual indication element is displayed on the display screen corresponding to the host to indicate the cursor position, so that in a multi-screen shared keyboard and mouse scenario, the user can find the cursor on the display screen relatively quickly, thereby enhancing the user experience.

[0057] In a possible implementation, the first visual indication element includes a first graphic, and the first graphic has a direction pointing to the cursor position; or,

[0058] The first visual indication element includes an animation having a directional directivity pointing to the cursor position.

[0059] In a possible implementation, the animation includes: a second graphic and a first motion trajectory of the second graphic, the second graphic having a direction directivity pointing to a cursor position, and / or the first motion trajectory of the second graphic having a direction directivity pointing to a cursor position.

[0060] In a possible implementation, determining that the first end condition is satisfied includes:

[0061] The end of the cursor seek operation is detected; or,

[0062] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0063] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0064] In a possible implementation, the first visual indication element includes an animation, and before the first visual indication element is displayed on a display screen corresponding to the host, the method further includes:

[0065] Displaying a visual reminder element on a display screen corresponding to the host; the visual reminder element includes a second graphic;

[0066] It is determined whether the second end condition is satisfied.

[0067] In a possible implementation, determining that the second end condition is satisfied includes:

[0068] The end of the cursor seek operation is detected; or,

[0069] It is determined that the display time of the visual reminder element reaches a second preset time.

[0070] In a possible implementation, determining that the first end condition is satisfied includes:

[0071] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0072] It is determined that the second graphic included in the first visual indication element moves to an end point of the first motion trajectory.

[0073] In a possible implementation, the first visual indication element includes a first graphic; and displaying the first visual indication element on a display screen corresponding to the host according to the position information of the cursor includes:

[0074] Obtaining location information of a first location;

[0075] Determine a first direction according to the position information of the first position and the position information of the cursor, the first direction being the direction from the first position to the position of the cursor;

[0076] The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at a first position.

[0077] In a possible implementation, obtaining location information of the first location includes:

[0078] Obtaining position information of a preset first pixel point on the display screen corresponding to the host; calculating position information of a first intersection point according to the position information of the cursor and the position information of the first pixel point, and using the position information of the first intersection point as the position information of the first position; the first intersection point is the intersection point of a first straight line and the edge line of the display screen corresponding to the host, and the first straight line is a straight line passing through the position of the cursor and the first pixel point; or,

[0079] Obtaining position information of a preset second pixel point on a first edge line of a display screen corresponding to the host, and using the position information of the second pixel point as position information of the first position, wherein the first edge line is the edge line of the display screen corresponding to the host closest to the position of the cursor; or,

[0080] The position information of a preset third pixel point on the display screen corresponding to the host is obtained, and the position information of the third pixel point is used as the position information of the first position.

[0081] In a possible implementation, the first visual indication element includes an animation, and the second graphic included in the animation has a directional directivity pointing to the cursor position;

[0082] Displaying a first visual indication element on a display screen corresponding to the host according to the position information of the cursor includes:

[0083] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0084] The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

[0085] In a possible implementation, the first visual indication element includes an animation, and the first motion track included in the animation has a direction directivity pointing to the cursor position;

[0086] Displaying a first visual indication element on a display screen corresponding to the host according to the position information of the cursor includes:

[0087] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0088] The position information of the second intersection is calculated according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection of the second straight line and the edge line of the display screen corresponding to the host; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0089] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is used as a first motion trajectory to display a first visual indication element.

[0090] In a possible implementation, the first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position;

[0091] Displaying a first visual indication element on a display screen corresponding to the host according to the position information of the cursor includes:

[0092] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0093] The position information of the second intersection is calculated according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection of the second straight line and the edge line of the display screen corresponding to the host; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0094] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction in which the fourth pixel point points to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

[0095] In a possible implementation, the display screen to which the cursor belongs is adjacent to the display screen corresponding to the host, and further includes:

[0096] Determine whether the second graphic included in the first visual indication element moves to the second intersection, and send a display notification to the host to which the cursor belongs, the display notification is used to instruct the host to which the cursor belongs to display the second visual indication element on the display screen to which the cursor belongs, the second visual indication element includes: a second motion trajectory of the second graphic and the second graphic, the second motion trajectory is a second vector with the third intersection as the starting point and the position of the cursor as the end point, and the third intersection is the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

[0097] In a third aspect, an embodiment of the present application provides a cursor prompt method, which is applied to a host, comprising:

[0098] Detecting a cursor search operation and determining a target display screen;

[0099] Displays a cursor on the target display.

[0100] In this method, a cursor search operation is detected, a target display screen is determined, and a cursor is displayed on the target display screen. Thus, as long as the user performs a cursor search operation, the cursor can be displayed on the target display screen. This enables the user to find the cursor on the display screen relatively quickly in a multi-screen shared keyboard and mouse scenario, thereby enhancing the user experience.

[0101] In a possible implementation manner, determining a target display screen includes:

[0102] The preset display screen information is obtained, and the display screen indicated by the preset display screen information is used as the target display screen.

[0103] In this method, the target display screen is a preset display screen, so that as long as the user performs a cursor search operation, the cursor can be found on the preset display screen. In this way, in a multi-screen shared keyboard and mouse scenario, the user can find the cursor on the display screen relatively quickly, thereby enhancing the user experience.

[0104] In a possible implementation manner, determining a target display screen includes:

[0105] Acquire a first image captured by each camera, and set the camera and the display screen accordingly;

[0106] A target display screen is selected from the display screens according to the acquired first image, where the target display screen is the display screen toward which the user's face is facing.

[0107] In this method, an image is captured by a camera arranged corresponding to the display screen, and the display screen that the user's face is facing is selected as the target display screen according to the image, and a cursor is displayed on the target display screen. As long as the user performs a cursor search operation, the cursor can be displayed on the display screen that the user is watching. In this way, in a multi-screen shared keyboard and mouse scenario, the user can find the cursor on the display screen relatively quickly, thereby enhancing the user experience.

[0108] In a possible implementation, displaying a cursor on a target display screen includes:

[0109] When it is determined that the target display screen is not the display screen corresponding to the host, a cursor display instruction is sent to the host corresponding to the target display screen, and the cursor display instruction is used to instruct the host corresponding to the target display screen to display a cursor on the target display screen.

[0110] In a possible implementation, obtaining a first image captured by a camera set on each display screen includes:

[0111] A first image sent by another host is received, where the first image is a first image captured by a camera set on a display screen corresponding to the other host.

[0112] In a possible implementation manner, selecting a target display screen from display screens according to the acquired first image includes:

[0113] Determining that there is only one first image with typical facial features in the first images, and determining a display screen corresponding to the first image with typical facial features as a target display;

[0114] It is determined that there are at least two first images with typical facial features in the first images, and a target display screen is selected according to the first images with typical facial features.

[0115] In a possible implementation, selecting a target display screen according to a first image having typical facial features includes:

[0116] For each first image, draw a triangle with the eyes and the mouth of the face in the first image as vertices, and calculate the angle difference between two internal angles of the triangle with the eyes as vertices;

[0117] The display screen corresponding to the first image with the smallest angle difference is selected as the target display screen.

[0118] In a fourth aspect, an embodiment of the present application provides a host, including:

[0119] One or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the device, cause the device to perform any one of the methods of the first aspect to the third aspect.

[0120] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes any one of the methods of the first to third aspects.

[0121] In a sixth aspect, the present application provides a computer program, which, when executed by a computer, is used to execute the method of the first aspect.

[0122] In one possible design, the program in the sixth aspect may be stored in whole or in part on a storage medium packaged together with the processor, or may be stored in whole or in part on a memory not packaged together with the processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0123] Figure 1 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application;

[0124] Figure 2 This is an example diagram of an application scenario of the cursor prompt method according to an embodiment of the present application;

[0125] Figure 3 This is another example diagram of an application scenario of the cursor prompt method according to an embodiment of the present application;

[0126] Figure 4 This is an example diagram of a method for establishing a coordinate system of a display screen in an embodiment of the present application;

[0127] Figure 5 This is an example diagram of setting the position relationship information between display screens in the embodiment of the present application;

[0128] Figure 6 A flowchart of an embodiment of the cursor prompt method of the present application;

[0129] Figure 7A to Figure 7C This is a possible implementation example diagram of the first graphic as a visual prompt element in an embodiment of the present application;

[0130] Figure 8 This is an example diagram of the intersection calculation method of the embodiment of the present application;

[0131] Figures 9A to 9C This is a possible implementation example diagram of the animation as a visual indication element in the embodiment of the present application;

[0132] Figure 10A to Figure 10C This is a flow chart of an embodiment of the cursor prompt method of the present application;

[0133] Fig.11 A flowchart of another embodiment of the cursor prompt method of the present application;

[0134] Fig.12 A flowchart of another embodiment of the cursor prompt method of the present application;

[0135] Fig.13 A flowchart of another embodiment of the cursor prompt method of the present application;

[0136] Fig.14 A flowchart of another embodiment of the cursor prompt method of the present application;

[0137] Fig.15 A flowchart of another embodiment of the cursor prompt method of the present application;

[0138] Fig.16 This is an example diagram of the positional relationship between the camera and the corresponding display screen in this application;

[0139] Fig.17 This is an example diagram of the triangle drawing method for the target face of this application;

[0140] Fig.18A flowchart of another embodiment of the cursor prompt method of the present application;

[0141] Fig.19 A flowchart of another embodiment of the cursor prompt method of the present application;

[0142] Fig. 20 A flowchart of another embodiment of the cursor prompt method of the present application;

[0143] Fig.21 A flowchart of another embodiment of the cursor prompt method of the present application;

[0144] Fig. 22 A flowchart of another embodiment of the cursor prompt method of the present application;

[0145] Fig.23 A structural diagram of an embodiment of a cursor prompt device of the present application;

[0146] Fig.24 A structural diagram of another embodiment of the cursor prompt device of the present application;

[0147] Fig.25 This is a structural diagram of another embodiment of the cursor prompt device of the present application. DETAILED DESCRIPTION

[0148] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.

[0149] In the prior art, a method is provided to assist the user in finding the cursor in a single screen scenario. For example, in a MAC OS system, when a user quickly shakes the mouse, the cursor will be enlarged and displayed on the screen to help the user find the cursor. Alternatively, in a Windows system, a function option of "showing the position of the pointer when the CTRL key is pressed" is provided. After the user selects this function, the user presses the CTRL key, and an inward-shrinking circle appears around the cursor to indicate the position of the cursor.

[0150] However, the above method can only be applied to a single display screen. In a multi-screen display scenario, the user still needs to find the display screen to which the cursor belongs before discovering the cursor. The user discovers the cursor slowly and with great difficulty, which affects the user experience.

[0151] To this end, an embodiment of the present application provides a cursor prompt method and a host, which can assist the user to find the cursor on the display interface of the display screen relatively quickly in a multi-screen shared keyboard and mouse scenario, thereby improving the user experience.

[0152] The method provided in the embodiment of the present application can be applied to a host. The host here refers to the main body part of an electronic device excluding input and output devices such as a display screen, a keyboard, a mouse, etc.

[0153] For example, Figure 1 A schematic structural diagram of the host 100 is shown.

[0154] The host 100 may include a processor 110 , an antenna, a wireless communication module 120 , an internal memory 121 , and the like.

[0155] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0156] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0157] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0158] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0159] In some embodiments, the processor 110 may include one or more interfaces, such as a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), and the like.

[0160] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function.

[0161] The MIPI interface can be used to connect the processor 110 to peripheral devices such as a display screen. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera communicate via the CSI interface to enable the host 100 to control the camera's shooting function. The processor 110 and the display screen communicate via the DSI interface to enable the host 100 to control the display function of the display screen.

[0162] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the host 100. In other embodiments of the present application, the host 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0163] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as an image playback function, etc.), etc. The data storage area may store data (such as image data, etc.) created during the use of the host 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0164] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied to the host 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0165] The display screen described in the following embodiments of the present application is used to display images, videos, etc. The display screen includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc.

[0166] The host and the display screen in the embodiments of the present application can be set in the same physical entity, such as a tablet computer (PAD, portable android device), an all-in-one personal computer (PC, personal computer) and other electronic devices; or, the host and the display screen can also be physically separated and exist as independent entities, such as a desktop computer.

[0167] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 Taking the host of the shown structure as an example, the method provided in the embodiment of the present application is specifically described in combination with the accompanying drawings and application scenarios.

[0168] First, the cursor in the embodiment of the present application is exemplified. The cursor is a graphical identification icon of the mouse position generated after the computer starts using the mouse in order to identify the mouse position on the graphical interface. Based on the different display interfaces on the display screen, the specific graphics of the cursor may change. For example, when inputting text in the text input interface, the cursor may be a regular flashing vertical line. The cursor is displayed as an arrow in some interfaces. When moving to a certain link, it may change to a small hand, etc. The user can realize the movement control of the cursor by operating input devices such as a mouse, keyboard, virtual keyboard, and touch display screen.

[0169] The following Figure 2 and Figure 3 The application scenario of the cursor prompt method in the embodiment of the present application is illustrated by examples.

[0170] Figure 2 This is an example diagram of an application scenario of the cursor prompt method of the embodiment of the present application. The scenario is an extended screen scenario, including: a host 21, a mouse 22, and n display screens 23, where n is an integer greater than or equal to 2; Figure 2 Take n=3, that is, there are 3 display screens as an example. Among them, the host 21 is connected to each display screen 23 respectively, and the host 21 is connected to the mouse 22; the connection between the host 21 and each display screen 23 can be a wireless connection or a wired connection; the connection between the host 21 and the mouse 22 can be a wireless connection or a wired connection. If it is a wireless connection, the specific connection method is not limited in the embodiment of the present application, for example, it can be WiFi, Bluetooth, etc. The host 21 can respectively determine the interface data that needs to be displayed on each display screen 23 of the n display screens 23, and send the interface data to each display screen 23 for display; the cursor 24 corresponding to the mouse 22 (the arrow is used as an example in the figure) can move on the n display screens 23 based on the user's operation on the mouse 22.

[0171] Figure 3: is another example diagram of application scenario of the cursor prompt method of the embodiment of the present application. This scenario is a keyboard and mouse sharing scenario, including: n hosts 31, a display screen 32 corresponding to each host 31, and a mouse 33; the hosts 31 are connected to each other, the host 31 is connected to its corresponding display screen 32, and the mouse 33 is connected to one of the n hosts 31; the above connection can be a wireless connection or a wired connection. If it is a wireless connection, the specific connection method is not limited in the embodiment of the present application, for example, it can be WiFi, Bluetooth, etc. The host 31 determines the interface data required to be displayed on the display screen 32 corresponding to the host 31, and sends the interface data to the corresponding display screen 32 for display; the cursor 34 corresponding to the mouse 33 (the arrow is used as an example in the figure) can move on the n display screens 32 based on the user's operation on the mouse 33; the host connected to the mouse 33 receives the displacement information sent by the mouse in real time according to a certain period, and the displacement information of the mouse can be shared by the host connected to the mouse to other hosts, such as the host corresponding to the display screen to which the cursor belongs, and the host corresponding to the display screen to which the cursor belongs adjusts the position of the cursor 34 on the display screen based on the displacement information of the mouse.

[0172] It should be noted that the host in the above application scenario can also be connected to other input devices besides the mouse, such as a keyboard, and the cursor can also be moved on each display screen based on the user's operation on the keyboard.

[0173] Below, through Figure 4 The method for establishing the coordinate system of each display screen in the embodiment of the present application is exemplified.

[0174] The display screen is generally a regular rectangle. Figure 2 and Figure 3 In the n display screens shown, each display screen can establish its own coordinate system. For convenience of calculation in subsequent steps, the n display screens preferably establish coordinate systems in the same manner. For example, for each display screen, Figure 4 As shown, based on the angle at which the user views the display screen, the upper left corner of the display screen is taken as the origin O of the coordinate system of the display screen, the upper edge of the display screen is the x-axis, the direction of the x-axis pointing to the right is the positive direction of the x-axis, the left edge of the display screen is the y-axis, and the downward direction of the y-axis is the positive direction of the y-axis. Accordingly, the position of each pixel on the display screen can be identified by the coordinates (x, y) in the display screen.

[0175] It should be noted that the above coordinate system establishment method is only an example and is not intended to limit the method for establishing a display screen coordinate system.

[0176] Since there are multiple display screens and the cursor can move between the multiple display screens, the position relationship information between the multiple display screens can be set in the host in advance. The following is an exemplary description of the method for setting the position relationship information between n display screens in an embodiment of the present application.

[0177] for Figure 2 In the application scenario shown, the position relationship information between the n display screens can be pre-set in the host 21; Figure 3 In the application scenario shown, it is necessary to set the positional relationship information between the n display screens 42 in at least one of the n hosts 31 in advance. Optionally, the positional relationship information between the display screens is set based on the coordinate system of the above-mentioned display screen, for example: one display screen is selected from the n display screens as the main display screen, and the coordinate system of the main display screen is called the main coordinate system. According to the display parameters of the display screen, such as width and height, and the physical relative position relationship between the display screens, the coordinates of the origin of the coordinate system of the non-main display screen in the main coordinate system are calculated. Accordingly, the positional relationship information between the display screens can be recorded in the following form: display screen M{X, Y, Width, Height}. Among them, X is the horizontal coordinate of the coordinate origin of the display screen M in the main coordinate system, Y is the vertical coordinate of the coordinate origin of the display screen M in the main coordinate system, Width is the screen width of the display screen M (the side length of the display screen M in the x-axis direction of the display screen M coordinate system), which can be represented by the number of pixels in the x-axis direction, and Height is the screen height of the display screen M (the side length of the display screen M in the y-axis direction of the display screen M coordinate system), which can also be represented by the number of pixels in the y-axis direction. The display screen M {X, Y, Width, Height} is referred to as the relative position information of the display screen M hereinafter.

[0178] For example: see Figure 5 , assuming that display screen 51 and display screen 52 are provided, display screen 51 is the main display screen, and the physical position relationship between display screen 52 and display screen 51 is as follows Figure 6 As shown, the positional relationship between the recording display screen 51 and the display screen 52 is: display screen 1 {X = 0, Y = 0, Width = W1, Height = H1}, display screen 2 {X = W1, Y = h3, Width = W2, Height = H2}. Figure 3 and Figure 4 When the total number of display screens in a system exceeds 2, the position relationship can be set as shown in Figure 5 Examples are given, and I will not go into details.

[0179] In the following embodiments, Figure 4 The coordinate system establishment method shown, and Figure 5 The method for setting the relative position relationship between the display screens shown is described as an example.

[0180] It should be noted that, when the positional relationship information between the above-mentioned display screens is known, and the x-axes and y-axes of the coordinate systems of the various display screens are parallel, if the coordinates of a certain pixel point in the coordinate system of one display screen are known, the coordinates of the point in the coordinate system of the other display screens can be calculated. For example, if the coordinates of a certain pixel point in the coordinate system of the display screen 1 to which it belongs are known, the coordinates of the pixel point in the main coordinate system can be calculated. The specific calculation method is not repeated here.

[0181] Figure 6 and Fig.11 It is aimed at Figure 2 An embodiment of a cursor prompt method for the application scenario shown.

[0182] Figure 6 This is a flowchart of an embodiment of the cursor prompt method of the present application, which can be applied to Figure 2 The host 21 shown, Figure 6 As shown, the method may include:

[0183] Step 601: The host detects a cursor search operation and obtains cursor position information.

[0184] Among them, the specific implementation of the cursor search operation is not limited in the embodiments of the present application. For example: the cursor search operation can be an operation such as shaking the mouse or moving the mouse quickly from the user level. Correspondingly, for the host, the host can judge that the movement distance of the mouse within the unit time reaches a preset threshold based on the displacement information of the mouse, and then the host detects the cursor search operation; or, the cursor search operation can be a user pressing a key on an input device connected to the host, such as a keyboard or a virtual keyboard, for a preset number of times from the user level, for example, the user presses the ctrl key 3 times or more. Correspondingly, for the host, the host judges that the number of press events of the designated key received within the unit time reaches a preset number based on the key press event sent by the received input device, and then the host detects the cursor search operation. The specific value of the unit time is not limited in the embodiments of the present application.

[0185] The cursor position information is used to record the position of the cursor on the display screen. The cursor position information can be: the coordinates of the cursor in the main coordinate system, such as (x1, y1); or the information of the display screen to which the cursor belongs and the coordinates of the cursor in the coordinate system of the display screen to which it belongs, such as (display screen 1, (x2, y2)). The coordinates of the cursor in a certain coordinate system can be identified by the coordinates of a preset point on the cursor graphic, such as the center point of the cursor graphic, in the coordinate system. For example, assuming that the cursor graphic is as follows Figure 2 and Figure 3As shown in the arrow, the position information of the cursor can be represented by the coordinates of the center point of the arrow in a certain coordinate system, or it can be called the coordinates of the cursor in a certain coordinate system. For example, the coordinates of the center point of the arrow in the principal coordinate system are (x3, y3), then the position information of the cursor can be (x3, y3), or it can be called the coordinates of the cursor in the principal coordinate system are (x3, y3).

[0186] Step 602: The host displays a first visual indication element on a display screen other than the display screen to which the cursor belongs, where the first visual indication element is used to indicate the position of the cursor.

[0187] For the convenience of subsequent description, the display screen displaying the first visual indication element, that is, the display screen other than the display screen where the cursor belongs, is referred to as the first display screen.

[0188] The first visual indication element may include: a first graphic, the first graphic has a direction directivity pointing to the cursor position; or the first visual indication element may include: an animation, the animation has a direction directivity pointing to the cursor position. The graphic or animation has a direction directivity pointing to the cursor position means that the user can get a direction when seeing the graphic or animation, and the direction is the direction pointing to the cursor position.

[0189] Optionally, the animation included in the first visual indication element may include: a second graphic and a first motion track of the second graphic, wherein the second graphic has a direction directivity pointing to the cursor position, and / or the first motion track of the second graphic has a direction directivity pointing to the cursor position.

[0190] Step 603: The host determines that the first end condition is met and ends the display of the first visual indication element.

[0191] Optionally, the host determining that the first end condition is satisfied may include: the host detecting that the cursor search operation is finished, or the host determining that the display time of the first visual indication element reaches a first preset time.

[0192] Optionally, if the first visual indication element includes an animation, and the animation includes: a second graphic and a first motion track of the second graphic, the host determining that the first end condition is satisfied may include: the host determining that the second graphic in the first visual indication element moves to the end point of the first motion track. The movement of the second graphic to the end point of the first motion track indicates that the second graphic has completed a movement from the start point to the end point of the first motion track, and it can be considered that a complete display of the animation has been completed.

[0193] Referring to the description in step 601, the host detects the end of the cursor search operation. From the user's perspective, the end of the cursor search operation may be the end of operations such as the user shaking the mouse or quickly moving the mouse. Accordingly, for the host, the host can determine that the movement distance of the mouse within a unit time period is less than a preset threshold based on the mouse displacement information, and the host detects the end of the cursor search operation; or, from the user's perspective, the end of the cursor search operation may be the end of the user pressing a key on an input device connected to the host, such as a keyboard or a virtual keyboard, for example, the user no longer presses the ctrl key. Accordingly, for the host, the host determines that the number of press events of the designated key received within a unit time period is less than a preset number, and the host detects the end of the cursor search operation.

[0194] The implementation of step 602 is described as follows:

[0195] If the first visual indication element comprises a first graphic:

[0196] The display position of the first visual indication element on the first display screen is not limited in the embodiments of the present application. In order to make it easier for the user to locate the cursor position according to the direction indicated by the first visual indication element, optionally, the display position of the first visual indication element can be located at the edge of the display screen closest to the cursor, such as the midpoint of the edge, or the intersection of the line between the cursor position and the center point of the first display and the edge; or, in order to make it easier for the user to notice the first visual indication element, the display position of the first visual indication element can be located at a relatively special position on the display screen, such as the center point of the first display. However, it should be noted that the first visual indication element set at other positions of the first display screen can also complete the indication function of the first visual indication element for the cursor position.

[0197] The specific shape of the first graphic is not limited in the embodiment of the present application, as long as it has a direction pointing to the cursor position. Optionally, in order to make it easier for the user to identify the direction indicated by the graphic, the first graphic can be an arrow pointing to the cursor position.

[0198] Similar to the above description of the cursor position, the display position of the first visual indication element can also be represented by the position of a certain pixel in the first visual indication element. For example, if the first graphic is an arrow, the display position of the arrow can be represented by the position of the pixel at the tip of the arrow, that is, the position information of the first graphic or the first visual indication element. In the following, in the example where the first visual indication element includes an arrow, the position of the pixel at the tip of the arrow is used as an example to represent the display position of the arrow.

[0199] The color of the first graphic is not limited in the embodiment of the present application, and is preferably a color that easily attracts the user's visual attention, such as red.

[0200] For example: see Fig. 7A As shown, the first graphic as the first visual indication element is arrow 721, display screen 71 is the display screen to which the cursor belongs, display screen 72 is the display screen to which arrow 721 belongs, that is, the first display screen mentioned above, the cursor is located at point A on display screen 71 (the cursor position is marked by the center point of the cursor as an example in FIG7 ), the center point of display screen 72 is point B, the tip pixel point of arrow 721 is located at point C, the intersection of straight line AB and the edge line of display screen 72, and the line included by arrow 721 coincides with straight line AB.

[0201] See also Figure 7B As shown, different from Fig. 7A The tip pixel of arrow 721 is located at the midpoint D of the edge of display screen 71 close to the cursor position, and the line included by arrow 721 coincides with straight line AD.

[0202] See also Figure 7C As shown, different from Fig. 7A and Figure 7B The tip pixel of arrow 721 is located at the center point B of display screen 71, and the line included by arrow 721 coincides with straight line AB.

[0203] It should be noted that Fig. 7A and Figure 7B The display screen 71 and the display screen 72 are adjacent to each other for example only. The display screen 71 and the display screen 72 may also be not adjacent to each other, for example, another display screen is arranged in the middle. Fig. 7A and Figure 7B , I won’t go into details here.

[0204] When the first graphic has been determined, when the host displays the first graphic on the first display screen, it is necessary to first determine the display position of the first graphic on the first display screen, and then determine the indication direction of the first graphic, that is, the direction in which the display position points to the cursor position. After that, the host can display the first graphic at the display position according to the indication direction, thereby completing the display of the first visual indication element.

[0205] The host determines the display position of the first graphic on the first display screen in two cases. One is that the display position information of the first graphic is obtained by dynamic calculation, for example Fig. 7A and Figure 7B In the example shown, the position of the pixel point at the tip of the arrow is calculated in real time based on the cursor position; secondly, the display position information of the first graphic is preset by the host, for example Figure 7C In the example shown, the pixel point at the tip of the arrow is located at the center point of the first display screen, which is preset by the host. The following is an exemplary description of the method for determining the display position of the first graphic on the first display screen in different situations:

[0206] In a possible implementation, a first pixel point may be preset in the host, the first pixel point may be any pixel point on the first display screen, and position information of the first pixel point (for example, the coordinates of the first pixel point in the coordinate system of the first display screen) is pre-stored; accordingly, the host determines the display position information of the first visual indication element may include:

[0207] Obtaining position information of a first pixel; calculating position information of a first intersection point according to the position information of a cursor and the position information of the first pixel point; the first intersection point is an intersection point of a first straight line and an edge line of a first display screen, and the first straight line is a straight line passing through the cursor position and the first pixel point.

[0208] For example Fig. 7A This can be achieved by Fig. 7A The first pixel point is the center point of the first display screen, the first straight line is the straight line AB, and the first intersection point is Fig. 7A Point C in .

[0209] At this time, the cursor position, the first intersection point, and the first pixel point are on a straight line, and the direction from the first intersection point to the cursor position, that is, the direction from the first pixel point to the cursor position, can be used as the indication direction of the first graphic. Accordingly, the host can display the first graphic based on the indication direction and the display position, for example Fig. 7A shown.

[0210] The following is an example of a method for calculating the position information of the first intersection. The calculation of the position information of the first intersection can be performed in the principal coordinate system. The host can determine the coordinates of the cursor in the principal coordinate system based on the position information of the cursor, and determine the coordinates of the first pixel in the principal coordinate system based on the position information of the first pixel. The host can calculate the coordinates of the first intersection in the principal coordinate system based on the coordinates of the cursor in the principal coordinate system and the coordinates of the first pixel in the principal coordinate system, combined with the positional relationship information between the display screens preset in the host, and the coordinates can identify the position of the first intersection. In order to facilitate the host to determine the position of the first intersection on the first display screen, the coordinates of the first intersection in the principal coordinate system can be converted to the coordinates of the first intersection in the first display screen coordinate system, and the coordinates can also identify the position of the first intersection. See. Figure 8, assuming that the cursor is located on the display screen 71, and the coordinate system of the display screen 71 may be the principal coordinate system or not, the coordinates of the cursor in the principal coordinate system are assumed to be represented by the coordinates of the cursor center point A in the principal coordinate system, specifically (x1, y1), the first pixel point is assumed to be the center point B of the first display screen (i.e., the display screen 72), the positional relationship information of the display screen 72 recorded in the positional relationship information between the display screens is (X=W1, Y=h3, Width=W2, Height=H2), the first intersection point is point C, a straight line parallel to the y-axis is drawn through point A, a straight line parallel to the x-axis is drawn through point B, the two straight lines intersect at point D, line segment AD is perpendicular to line segment DB, the intersection of line segment DB and the edge line of the display screen 72 is point E, and line segment CE is perpendicular to line segment DB. Under this figure, based on trigonometric functions or the proportional relationship between the sides of similar triangles, the ordinate of the first intersection point C can be calculated as: The horizontal coordinate of point C is W1, so the coordinate of point C in the main coordinate system is (W1, h4). This coordinate can also be converted into the coordinate (0, h4-h3) in the coordinate system of the display screen 72, so that the host can display the first graphic at point C of the display screen 72.

[0211] In another possible implementation, the host may select the edge of the display screen closest to the cursor position based on the positional relationship between the cursor position and the display screen, and use a preset pixel point of the edge, such as the midpoint, as the display position of the first graphic; in this case, the host may determine the display position information of the first graphic, including:

[0212] The position information of a preset second pixel point on a first edge line of the first display screen is obtained, and the position information of the second pixel point is used as the display position information of the first graphic. The first edge line is the edge line of the first display screen closest to the cursor position.

[0213] At this time, the direction in which the second pixel point points to the cursor position can be used as the indication direction of the first graphic. Accordingly, the host can display the first graphic based on the indication direction and the display position, for example Figure 7B shown.

[0214] In another possible implementation, the host may store the position information of a preset pixel point, such as a center point, of the first display screen. Then, the host may directly use the position information of the preset pixel point as the display position information of the first graphic.

[0215] At this time, the direction from the center point of the display screen to the cursor position can be used as the indication direction of the first graphic. Correspondingly, the host can display the first graphic based on the indication direction and the display position, for example Figure 7C shown.

[0216] If the visual indication element is an animation, the animation includes: the second graphic and the first motion track of the second graphic:

[0217] If the second graphic in the animation has a direction pointing to the cursor position, the implementation of the second graphic can refer to the relevant description of the first graphic. For example, the second graphic can be an arrow pointing to the cursor position. In this case, the motion trajectory of the second graphic is not limited. For example, the animation can be: the arrow pointing to the cursor position keeps flashing or shaking; for example, Figures 7A to 7C The arrow shown is added with animation effects such as flashing and shaking to obtain an animation with a direction pointing to the cursor position.

[0218] If the first motion trajectory of the second graphic in the animation has a direction pointing to the cursor position, the first motion trajectory may be a vector starting from a preset fourth pixel point on the first display screen and pointing to the cursor position along the preset pixel point until the edge of the first display screen. The fourth pixel point may be a point within the edge of the first display screen. In order to make the animation path relatively long and have a better visual effect, the center point of the first display screen may be used as the preset fourth pixel point, that is, the starting point of the first motion trajectory. For example, the animation as the first visual indication element may be that the second graphic starts from the center point of the first display screen and continuously approaches the cursor position in the direction pointing to the cursor position until the edge of the first display screen; for example, see Fig. 9A As shown, the second graphic is a heart 922, starting from the center point B of the display screen 92, and continuously approaching the cursor position A along the direction from the center point B to the cursor position A, until the edge point C of the display screen 92, where the point C is the intersection of the straight line AB and the display screen 92. The calculation of the position information of the intersection point C can refer to the above Figure 8 The relevant instructions in are not repeated here.

[0219] If the second graphic and the first motion track of the second graphic included in the animation both have a direction pointing to the cursor position, the method for determining the direction indicated by the second graphic and the method for determining the first motion track of the second graphic can refer to the relevant description of the case where only the second graphic or the first motion track of the second graphic has a direction, which will not be repeated here. For example, the animation can be an arrow pointing to the cursor position that continuously approaches the cursor position in the direction pointing to the cursor position. For example, see Fig. 9B As shown, different from Fig. 9A , the second graphic is an arrow 921, and the arrow 921 points to the cursor position.

[0220] Optionally, in step 602, in addition to displaying the first visual indication element on a display screen other than the display screen to which the cursor belongs to indicate the cursor position to the user, certain effects may be displayed on the display screen to which the cursor belongs so that the user can find the cursor more quickly. At this time, this step 602 may also include: the host highlights the display interface and / or the cursor with a preset effect on the display screen to which the cursor belongs. The highlighting of the display interface may include, but is not limited to: highlighting the display interface, flashing the display interface, etc. The highlighting of the cursor may include, but is not limited to: enlarging the cursor, changing the cursor color to a relatively eye-catching color such as red, flashing the cursor, etc. By highlighting the display interface on the display screen to which the cursor belongs, it is possible for the user to more easily find the display screen where the cursor is located, and highlighting the cursor may make it easier for the user to find the cursor.

[0221] Optionally, if the first motion track included in the animation as the first visual indication element has a direction directivity pointing to the cursor position, for example Fig. 9A and Fig. 9B As shown, in order to make this direction more clear and complete, the host can control the relevant display screens to relay the animation of the same second graphic moving from the preset pixel point of the first display screen to the cursor position. Fig. 9C As shown, it is assumed that display screens 91 to 93 are included, and display screens 91 to 93 are arranged in sequence. The cursor is at point A in display screen 91, and points C, D, E, and F are the intersections of straight line AB and the edges of each display screen, respectively. An arrow 931 is displayed on display screen 93, moving from point B to point C along the BC direction. Then, an arrow 931 is displayed on display screen 92, moving from point D to point E along the DE direction. Finally, an arrow 931 is displayed on display screen 91, moving from point F to point A, completing the motion trajectory of arrow 931 from the center point B of display screen 93 to the cursor position A. For display screens 91 to 93, display screens 91 to 93 respectively display a visual indication element, and the visual indication element includes the same second graphic, and the motion trajectory of the second graphic is on the same straight line.

[0222] At this time, if there is a third display screen between the first display screen and the second display screen to which the cursor belongs, the host can calculate the position information of the two intersection points of the edge line of the third display screen and the straight line passing through the preset pixel point and the cursor position based on the position information of the preset pixel point on the first display screen and the position information of the cursor, and use the intersection point close to the cursor position as the end point and the intersection point far from the cursor position as the starting point to obtain the vector as the motion trajectory of the second graphic in the third display screen; for example Fig. 9CIn the figure, relative to display screens 91 and 93, display screen 92 is the third display screen. It can be calculated that the two intersection points of straight line AB and the edge line of display screen 92 are points D and E respectively. The vector with point D as the starting point and point E as the end point is used as the movement trajectory of arrow 931 in display screen 92.

[0223] For the second display screen where the cursor belongs, the host can calculate the intersection of the edge line of the second display screen and the straight line passing through the preset pixel point and the cursor position, and use the intersection as the starting point and the cursor position as the end point of the vector as the movement trajectory of the second graphic in the second display screen. After the host controls the first display screen to display the animation, the third display screen displays the animation, and finally the second display screen displays the animation, completing the relay display of the second graphic moving to the cursor position. For example Fig. 9C In the figure, the second display screen is display screen 91, the intersection point of its edge line and the straight line passing through the preset pixel point and the cursor position is F, and the movement trajectory of arrow 931 in display screen 91 is a vector with point F as the starting point and point A as the end point.

[0224] The above embodiment is exemplarily described below from the perspective of the user interface (UI).

[0225] See also Fig. 10A As shown, in part 1010 of Figure 10, the cursor 101 is located at the display screen 1011, and the host detects a cursor search operation; referring to part 1020, the display screen 1012 displays an arrow 102 near the edge of the cursor 101, and the arrow 102 points to the position of the cursor 101, and the display screen 1013 displays an arrow 103 near the edge of the cursor 101, and the arrow 103 points to the position of the cursor 101; referring to part 1030, the host determines that the cursor search operation is ended, and the arrows on the display screens 1012 and 1013 are no longer displayed.

[0226] See also Fig. 10B As shown, different from Fig. 10A A static arrow is used to indicate the position of the cursor 101. Fig. 10B Animation is used to indicate the position of cursor 101, see part 1021, arrow 102 displayed on display screen 1012 gradually approaches cursor 101 along the direction pointing to the position of cursor 101 from the center point of display screen 1012, and arrow 103 displayed on display screen 1013 gradually approaches cursor 101 along the direction pointing to the position of cursor 101 from the center point of display screen 1013.

[0227] See also Fig. 10C , different from Fig. 10BIn the added part 1022, the display screen 1011 can also display the arrow 102 and the arrow 103 in relay, so that the movement trajectories of the arrow 102 and the arrow 103 extend to the position of the cursor 101, making the indication of the cursor position clearer.

[0228] Different from Figure 6 In the embodiment shown, when the motion track of the second graphic in the first visual indication element has a directional orientation, in order to better attract the user's visual attention so that the user can effectively watch the motion track of the second graphic in the first visual indication element, the host may further add a visual reminder element before displaying the first visual indication element on the first display screen. Fig.11 As shown, before step 602, the following may be included:

[0229] Step 1101: The host displays a visual reminder element on a first display screen.

[0230] Among them, the main function of the visual reminder element is to attract the user's visual attention through the element, so that the user can effectively watch the movement trajectory of the second graphic in the first visual indication element and find the cursor position. The visual reminder element may have a direction pointing to the cursor position, such as the arrow pointing to the cursor position in the aforementioned example, or may not have a direction pointing to the cursor position, such as a mirror cursor or a heart in the aforementioned example. Optionally, the visual reminder element may be the second graphic included in the animation as the first visual indication element. Optionally, the host displays the position of the visual reminder element at the starting point of the first movement trajectory.

[0231] Step 1102: The host determines that the second end condition is met and executes step 602.

[0232] The host determines that the second end condition is met, which may include: detecting that the cursor search operation is ended; or determining that the display time of the visual reminder element reaches a second preset time.

[0233] At this time, in step 603, the host determines that the first end condition is satisfied, which may include:

[0234] Determining that the display duration of the visual indication element reaches a first preset duration; or,

[0235] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0236] The above embodiment is exemplarily described below from the perspective of UI interface.

[0237] See also Fig.12 As shown, different from Fig. 10BIn the illustrated embodiment, part 1210 is added, in which the visual reminder element is an arrow in the first visual indication element as an example, referring to part 1210, the display screen 1012 displays arrow 102 at the center point, and arrow 102 points to the position of cursor 101, and the display screen 1013 displays arrow 103 at the center point, and arrow 103 points to the position of cursor 101.

[0238] It should be noted that in the above embodiment, when displaying visual reminder elements and visual indication elements on the display screen, a new transparent window can be created, the transparent window can be displayed on the top layer of all windows, and the visual reminder elements and visual indication elements can be displayed in the newly created transparent window.

[0239] For Figure 4 The system architecture shown illustrates the implementation of the cursor prompt method of the present application.

[0240] Fig.13 This is another structural diagram of an embodiment of the cursor prompt method of the present application. For the sake of description, the host corresponding to the display screen to which the cursor belongs is referred to as the first host, and the host other than the first host is referred to as the second host. The second host may be one or more. Figure 4 The value of n is relevant in the system architecture shown.

[0241] like Fig.13 As shown, the method may include:

[0242] Step 1301: The second host receives cursor position information, which is sent after the first host detects a cursor search operation.

[0243] Step 1302: The second host displays a first visual indication element on a display screen corresponding to the second host according to the position information of the cursor.

[0244] Step 1303: The second host determines that the first end condition is met, and ends the display of the first visual indication element on the display screen corresponding to the second host.

[0245] Different from Fig.13 In the embodiment shown, in order to better attract the user's visual attention, a visual reminder element can be further displayed before the visual indication element is displayed. Fig.14 As shown, before step 1302, the following may be included:

[0246] Step 1401: The second host displays a visual reminder element on a corresponding display screen.

[0247] Step 1402: The second host determines that the second end condition is met and executes step 1302.

[0248] In step 1302, when displaying the first visual indication element, it is generally necessary to use the position relationship information between the display screens. If the position relationship information is set Figure 4 In each host shown, the second host in step 1302 can obtain the position relationship information from the second host locally, and display the first visual indication element accordingly. If the position relationship information between the display screens is set in one of the hosts, the first host can send the cursor position information to the host, and the host centrally calculates the relevant display information required for the first visual reminder element displayed on each display screen, such as the display position, indication direction, graphic motion trajectory, etc. of the first visual reminder element, and sends the relevant display information to the corresponding second host, and the second host displays the first visual reminder element on the corresponding display screen based on the display information.

[0249] Fig.13 and Fig.14 The specific implementation of each step in the illustrated embodiment can refer to the corresponding description in the aforementioned embodiment, which will not be repeated here.

[0250] Different from the above-mentioned embodiment, if the host needs to relay the display of the same second graphic on the corresponding display screen, the animation of the movement from the preset pixel point of the first display screen to the cursor position, then each host needs to send a display notification to the next host that relays the display when the second graphic in the visual prompt element displayed by itself moves to the end point of the motion track in the corresponding display screen, so as to remind the next host to display the corresponding visual prompt element. For example, if the display screen to which the cursor belongs is adjacent to the display screen corresponding to the second host, the method may also include:

[0251] Determine whether the second graphic included in the first visual indication element displayed by the second host moves to the end point of the motion trajectory, and send a display notification to the first host, the display notification is used to instruct the first host to display the second visual indication element on the display screen corresponding to the first host, the second visual indication element includes: the second graphic and the second motion trajectory of the second graphic, the second motion trajectory is a second vector with the third intersection as the starting point and the position of the cursor as the end point, the third intersection is the intersection of the third straight line and the edge line of the display screen to which the cursor belongs, and the third straight line is a straight line passing through a preset pixel point of the display screen corresponding to the second host and the cursor position.

[0252] Fig.13 and Fig.14 The cursor prompt method shown allows the user to Figure 4 Under the system architecture shown, the cursor position can be quickly located through visual indication elements, thereby improving the user experience.

[0253] Fig.15 This is a flowchart of another embodiment of the cursor prompt method of the present application, which can be applied to Figure 2 A host in the system architecture shown, or Figure 3 A host under the system architecture shown; Fig.15 As shown, the method may include:

[0254] Step 1501: The host detects a cursor seek operation.

[0255] Among them, if the host in this step is Figure 2 The host in the system architecture shown is either Figure 3 In the system architecture shown, the cursor belongs to a host. In this step, the host can directly detect the cursor search operation based on the received mouse event or key event. The specific implementation can refer to the corresponding description in step 601, which is not repeated here.

[0256] Among them, if the host in this step is Figure 3 For a host other than the host to which the cursor belongs in the system architecture shown, the host to which the cursor belongs generally detects a cursor search operation based on a received mouse event or key event, and then sends a notification of detection of the cursor search operation to the host. When the host in this step receives the notification, it detects the cursor search operation; therefore, this step may include: the host receives a first notification sent by the host to which the cursor belongs, and the first notification is sent after the host to which the cursor belongs detects the cursor search operation.

[0257] Step 1502: The host determines the target display screen.

[0258] In a possible implementation, one of the n display screens may be preset as a default display screen, and accordingly, display screen information of the default display screen is preset in the host; in this case, step 1502 may include:

[0259] Acquire preset display screen information, and use the display screen indicated by the preset display screen information as the target display screen.

[0260] In another possible implementation, step 1502 may include:

[0261] The host obtains the first image captured by each camera, and the camera and the display screen are set accordingly;

[0262] The host selects a target display screen from the display screens according to the first image, where the target display screen is the display screen toward which the user's face is facing.

[0263] In order to capture the first image so as to determine whether the user's face is facing the display screen in the subsequent step, the camera corresponding to each display screen can be set in the middle position above the display screen, such as Fig.16As shown, the camera 1601 corresponding to the display screen 1602 is set at the upper middle position of the display screen 1602, and the camera 1603 corresponding to the display screen 1604 is set at the upper middle position of the display screen 1604.

[0264] Among them, if the host in this step is Figure 2 The host under the system architecture shown is connected to each camera, and the host can directly obtain the first image captured by the camera from the camera;

[0265] Among them, if the host in this step is Figure 3 For the hosts under the system architecture shown, each host is connected to a corresponding camera, and this step may include: the host obtains a first image taken by the corresponding camera from the camera; and obtains a first image taken by the camera corresponding to other hosts from other hosts other than the host.

[0266] The host selecting a target display screen from the display screens according to the first image may include:

[0267] The host determines whether there is a first image with typical facial features in the image; having typical facial features means that both eyes and a mouth can be identified from the target face in the image;

[0268] If it does not exist, it is determined that there is no target display screen. At this time, the host can keep the position of the cursor unchanged or display the cursor at a preset position on a preset display screen.

[0269] If so, determining the number of first images having typical facial features;

[0270] If the number is 1, the display screen corresponding to the first image having typical facial features is determined as the target display screen;

[0271] If the number is greater than 1, a first image is selected from the first images having typical facial features, and a display screen corresponding to the selected image is used as a target display screen.

[0272] Selecting a first image from first images having typical facial features may include:

[0273] For each first image with typical facial features, a triangle is drawn with the eyes and mouth of the target face in the first image as vertices, and the angle difference between the inner angles of the triangle with the eyes as vertices is calculated; and the display screen corresponding to the first image with the smallest angle difference is determined as the target display screen.

[0274] The first image may include multiple faces. At this time, a target face can be selected from the multiple faces. The target face can be input by the mouse operator in advance into the host, and the host stores the face information accordingly. In this step, the host can select the target face from the multiple faces in the first image for processing. For example, Fig.17 171 target faces are selected from the image.

[0275] See also Fig.17 , the left eye area 172, the right eye area 173 and the mouth area 174 of the target face can be identified according to the relevant image recognition method. The specific recognition method is not described in detail in the embodiment of this application. Furthermore, the center point A1 of the left eye area, the center point B1 of the right eye area and the center point C1 of the mouth area can be used as a vertex to draw the triangle A1B1C1. Afterwards, the difference between ∠C1A1B1 and ∠A1B1C1 can be calculated. The smaller the difference, the more the user's face is facing the display screen corresponding to the image, and the greater the possibility that the user is watching the display screen. Therefore, the display screen corresponding to the first image with the smallest difference can be selected as the target display screen.

[0276] Step 1503: The host displays a cursor on the target display screen.

[0277] The display position of the cursor on the target display screen is not limited and can be any point on the target display screen, preferably the center point.

[0278] Optionally, in order to remind the user to pay attention to the cursor on the target display screen, a special display effect can be added to the cursor when the cursor is displayed, such as the cursor size changing from large to normal size, an aperture of a preset duration being displayed outside the cursor, and so on.

[0279] Among them, if the host in this step is Figure 2 The host under the system architecture shown can directly control the target display screen to display the cursor;

[0280] Among them, if the host in this step is Figure 3 For the host under the system architecture shown, this step may include: the host determines that the target display screen is not the display screen corresponding to the host, and sends a cursor display indication to the host corresponding to the target display screen, where the cursor display indication is used to instruct the host corresponding to the target display screen to display a cursor on the target display screen; the host determines that the target display screen is the display screen corresponding to the host, and displays a cursor on the corresponding display screen.

[0281] The following is an example Fig.15 Cursor prompt method shown.

[0282] Fig.18 This is a flowchart of another embodiment of the cursor prompt method of the present application, which is applicable to Figure 2 The system architecture is shown.

[0283] In the method, the host 1814 is connected to the display screens 1811 to 1813 , and the cursor 181 is located on the display screen 1811 .

[0284] See also Fig.18 As shown in part 1810, if the user's face is located in front of the display screen 1812 and a cursor search operation is performed, the host detects the cursor search operation and selects the corresponding cameras ( Fig.18 (not shown) respectively acquiring first images captured by the cameras;

[0285] See also Fig.18 As shown in part 1820, the host selects a target display screen from the display screens according to the first image. Since the user's face is located in front of the display screen 1812, the target display screen finally selected by the host is the display screen 1812. The method for the host to select a target display screen from the display screens according to the first image is described in step 1503, which will not be repeated here.

[0286] See also Fig.18 As shown in part 1830 , the cursor 181 in the display screen 1811 is no longer displayed, and the host displays the cursor 181 in the display screen 1812 , wherein part 1830 of FIG. 1830 takes displaying the cursor 181 at the center point of the display screen 1812 as an example.

[0287] Fig.19 This is a flowchart of another embodiment of the cursor prompt method of the present application, which is applicable to Figure 3 In this method, the host 1914 is connected to the display screen 1913, the host 1915 is connected to the display screen 1911, the host 1916 is connected to the display screen 1812, and the cursor 191 is located on the display screen 1911. Each display screen is provided with a camera. Fig.19 Not shown in FIG.

[0288] See also Fig.19 As shown in part 1910, if the user's face is located in front of the display screen 1912 to perform a cursor search operation, the host 1915 detects the cursor search operation and sends a first notification to the host 1914; the host 1914 receives the first notification (that is, the cursor search operation is detected), obtains the first image taken by the camera from the camera corresponding to the display screen 1913, obtains the first image taken by the camera corresponding to the display screen 1911 from the host 1915, and obtains the first image taken by the camera corresponding to the display screen 1912 from the host 1916.

[0289] See also Fig.19As shown in part 1920, host 1914 selects a target display screen from display screens 1911 to 1913 based on the acquired first image. Since the user's face is located in front of display screen 1912, the target display screen finally selected by host 1914 is display screen 1912. Host 1914 sends a cursor display indication to host 1916 corresponding to display screen 1912 to instruct host 1916 to display a cursor on display screen 1912.

[0290] See also Fig.19 As shown in part 1930 , the host 1916 (part 1930 is not shown) displays the cursor 191 on the corresponding display screen 1912 , wherein part 1930 of FIG. 1930 takes displaying the cursor 191 at the center point of the display screen 1912 as an example.

[0291] Fig. 20 is a flowchart of another embodiment of the cursor prompt method of the present application, which is different from Fig.19 The host 1914 selects the target display screen. Fig. 20 The target display screen is selected by the host 1915 to which the cursor belongs; correspondingly:

[0292] exist Fig. 20 The 2010 part is different from Fig.19 In part 1910 , the host 1915 detects the cursor search operation and obtains a first image from the corresponding camera and the host 1914 and the host 1916 ;

[0293] exist Fig. 20 The 2020 part is different from Fig.19 In part 1920, the host 1915 selects a target display screen according to the first image and sends a cursor display instruction to the host 1916 corresponding to the target display screen 1912.

[0294] Fig.21 is a flowchart of another embodiment of the cursor prompt method of the present application, which is different from Fig.19 The target display screen selected by the host 1914 is the display screen 1912. Fig.21 The target display screen selected by the host 1914 is the display screen 1913 corresponding to the host 1914; accordingly,

[0295] exist Fig.21 The 2110 part is different from Fig.19 In part 1930, the host 1914 displays the cursor 191 on the display screen 1913, wherein part 2110 of Figure 21 takes displaying the cursor 191 at the center point of the display screen 1913 as an example.

[0296] In the above embodiment, the display screen facing the user's face is used as the target display screen, and the cursor is displayed on the target display screen. Since the display screen facing the user may be the display screen that the user needs to use next, by directly helping the user to move the cursor to the target display screen, it can not only help the user find the cursor, but also save the user from possible subsequent cursor movement operations.

[0297] Fig. 22 This is a flowchart of another embodiment of the cursor prompt method of the present application, which is applicable to Figure 2 In the method, the host 2214 is connected to the display screens 2211 to 2213 , and the cursor 221 is located on the display screen 2211 .

[0298] See also Fig. 22 As shown in part 2210, if the user performs a cursor search operation, the host detects the cursor search operation and obtains preset display screen information. Assuming that the display screen information indicates a display screen 2213, the host uses the display screen 2213 as the target display screen;

[0299] See also Fig. 22 As shown in part 2220 , the host displays a cursor 221 at the center point of the display screen 2213 .

[0300] Fig. 22 The method shown can be extended to Figure 3 As shown in the system architecture, at this time, if the target display screen is the display screen corresponding to the host executing the cursor prompt method, the host directly displays the cursor 221 on the corresponding display screen; otherwise, the host executing the cursor prompt method sends a cursor display instruction to the host corresponding to the target display screen, instructing the host corresponding to the target display screen to display the cursor.

[0301] Fig. 22 In the illustrated embodiment, as long as the user performs a cursor search operation, the cursor is displayed on a preset display screen, thereby helping the user to find the cursor by directly helping the user to move the cursor to the target display screen.

[0302] It is to be understood that some or all of the steps or operations in the above embodiments are merely examples, and the present application embodiments may also perform other operations or variations of various operations. In addition, the various steps may be performed in different orders presented in the above embodiments, and it is possible that not all of the operations in the above embodiments need to be performed.

[0303] Fig.23 This is a schematic diagram of the structure of an embodiment of the cursor prompt device of the present application. The device can be set in a host, such as Fig.23 As shown, the device 2300 may include:

[0304] An acquisition unit 2310 is used to detect a cursor search operation and acquire cursor position information;

[0305] Display unit 2320 is used to display a first visual indication element on a first display screen according to the position information of the cursor, and the first visual indication element is used to indicate the position of the cursor; the first display screen is a display screen other than the display screen to which the cursor belongs; when it is determined that the first termination condition is met, the display of the first visual indication element is terminated.

[0306] In a possible implementation, the first visual indication element includes a first graphic, and the first graphic has a direction pointing to the cursor position; or,

[0307] The first visual indication element includes an animation having a directional directivity pointing to the cursor position.

[0308] In a possible implementation, the animation includes: a second graphic and a first motion trajectory of the second graphic, the second graphic having a direction directivity pointing to a cursor position, and / or the first motion trajectory of the second graphic having a direction directivity pointing to a cursor position.

[0309] In a possible implementation, the display unit 2320 may be specifically used for:

[0310] The end of the cursor seek operation is detected; or,

[0311] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0312] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0313] In a possible implementation, the first visual indication element includes an animation, and the display unit 2220 can also be used to: display a visual reminder element on the first display screen; the visual reminder element includes a second graphic; and determine whether the second end condition is satisfied.

[0314] In a possible implementation, the display unit 2320 may be specifically used for:

[0315] The end of the cursor seek operation is detected; or,

[0316] It is determined that the display time of the visual reminder element reaches a second preset time.

[0317] In a possible implementation, determining that the first end condition is satisfied includes:

[0318] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0319] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0320] In a possible implementation, the first visual indication element includes a first graphic; the display unit 2320 may be specifically configured to:

[0321] Obtaining location information of a first location;

[0322] Determine a first direction according to the position information of the first position and the position information of the cursor, the first direction being the direction from the first position to the position of the cursor;

[0323] The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at a first position.

[0324] In a possible implementation, the display unit 2320 may be specifically used for:

[0325] Obtaining position information of a preset first pixel on the first display screen; calculating position information of a first intersection according to the position information of the cursor and the position information of the first pixel, and using the position information of the first intersection as the position information of the first position; the first intersection is the intersection of a first straight line and a sideline of the first display screen, and the first straight line is a straight line passing through the position of the cursor and the first pixel; or,

[0326] Acquire position information of a preset second pixel point on a first edge line of the first display screen, and use the position information of the second pixel point as position information of the first position, wherein the first edge line is the edge line of the first display screen closest to the position of the cursor; or,

[0327] The position information of a preset third pixel point on the first display screen is obtained, and the position information of the third pixel point is used as the position information of the first position.

[0328] In a possible implementation, the first visual indication element includes an animation, and the second graphic included in the animation has a direction pointing to the cursor position; the display unit 2320 can be specifically used to: obtain position information of a preset fourth pixel point on the first display screen;

[0329] The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

[0330] In a possible implementation, the first visual indication element includes an animation, and the first motion track included in the animation has a direction pointing to the cursor position; the display unit 2320 can be specifically used to: obtain position information of a preset fourth pixel point on the first display screen;

[0331] Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0332] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is used as a first motion trajectory to display a first visual indication element.

[0333] In a possible implementation, the first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position; the display unit 2320 can be specifically used to: obtain position information of a preset fourth pixel point on the first display screen;

[0334] Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0335] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction in which the fourth pixel point points to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

[0336] In a possible implementation, the display screen to which the cursor belongs is adjacent to the first display screen, and the display unit 2320 may also be used for:

[0337] Determine whether the second graphic included in the first visual indication element moves to the second intersection, and display the second visual indication element on the display screen to which the cursor belongs, the second visual indication element including: a second motion trajectory of the second graphic and the second graphic, the second motion trajectory being a second vector with the third intersection as the starting point and the position of the cursor as the end point, the third intersection being the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

[0338] In a possible implementation, the display unit 2320 may also be used to: highlight the display interface and / or the cursor with a preset effect on the display screen to which the cursor belongs.

[0339] In the device, a cursor search operation is detected, and a first visual indication element is displayed on a display screen other than the display screen to which the cursor belongs to indicate the cursor position, thereby enabling the user to find the cursor on the display screen relatively quickly in a multi-screen shared keyboard and mouse scenario, thereby enhancing the user experience.

[0340] Fig.24 This is a schematic diagram of the structure of an embodiment of the cursor prompt device of the present application. The device can be set in a host, such as Fig.24 As shown, the device 2400 may include:

[0341] The receiving unit 2410 is used to receive the position information of the cursor, and the position information is sent after the host to which the cursor belongs detects the cursor search operation;

[0342] The display unit 2420 is used to display a first visual indication element on a display screen corresponding to the host according to the position information of the cursor, where the first visual indication element is used to indicate the position of the cursor; when it is determined that the first end condition is met, the display of the first visual indication element is ended.

[0343] In a possible implementation, the first visual indication element includes a first graphic, and the first graphic has a direction pointing to the cursor position; or,

[0344] The first visual indication element includes an animation having a directional directivity pointing to the cursor position.

[0345] In a possible implementation, the animation includes: a second graphic and a first motion trajectory of the second graphic, the second graphic having a direction directivity pointing to a cursor position, and / or the first motion trajectory of the second graphic having a direction directivity pointing to a cursor position.

[0346] In a possible implementation, the display unit 2420 may be specifically used for:

[0347] The end of the cursor seek operation is detected; or,

[0348] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0349] It is determined that the second graphic in the first visual indication element moves to an end point of the first motion trajectory.

[0350] In a possible implementation, the first visual indication element includes an animation, and the display unit 2320 can also be used to: display a visual reminder element on a display screen corresponding to the host; the visual reminder element includes a second graphic; and determine whether the second end condition is satisfied.

[0351] In a possible implementation, the display unit 2420 may be specifically used for:

[0352] The end of the cursor seek operation is detected; or,

[0353] It is determined that the display time of the visual reminder element reaches a second preset time.

[0354] In a possible implementation, the display unit 2420 may be specifically used for:

[0355] Determining that the display duration of the first visual indication element reaches a first preset duration; or,

[0356] It is determined that the second graphic included in the first visual indication element moves to an end point of the first motion trajectory.

[0357] In a possible implementation, the first visual indication element includes a first graphic, and the display unit 2320 may be specifically configured to:

[0358] Obtaining location information of a first location;

[0359] Determine a first direction according to the position information of the first position and the position information of the cursor, the first direction being the direction from the first position to the position of the cursor;

[0360] The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at a first position.

[0361] In a possible implementation, the display unit 2420 may be specifically used for:

[0362] Obtaining position information of a preset first pixel point on the display screen corresponding to the host; calculating position information of a first intersection point according to the position information of the cursor and the position information of the first pixel point, and using the position information of the first intersection point as the position information of the first position; the first intersection point is the intersection point of a first straight line and the edge line of the display screen corresponding to the host, and the first straight line is a straight line passing through the position of the cursor and the first pixel point; or,

[0363] Obtaining position information of a preset second pixel point on a first edge line of a display screen corresponding to the host, and using the position information of the second pixel point as position information of the first position, wherein the first edge line is the edge line of the display screen corresponding to the host closest to the position of the cursor; or,

[0364] The position information of a preset third pixel point on the display screen corresponding to the host is obtained, and the position information of the third pixel point is used as the position information of the first position.

[0365] In a possible implementation, the first visual indication element includes an animation, and the second graphic included in the animation has a direction pointing to the cursor position; the display unit 2420 can be specifically used for:

[0366] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0367] The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

[0368] In a possible implementation, the first visual indication element includes an animation, and the first motion track included in the animation has a direction directivity pointing to the cursor position; the display unit 2420 can be specifically used for:

[0369] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0370] The position information of the second intersection is calculated according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection of the second straight line and the edge line of the display screen corresponding to the host; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0371] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is used as a first motion trajectory to display a first visual indication element.

[0372] In a possible implementation, the first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position; the display unit 2320 can be specifically used for:

[0373] Obtaining position information of a preset fourth pixel point on a display screen corresponding to the host;

[0374] The position information of the second intersection is calculated according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection of the second straight line and the edge line of the display screen corresponding to the host; the second straight line is a straight line passing through the cursor position and the fourth pixel point;

[0375] A first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction in which the fourth pixel point points to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

[0376] In a possible implementation, the display screen to which the cursor belongs is adjacent to the display screen corresponding to the host, and further includes:

[0377] A sending unit is used to determine whether the second graphic included in the first visual indication element moves to the second intersection, and send a display notification to the host to which the cursor belongs, wherein the display notification is used to instruct the host to which the cursor belongs to display the second visual indication element on the display screen to which the cursor belongs, wherein the second visual indication element includes: a second motion trajectory of the second graphic and the second graphic, wherein the second motion trajectory is a second vector with the third intersection as the starting point and the position of the cursor as the end point, and wherein the third intersection is the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

[0378] In the device, a cursor search operation is detected and a first visual indication element is displayed on the display screen corresponding to the host to indicate the cursor position, so that in a multi-screen shared keyboard and mouse scenario, the user can find the cursor on the display screen relatively quickly, thereby enhancing the user experience.

[0379] Fig.25 This is a schematic diagram of the structure of an embodiment of the cursor prompt device of the present application. The device can be set in a host, such as Fig.25As shown, the device 2500 may include:

[0380] A determination unit 2510, configured to detect a cursor search operation and determine a target display screen;

[0381] The display unit 2520 is used to display a cursor on a target display screen.

[0382] In a possible implementation, the determining unit 2510 may be specifically configured to:

[0383] The preset display screen information is obtained, and the display screen indicated by the preset display screen information is used as the target display screen.

[0384] In a possible implementation, the determining unit 2510 may include:

[0385] An acquisition unit, used to acquire a first image captured by each camera, the camera and the display screen being set correspondingly;

[0386] The selection unit is used to select a target display screen from the display screens according to the acquired first image, where the target display screen is the display screen that the user's face is facing.

[0387] In a possible implementation, the display unit 2520 may be specifically used for:

[0388] When it is determined that the target display screen is not the display screen corresponding to the host, a cursor display instruction is sent to the host corresponding to the target display screen, and the cursor display instruction is used to instruct the host corresponding to the target display screen to display a cursor on the target display screen.

[0389] In a possible implementation, the acquisition unit may be specifically used to:

[0390] A first image sent by another host is received, where the first image is a first image captured by a camera set on a display screen corresponding to the other host.

[0391] In a possible implementation, the selection unit may be specifically used to:

[0392] Determining that there is only one first image with typical facial features in the first images, and determining a display screen corresponding to the first image with typical facial features as a target display;

[0393] It is determined that there are at least two first images with typical facial features in the first images, and a target display screen is selected according to the first images with typical facial features.

[0394] In a possible implementation, the selection unit may be specifically used to:

[0395] For each first image, draw a triangle with the eyes and the mouth of the face in the first image as vertices, and calculate the angle difference between two internal angles of the triangle with the eyes as vertices;

[0396] The display screen corresponding to the first image with the smallest angle difference is selected as the target display screen.

[0397] In the device, an image is captured by a camera arranged corresponding to the display screen, and the display screen to which the user's face is facing is selected as the target display screen according to the image, and a cursor is displayed on the target display screen. As a result, as long as the user performs a cursor search operation, the cursor can be displayed on the display screen that the user is watching. In this way, in a multi-screen shared keyboard and mouse scenario, the user can find the cursor on the display screen relatively quickly, thereby enhancing the user experience.

[0398] Figures 23 to 25 The device provided in the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment of the present application. Its implementation principle and technical effects can be further referred to the relevant description in the method embodiment.

[0399] It should be understood that the above Figures 23 to 25 The division of the various units of the device shown is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these units can all be implemented in the form of software calling through processing elements; they can also be all implemented in the form of hardware; some units can also be implemented in the form of software calling through processing elements, and some units can be implemented in the form of hardware. For example, the acquisition unit can be a separately established processing element, or it can be integrated in a chip of an electronic device. The implementation of other units is similar. In addition, all or part of these units can be integrated together, or they can be implemented independently. In the implementation process, each step of the above method or the above units can be completed by the hardware integrated logic circuit in the processor element or the instructions in the form of software.

[0400] The present application also provides a host, comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the device, the device executes Figure 6 to Figure 22 The method shown.

[0401] The present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the present application. Figure 6 to Figure 22 The method provided by the illustrated embodiment.

[0402] The present application also provides a computer program product, which includes a computer program, which, when executed on a computer, enables the computer to execute the present application. Figure 6 to Figure 22 The method provided by the illustrated embodiment.

[0403] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, c can be single or multiple.

[0404] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0405] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0406] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), disk or optical disk, and other media that can store program codes.

[0407] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A cursor prompt method, applied to a host, characterized in that: include: Detecting a cursor search operation and obtaining cursor position information; Displaying a first visual indication element on a first display screen according to the position information of the cursor, wherein the first visual indication element is used to indicate the position of the cursor; the first display screen is a display screen other than the display screen to which the cursor belongs; Determining that a first end condition is met, and ending the display of the first visual indication element; Wherein, the first visual indication element includes a first graphic, and the first graphic has a direction directivity pointing to the cursor position; or, the first visual indication element includes an animation, and the animation has a direction directivity pointing to the cursor position; The determining that the first end condition is satisfied includes: detecting that the cursor search operation ends; or, It is determined that the display duration of the first visual indication element reaches a first preset duration.

2. The method according to claim 1, characterized in that: The animation includes: a second graphic and a first motion track of the second graphic, the second graphic having a direction directivity pointing to the cursor position, and / or the first motion track of the second graphic having a direction directivity pointing to the cursor position.

3. The method according to claim 2, characterized in that The first visual indication element includes an animation, and before displaying the first visual indication element on the first display screen, the method further includes: Displaying a visual reminder element on the first display screen; the visual reminder element includes the second graphic; It is determined whether the second end condition is satisfied.

4. The method according to claim 3, characterized in that: The determining that the second end condition is satisfied includes: detecting that the cursor search operation ends; or, It is determined that the display time of the visual reminder element reaches a second preset time.

5. The method according to any one of claims 1 to 4, characterized in that: The first visual indication element includes a first graphic; and displaying the first visual indication element on the first display screen according to the position information of the cursor includes: Obtaining location information of a first location; Determine a first direction according to the position information of the first position and the position information of the cursor, wherein the first direction is the direction in which the first position points to the position of the cursor; The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at the first position.

6. The method according to claim 5, characterized in that The obtaining the location information of the first location includes: Obtaining position information of a preset first pixel on the first display screen; calculating position information of a first intersection according to the position information of the cursor and the position information of the first pixel, and using the position information of the first intersection as the position information of the first position; the first intersection is the intersection of a first straight line and a sideline of the first display screen, and the first straight line is a straight line passing through the position of the cursor and the first pixel; or, Acquire position information of a preset second pixel point on a first edge of the first display screen, and use the position information of the second pixel point as the position information of the first position, wherein the first edge is the edge of the first display screen closest to the position of the cursor; or The position information of a preset third pixel point on the first display screen is obtained, and the position information of the third pixel point is used as the position information of the first position.

7. The method according to any one of claims 2 to 4, characterized in that: The first visual indication element includes an animation, and the second graphic included in the animation has a directional directivity pointing to the cursor position; The step of displaying a first visual indication element on a first display screen according to the position information of the cursor includes: Acquire position information of a preset fourth pixel point on the first display screen; The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

8. The method according to any one of claims 2 to 4, characterized in that: The first visual indication element includes an animation, and the first motion track included in the animation has a direction directivity pointing to the cursor position; The step of displaying a first visual indication element on a first display screen according to the position information of the cursor includes: Acquire position information of a preset fourth pixel point on the first display screen; Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point; A first vector formed by taking the fourth pixel point as a starting point and the second intersection point as an end point is used as the first motion trajectory, and the first visual indication element is displayed.

9. The method according to any one of claims 2 to 4, characterized in that: The first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position; The step of displaying a first visual indication element on a first display screen according to the position information of the cursor includes: Acquire position information of a preset fourth pixel point on the first display screen; Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the first display screen; the second straight line is a straight line passing through the cursor position and the fourth pixel point; The first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction of the fourth pixel point pointing to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

10. The method according to claim 8, characterized in that The step of displaying a first visual indication element on a first display screen according to the position information of the cursor further comprises: Determine whether the second graphic included in the first visual indication element moves to the second intersection, and display the second visual indication element on the display screen to which the cursor belongs, the second visual indication element including: the second graphic and a second motion trajectory of the second graphic, the second motion trajectory being a second vector with a third intersection as a starting point and the position of the cursor as an end point, the third intersection being an intersection of the second straight line and an edge line of the display screen to which the cursor belongs.

11. The method according to claim 9, characterized in that The step of displaying a first visual indication element on a first display screen according to the position information of the cursor further comprises: Determine whether the second graphic included in the first visual indication element moves to the second intersection, and display the second visual indication element on the display screen to which the cursor belongs, the second visual indication element including: the second graphic and a second motion trajectory of the second graphic, the second motion trajectory being a second vector with a third intersection as a starting point and the position of the cursor as an end point, the third intersection being an intersection of the second straight line and an edge line of the display screen to which the cursor belongs.

12. The method according to any one of claims 1 to 4, characterized in that: After the cursor search operation is detected, the method further includes: The display interface and / or the cursor are highlighted with a preset effect on the display screen to which the cursor belongs.

13. A cursor prompt method, applied to a first host, characterized in that: include: receiving position information of a cursor, wherein the position information is sent after a second host to which the cursor belongs detects a cursor search operation; Displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor, wherein the first visual indication element is used to indicate the position of the cursor; Determining that a first end condition is met, and ending the display of the first visual indication element; Wherein, the first visual indication element includes a first graphic, and the first graphic has a direction directivity pointing to the cursor position; or, the first visual indication element includes an animation, and the animation has a direction directivity pointing to the cursor position; The determining that the first end condition is satisfied includes: detecting that the cursor search operation ends; or, It is determined that the display duration of the first visual indication element reaches a first preset duration.

14. The method according to claim 13, characterized in that The animation includes: a second graphic and a first motion track of the second graphic, the second graphic having a direction directivity pointing to the cursor position, and / or the first motion track of the second graphic having a direction directivity pointing to the cursor position.

15. The method according to claim 14, characterized in that The first visual indication element includes an animation, and before displaying the first visual indication element on a display screen corresponding to the first host, the method further includes: Displaying a visual reminder element on a display screen corresponding to the first host; the visual reminder element includes the second graphic; It is determined whether the second end condition is satisfied.

16. The method according to claim 15, characterized in that The determining that the second end condition is satisfied includes: detecting that the cursor search operation ends; or, It is determined that the display time of the visual reminder element reaches a second preset time.

17. The method according to any one of claims 13 to 16, characterized in that: The first visual indication element includes a first graphic; and displaying the first visual indication element on a display screen corresponding to the first host according to the position information of the cursor includes: Obtaining location information of a first location; Determine a first direction according to the position information of the first position and the position information of the cursor, wherein the first direction is the direction in which the first position points to the position of the cursor; The first direction is used as the indication direction of the first graphic, and the first graphic is displayed at the first position.

18. The method according to claim 17, characterized in that The obtaining the location information of the first location includes: Obtaining position information of a preset first pixel point on the display screen corresponding to the first host; calculating position information of a first intersection point according to the position information of the cursor and the position information of the first pixel point, and using the position information of the first intersection point as the position information of the first position; the first intersection point is the intersection point of a first straight line and the edge line of the display screen corresponding to the first host, and the first straight line is a straight line passing through the position of the cursor and the first pixel point; or, Obtaining position information of a preset second pixel point on a first edge line of a display screen corresponding to the first host, and using the position information of the second pixel point as the position information of the first position, wherein the first edge line is a edge line of the display screen corresponding to the first host that is closest to the position of the cursor; or The position information of a preset third pixel point on the display screen corresponding to the first host is obtained, and the position information of the third pixel point is used as the position information of the first position.

19. The method according to any one of claims 14 to 16, characterized in that: The first visual indication element includes an animation, and the second graphic included in the animation has a directional directivity pointing to the cursor position; The step of displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor includes: Obtaining position information of a preset fourth pixel point on the display screen corresponding to the first host; The direction in which the fourth pixel point points to the cursor position is used as the indication direction of the second graphic, and the second graphic included in the first visual indication element is displayed.

20. The method according to any one of claims 14 to 16, characterized in that The first visual indication element includes an animation, and the first motion track included in the animation has a direction directivity pointing to the cursor position; The step of displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor includes: Obtaining position information of a preset fourth pixel point on the display screen corresponding to the first host; Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the display screen corresponding to the first host; the second straight line is a straight line passing through the cursor position and the fourth pixel point; A first vector formed by taking the fourth pixel point as a starting point and the second intersection point as an end point is used as the first motion trajectory, and the first visual indication element is displayed.

21. The method according to any one of claims 14 to 16, characterized in that The first visual indication element includes an animation, and the second graphic and the first motion track included in the animation both have a direction pointing to the cursor position; The step of displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor includes: Obtaining position information of a preset fourth pixel point on the display screen corresponding to the first host; Calculating the position information of the second intersection point according to the position information of the cursor and the position information of the fourth pixel point; the second intersection point is the intersection point of the second straight line and the edge line of the display screen corresponding to the first host; the second straight line is a straight line passing through the cursor position and the fourth pixel point; The first vector formed by taking the fourth pixel point as the starting point and the second intersection point as the end point is taken as the first motion trajectory, and the direction of the fourth pixel point pointing to the second intersection point is taken as the indication direction of the second graphic, and the first visual indication element is displayed.

22. The method according to claim 20, characterized in that The step of displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor further includes: Determine that the second graphic included in the first visual indication element moves to the second intersection, and send a display notification to the second host to which the cursor belongs, wherein the display notification is used to instruct the second host to which the cursor belongs to display a second visual indication element on the display screen to which the cursor belongs, and the second visual indication element includes: the second graphic and a second motion trajectory of the second graphic, the second motion trajectory is a second vector with a third intersection as the starting point and the position of the cursor as the end point, and the third intersection is the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

23. The method according to claim 21, characterized in that The step of displaying a first visual indication element on a display screen corresponding to the first host according to the position information of the cursor further includes: Determine that the second graphic included in the first visual indication element moves to the second intersection, and send a display notification to the second host to which the cursor belongs, wherein the display notification is used to instruct the second host to which the cursor belongs to display a second visual indication element on the display screen to which the cursor belongs, and the second visual indication element includes: the second graphic and a second motion trajectory of the second graphic, the second motion trajectory is a second vector with a third intersection as the starting point and the position of the cursor as the end point, and the third intersection is the intersection of the second straight line and the edge line of the display screen to which the cursor belongs.

24. A cursor prompt method, applied to a host, characterized in that: A plurality of display screens are provided, and the host is connected to the plurality of display screens respectively, or the host is connected to one of the plurality of display screens; the method comprises: Detecting a cursor search operation, and determining a target display screen among the multiple display screens; displaying a cursor on the target display screen; The step of determining the target display screen comprises: Acquire preset display screen information, and use the default display screen indicated by the preset display screen information as the target display screen; the preset display screen information is used to indicate the default display screen; Alternatively, determining the target display screen includes: Acquire a first image captured by each camera, wherein the camera is arranged corresponding to the first display screen; A target display screen is selected from the first display screen according to the acquired first image, where the target display screen is the first display screen toward which the user's face is facing.

25. The method according to claim 24, characterized in that The step of displaying a cursor on the target display screen comprises: When it is determined that the target display screen is not the display screen corresponding to the host, a cursor display instruction is sent to the host corresponding to the target display screen, wherein the cursor display instruction is used to instruct the host corresponding to the target display screen to display a cursor on the target display screen.

26. The method according to claim 25, characterized in that The step of obtaining the first image captured by each camera includes: A first image sent by another host is received, where the first image is a first image captured by a camera disposed on a first display screen corresponding to the other host.

27. The method according to any one of claims 24 to 26, characterized in that The step of selecting a target display screen from the first display screen according to the acquired first image comprises: determining that there is only one first image with typical facial features in the first images, and determining a first display screen corresponding to the first image with typical facial features as a target display screen; It is determined that there are at least two first images with typical facial features in the first images, and the target display screen is selected according to the first images with typical facial features.

28. The method according to claim 27, characterized in that The step of selecting the target display screen according to the first image having typical facial features comprises: For each first image, draw a triangle with the eyes and the mouth of the face in the first image as vertices, and calculate the angle difference between two internal angles of the triangle with the eyes as vertices; The display screen corresponding to the first image having the smallest angle difference is selected as the target display screen.

29. A host, characterized in that: include: one or more processors; Memory; One or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the processor, cause the host to perform the method of any one of claims 1 to 28.

30. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 28.

Images