A multifunctional mouse based on Internet of Things and control method thereof
By integrating eye tracker and WIFI communication module in a multi-function mouse, the moving average speed of the eye focus is calculated, and the problem of inaccurate mouse cursor position caused by excessive eye movement is solved, and higher control accuracy and stability are achieved sex.
Patent Information
- Application Number
- CN202311630091.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-30
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2043-11-30
AI Technical Summary
In the prior art, when the eye tracking device is used to control the mouse cursor, the eye movement is mainly about jumping and gaze, which leads to compensation and correction of the eye focus tracking process, and the eye movement is too fast, resulting in the mouse cursor position not precise.
Design a multi-function mouse, including WIFI communication module, wireless charging module, battery, WIFI relay device and eye tracker, to obtain the displacement state and movement time of the eye focus through the eye tracker, calculate the moving average speed, and then Determine the position of the mouse cursor and use the preset threshold for compensation and correction.
It effectively avoids inaccurate position of the mouse cursor due to excessive eye movement, and improves the control accuracy and stability of the mouse cursor.
Smart Images

Figure CN117631855B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a multifunctional mouse based on the Internet of Things and a control method thereof. Background Art
[0002] With the progress and development of science, electronic devices, such as computers, have become indispensable tools in our lives. There are many ways for people to interact with electronic devices. For example, a mouse device can be used to control the cursor on the electronic device to interact with the system. Conventional mouse devices are optical mice, that is, the movement of the mouse cursor is controlled by hand movement, but for people with inconvenient hands, there may be inconvenience in use.
[0003] In the prior art, an eye tracking device has been proposed to control the position of a mouse cursor, but eye movements are mainly jumping and staring, so it is necessary to compensate and correct the tracking process of the eye focus. Summary of the invention
[0004] The embodiment of the present application proposes a multifunctional mouse of the Internet of Things level to improve the above-mentioned technical problems.
[0005] In a first aspect, an embodiment of the present application proposes a multi-function mouse, comprising: a mouse body, the mouse body comprising a WIFI communication module, a wireless charging module and a battery, the wireless charging module being electrically connected to the battery; a WIFI relay device; and an eye tracker, wherein the mouse body is communicatively connected to the eye tracker via the WIFI relay device.
[0006] In some embodiments, the mouse body further comprises:
[0007] A displacement state acquisition module, the displacement state acquisition module is used to obtain the eye focus displacement state through the eye tracker; a time acquisition module, the time acquisition module is used to obtain the movement time t1 of the eye focus; an average speed confirmation module, the average speed confirmation module is used to determine the moving average speed of the eye focus according to the running time of the eye focus and the displacement state; a cursor confirmation module, the cursor confirmation module is used to determine the position of the mouse cursor according to the moving average speed of the eye focus.
[0008] It is understandable that the displacement state may include a displacement distance. The displacement distance may be a movement distance of a mouse cursor displayed on a display. It is understandable that within a unit time, the eye tracker may obtain information such as the displacement speed and the displacement distance of the eye focus.
[0009] In the second aspect, the present application proposes a multi-function mouse control method, which is applicable to a multi-function mouse as described in any of the above items, and the method includes: obtaining the eye focus displacement state through the eye tracker; obtaining the movement time t1 of the eye focus; determining the average moving speed of the eye focus according to the running time of the eye focus and the displacement state; determining the position of the mouse cursor according to the average moving speed of the eye focus.
[0010] It is understandable that in this embodiment, t1 can be a unit time. During the operation of the multifunctional mouse, multiple unit times t1 can be linearly connected, that is, after one unit time t1 ends, the next unit time t1 is repeated, so as to achieve control of the mouse cursor for a longer time.
[0011] In some embodiments, the position of the mouse cursor is determined based on the average moving speed of the eye focus, including: obtaining a first position of the eye focus; obtaining a second position of the eye focus, wherein the second position is the position of the mouse icon after the movement time t1; determining a target position based on the first position and the second position, wherein the target position is the midpoint between the first position and the second position; if the average moving speed of the eye focus is greater than a preset threshold value v1, determining the position of the mouse cursor as the target position.
[0012] In some implementations, the method further includes determining that the position of the mouse cursor is the second position if the average moving speed of the eye focus is less than or equal to the preset threshold value v1.
[0013] It can be understood that the moving average speed of the eye focus is determined by the running time of the eye focus and the displacement state. The average speed can be the total distance of displacement divided by the duration of displacement. In some embodiments, it also includes determining the displacement distance according to the displacement state; and determining the moving average speed according to the displacement distance and the movement time t1.
[0014] In some embodiments, the position of the mouse cursor is determined based on the average moving speed of the eye focus, including: obtaining a first position of the eye focus; obtaining a second position of the eye focus, the second position being the position of the mouse icon after the moving time t2; obtaining a third position of the eye focus, the third position being the position of the mouse icon after the moving time t3, wherein the moving time t1 is equal to the sum of the moving time t2 and the moving time t3; determining a target position based on the first position, the second position, and the third position, wherein the target position is the geometric center formed by the lines connecting the first position, the second position, and the third position; if the average moving speed of the eye focus is greater than a preset threshold value v2, the position of the mouse cursor is determined to be the target position.
[0015] The method further includes: if the average moving speed of the eye focus is less than or equal to the preset threshold value v2, determining the position of the mouse cursor as the third position.
[0016] In a third aspect, the present application proposes a computer-readable storage medium storing a computer program, characterized in that when the computer program is loaded and executed by a processor, it implements any of the methods described above.
[0017] In a fourth aspect, the present application proposes an electronic device, characterized in that it includes a processor and a memory, wherein the memory is used to store a computer program; and the processor is used to load and execute the computer program to implement any of the methods described above.
[0018] The embodiment of the present application proposes a multifunctional mouse based on the Internet of Things and a control method thereof, the multifunctional mouse includes a mouse body, the mouse body includes a WIFI communication module, a wireless charging module and a battery, the wireless charging module is electrically connected to the battery; a WIFI relay device; and an eye tracker, wherein the mouse body is communicatively connected to the eye tracker via the WIFI relay device. The eye focus displacement state is obtained through the eye tracker; the moving time t1 of the eye focus is obtained; the moving average speed of the eye focus is determined according to the running time of the eye focus and the displacement state; the position of the mouse cursor is determined according to the moving average speed of the eye focus. The present application proposes a mouse control method based on the Internet of Things, when using an eye tracking device to control the mouse cursor, it can compensate and correct the tracking process of the eye focus, thereby avoiding inaccurate mouse cursor position due to excessive eye movement. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the implementation modes of the present application, the drawings required for use in the description of the implementation modes will be briefly introduced below. Obviously, the drawings described below are only some implementation modes of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0020] Figure 1 A flowchart of a mouse control method proposed in an embodiment of the present application;
[0021] Figure 2 A structural block diagram of a multi-function mouse proposed in an embodiment of the present application;
[0022] Figure 3 This is a structural block diagram of an electronic device proposed in an embodiment of the present application. DETAILED DESCRIPTION
[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the implementation mode of the present application. Obviously, the described implementation mode is only a part of the implementation mode of the present application, not all the implementation modes. Based on the implementation mode in the present application, all other implementation modes obtained by those skilled in the art without making creative work are within the scope of protection of the present application.
[0024] In this application, unless otherwise clearly specified or limited, the terms "installation", "connection", "fixation" and the like should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be internal communication between two elements, or it can be only surface contact, or surface contact connection through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0025] In the embodiments of the present application, words such as "exemplarily" and "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "example" is intended to present concepts in a concrete way. In addition, in the embodiments of the present application, the meaning expressed by "and / or" can be both, or it can be either of the two.
[0026] Computers have become an indispensable tool in our lives. There are many ways for people to interact with electronic devices. In related technologies, for example, the position of the mouse cursor is controlled by an eye tracking device. However, eye movements are mainly jumping and staring, so it is necessary to compensate and correct the tracking process of the eye focus.
[0027] To this end, the present application provides a solution, obtaining the eye focus displacement state through the eye tracker; obtaining the movement time t1 of the eye focus; determining the average moving speed of the eye focus according to the running time of the eye focus and the displacement state; and determining the position of the mouse cursor according to the average moving speed of the eye focus.
[0028] An embodiment of the present application proposes a multi-function mouse, comprising: a mouse body, the mouse body comprising a WIFI communication module, a wireless charging module and a battery, the wireless charging module being electrically connected to the battery; a WIFI relay device; and an eye tracker, wherein the mouse body is communicatively connected to the eye tracker via the WIFI relay device.
[0029] It is understandable that the mouse body can be a wireless mouse, which can be electrically connected to a WIFI module. The WIFI relay device can be arranged inside the mouse body, or it can be a structure independent of the mouse body, which is not limited here. The WIFI relay device can expand and bridge the WIFI range. Its specific structure and operation mode are relatively common in the relevant technology and are not limited here. The WIFI relay device can relay the WIFI signal to expand the range of the WIFI router and realize the multi-function of the mouse.
[0030] The solution of the present application is further described below in conjunction with the accompanying drawings.
[0031] See also Figure 1 , an embodiment of the present application proposes a mouse control method, which is applied to a multi-function mouse, the multi-function mouse includes an eye tracker, and the method includes steps S101 to S104.
[0032] S101. Acquire the eye focus displacement state through the eye tracker.
[0033] Exemplarily, in this embodiment, the displacement state may include a displacement distance. The displacement distance may be a movement distance of a mouse cursor displayed on a display. It is understandable that, within a unit time, the eye tracker may obtain information such as the displacement speed and the displacement distance of the eye focus.
[0034] S102: Obtain the moving time t1 of the eye focus.
[0035] It is understandable that in this embodiment, t1 can be a unit time. During the operation of the multifunctional mouse, multiple unit times t1 can be linearly connected, that is, after one unit time t1 ends, the next unit time t1 is repeated, so as to achieve control of the mouse cursor for a longer time.
[0036] S103, determining the moving average speed of the eye focus according to the running time of the eye focus and the displacement state.
[0037] It can be understood that the moving average speed of the eye focus is determined by the running time of the eye focus and the displacement state. The average speed can be the total distance of displacement divided by the duration of displacement. In some embodiments, it also includes determining the displacement distance according to the displacement state; and determining the moving average speed according to the displacement distance and the movement time t1.
[0038] S104: Determine the position of the mouse cursor according to the average moving speed of the eye focus.
[0039] When the eye tracking device is used to control the mouse cursor, the tracking process of the eye focus can be compensated and corrected, thereby avoiding inaccurate mouse cursor position caused by too fast eye movement.
[0040] Specifically, in this embodiment, determining the position of the mouse cursor according to the average moving speed of the eye focus may include the following steps S201 to S204:
[0041] S201, obtaining a first position of an eye focus.
[0042] It can be understood that the first position of the eye focus is the initial position at the beginning of the unit time t1.
[0043] S202, obtaining a second position of the eye focus, wherein the second position is a position of the mouse icon after the movement time t1;
[0044] In this embodiment, the process of the eye trajectory moving from the first position to the second position is only taken as a straight line. This method can eliminate slight eye tremors. In some embodiments, determining the position of the mouse cursor according to the moving average speed of the eye focus can also include: obtaining the first position of the eye focus; obtaining the second position of the eye focus, the second position is the position of the mouse icon after the moving time t2; obtaining the third position of the eye focus, the third position is the position of the mouse icon after the moving time t3, wherein the moving time t1 is equal to the sum of the moving time t2 and the moving time t3; determining the target position according to the first position, the second position and the third position, wherein the target position is the geometric center formed by the line connecting the first position, the second position and the third position; if the moving average speed of the eye focus is greater than the preset threshold value v2, the position of the mouse cursor is determined to be the target position.
[0045] S203, determining a target position according to the first position and the second position, wherein the target position is a midpoint between the first position and the second position;
[0046] The first position and the second position are connected by a straight line, so in this embodiment, the midpoint between the first position and the second position can be taken as the target position.
[0047] S204: If the average moving speed of the eye focus is greater than a preset threshold value v1, determine the position of the mouse cursor as the target position.
[0048] In this embodiment, the preset threshold value v1 is a specific speed. When the eye vibrates or moves to a greater extent, the corresponding average speed of the eye focus will be greater and greater than the preset threshold. In this case, the target position is also the cursor position. In this way, when the eye moves quickly, the cursor can move in a slower manner, avoiding inaccurate pointing caused by the cursor moving too fast.
[0049] In some implementations, step S205 is also included.
[0050] S205: If the average moving speed of the eye focus is less than or equal to the preset threshold value v1, determine the position of the mouse cursor as the second position.
[0051] When the moving speed is less than the preset threshold, the mouse is in a normal state. In this state, the target position is always following the user's focus. In this process, the eye focus moves to the second position, and correspondingly, the mouse cursor also moves to the second position.
[0052] In some embodiments, if the average moving speed of the eye focus is greater than a preset threshold value v1, before determining that the position of the mouse cursor is the target position, the method further includes: acquiring the preset threshold value v1.
[0053] It is understandable that the preset threshold value v1 can be an adjustable threshold value, and the threshold value can be adjusted according to the specific usage of the user. For example, when the user controls the mouse cursor to move quickly, such as when playing a shooting game, the threshold value can be reduced so that the mouse cursor can track the focus movement of the user's eyes at any time. However, when the user performs operations such as text reading, the threshold value V1 can be increased accordingly to avoid running faster.
[0054] In some embodiments, the position of the mouse cursor is determined based on the average moving speed of the eye focus, including: obtaining a first position of the eye focus; obtaining a second position of the eye focus, the second position being the position of the mouse icon after the moving time t2; obtaining a third position of the eye focus, the third position being the position of the mouse icon after the moving time t3, wherein the moving time t1 is equal to the sum of the moving time t2 and the moving time t3; determining a target position based on the first position, the second position, and the third position, wherein the target position is the geometric center formed by the lines connecting the first position, the second position, and the third position; if the average moving speed of the eye focus is greater than a preset threshold value v2, the position of the mouse cursor is determined to be the target position.
[0055] The embodiment proposes a multifunctional mouse based on the Internet of Things, which obtains the eye focus displacement state through the eye tracker; obtains the movement time t1 of the eye focus; determines the moving average speed of the eye focus according to the running time of the eye focus and the displacement state; and determines the position of the mouse cursor according to the moving average speed of the eye focus. The application proposes a mouse control method, which can compensate and correct the eye focus tracking process when controlling the mouse cursor using an eye tracking device, thereby avoiding inaccurate mouse cursor position caused by too fast eye movement.
[0056] This application proposes a multifunctional mouse 100, see Figure 2 ,include:
[0057] A displacement state acquisition module 200, wherein the displacement state acquisition module 200 is used to acquire the eye focus displacement state through the eye tracker;
[0058] Optionally, in some implementations, the displacement state acquisition module 200 may also be used to determine a displacement distance according to the displacement state; and determine a moving average speed according to the displacement distance and the moving time t1.
[0059] The time acquisition module 300 is used to acquire the movement time t1 of the eye focus. In this embodiment, the displacement state may include a displacement distance. The displacement distance may be a movement distance of a mouse cursor displayed on a display. It is understandable that within a unit time, the eye tracker may acquire the eye focus such as the displacement speed and the displacement distance.
[0060] The average speed confirmation module 400 is used to determine the moving average speed of the eye focus according to the running time of the eye focus and the displacement state.
[0061] It is understandable that in this embodiment, t1 can be a unit time. During the operation of the multifunctional mouse 100, multiple unit times t1 can be linearly connected, that is, after one unit time t1 ends, the next unit time t1 is repeated, so as to achieve control of the mouse cursor for a longer time.
[0062] The cursor confirmation module 500 is used to determine the position of the mouse cursor according to the average moving speed of the eye focus. It can be understood that the average moving speed of the eye focus is determined by the running time of the eye focus and the displacement state. The average speed can be the total distance of the displacement divided by the duration of the displacement. In some embodiments, it also includes determining the displacement distance according to the displacement state; determining the moving average speed according to the displacement distance and the movement time t1.
[0063] Optionally, in some embodiments, the position of the mouse cursor is determined according to the average moving speed of the eye focus, including: obtaining the first position of the eye focus; obtaining the second position of the eye focus, the second position being the position of the mouse icon after the moving time t2; obtaining the third position of the eye focus, the third position being the position of the mouse icon after the moving time t3, wherein the moving time t1 is equal to the sum of the moving time t2 and the moving time t3; determining the target position according to the first position, the second position and the third position, wherein the target position is the geometric center formed by the lines connecting the first position, the second position and the third position; if the average moving speed of the eye focus is greater than a preset threshold value v2, the position of the mouse cursor is determined to be the target position.
[0064] Optionally, the cursor confirmation module may also be used to obtain the first position of the eye focus.
[0065] Optionally, the cursor confirmation module may also be used to obtain a second position of the eye focus, wherein the second position is the position of the mouse icon after the movement time t1.
[0066] Optionally, the cursor confirmation module may also be used to determine a target position according to the first position and the second position, wherein the target position is a midpoint between the first position and the second position.
[0067] The multifunctional mouse 100 proposed in this embodiment obtains the eye focus displacement state through the eye tracker; obtains the movement time t1 of the eye focus; determines the moving average speed of the eye focus according to the running time of the eye focus and the displacement state; and determines the position of the mouse cursor according to the moving average speed of the eye focus. A mouse control method proposed in this application can compensate and correct the eye focus tracking process when controlling the mouse cursor using an eye tracking device, thereby avoiding inaccurate mouse cursor position caused by excessive eye movement.
[0068] In a third aspect, the present application proposes a computer-readable storage medium storing a computer program, characterized in that when the computer program is loaded and executed by a processor, it implements any of the methods described above.
[0069] In a fourth aspect, the present application proposes an electronic device, characterized in that it includes a processor and a memory, wherein the memory is used to store a computer program; and the processor is used to load and execute the computer program to implement the method as described above.
[0070] like Figure 3 As shown, the electronic device 2000 may include a processor 2001 .
[0071] Optionally, the electronic device 2000 may further include a memory 2002 and / or a transceiver 2003 .
[0072] The processor 2001 is coupled with the memory 2002 and the transceiver 2003, for example, via a communication bus.
[0073] Combine the following Figure 3 The components of the electronic device 2000 are described in detail:
[0074] The processor 2001 is the control center of the electronic device 2000, and may be a processor or a general term for multiple processing elements. For example, the processor 2001 is one or more central processing units (CPUs), or may be application specific integrated circuits (ASICs), or may be configured to implement one or more integrated circuits of the embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs), or one or more field programmable gate arrays (FPGAs).
[0075] Optionally, the processor 2001 can perform various functions of the electronic device 2000 by running or executing a software program stored in the memory 2002 and calling data stored in the memory 2002.
[0076] In a specific implementation, as an embodiment, the processor 2001 may include one or more CPUs, such as Figure 3 CPU0 and CPU1 are shown in FIG.
[0077] In a specific implementation, as an embodiment, the electronic device 2000 may also include multiple processors, such as Figure 3 2001 and processor 2004 are shown in FIG. Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).
[0078] The memory 2002 is used to store the software program for executing the solution of the present application, and the execution is controlled by the processor 2001. The specific implementation method can refer to the above method embodiment, which will not be repeated here.
[0079] Optionally, the memory 2002 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2002 may be integrated with the processor 2001, or may exist independently and access the computer through the interface circuit ( Figure 3 ) is coupled to the processor 2001, which is not specifically limited in the embodiment of the present application.
[0080] The transceiver 2003 is used for communication with other electronic devices. For example, if the electronic device 2000 is a mobile terminal, the transceiver 2003 can be used to communicate with a network device or another terminal device. For another example, if the electronic device 2000 is a network device, the transceiver 2003 can be used to communicate with a terminal device or another network device.
[0081] Optionally, the transceiver 2003 may include a receiver and a transmitter ( Figure 3 The receiver is used to implement a receiving function, and the transmitter is used to implement a sending function.
[0082] Optionally, the transceiver 2003 may be integrated with the processor 2001, or may exist independently and communicate with the processor 2001 through the interface circuit ( Figure 3 ) is coupled to the processor 2001, which is not specifically limited in the embodiment of the present application.
[0083] It should be noted that Figure 3 The structure of the electronic device 2000 shown in the figure does not constitute a limitation on the electronic device. The actual electronic device may include more or fewer components than those shown in the figure, or combine certain components, or arrange the components differently.
[0084] In addition, the technical effects of the electronic device 2000 can refer to the technical effects of the elastic file delay control method described in the above method embodiment, and will not be repeated here.
[0085] It should be understood that the processor in the embodiments of the present application may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0086] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0087] The above embodiments can be implemented in whole or in part by software, hardware (such as circuits), firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.
[0088] It should be understood that the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. A and B can be singular or plural. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship, but it may also indicate an "and / or" relationship. Please refer to the context for specific understanding.
[0089] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0090] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0091] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0092] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0093] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0094] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0095] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0096] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.
[0097] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0098] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that an article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such article or device. In the absence of more restrictions, the elements defined by the sentence "includes..." do not exclude the existence of other identical elements in the article or device including the elements.
[0099] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.
[0100] In summary, this embodiment proposes a multifunctional mouse, which obtains the eye focus displacement state through the eye tracker; obtains the movement time t1 of the eye focus; determines the moving average speed of the eye focus according to the running time of the eye focus and the displacement state; and determines the position of the mouse cursor according to the moving average speed of the eye focus. A mouse control method proposed in this application can compensate and correct the eye focus tracking process when controlling the mouse cursor using an eye tracking device, thereby avoiding inaccurate mouse cursor position caused by excessive eye movement.
[0101] The above implementation modes are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned implementation modes, a person skilled in the art should understand that the technical solutions described in the aforementioned implementation modes can still be modified, or some of the technical features can be replaced by equivalents. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various implementation modes of the present application, and should all be included in the protection scope of the present application.
Claims
1. A multifunctional mouse control method based on the Internet of Things, characterized in that: The multifunctional mouse comprises: a mouse body, the mouse body comprises a WIFI communication module, a wireless charging module and a battery, the wireless charging module is electrically connected to the battery; a WIFI relay device, and an eye tracker, wherein the mouse body is communicatively connected to the eye tracker via the WIFI relay device, and the method comprises: Acquiring the eye focus displacement state through the eye tracker; Obtaining the moving time t1 of the eye focus; Determining the moving average speed of the eye focus according to the running time of the eye focus and the displacement state; Determining the position of the mouse cursor according to the average moving speed of the eye focus; Get the first position of the eye focus; Acquire a second position of the eye focus, where the second position is the position of the mouse icon after the movement time t2; Acquire a third position of the eye focus, the third position being the position of the mouse icon after the movement time t3, wherein the movement time t1 is equal to the sum of the movement time t2 and the movement time t3; Determine a target position according to the first position, the second position and the third position, wherein the target position is a geometric center formed by a line connecting the first position, the second position and the third position; If the average moving speed of the eye focus is greater than a preset threshold value v2, the position of the mouse cursor is determined to be the target position.
2. The method according to claim 1, characterized in that The method further comprises: If the average moving speed of the eye focus is less than or equal to the preset threshold value v2, the position of the mouse cursor is determined to be the third position.
3. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is loaded and executed by a processor, the method according to any one of claims 1 to 2 is implemented.
Citation Information
Patent Citations
A mouse
CN109324703A
Method for controlling mouse cursor using eye recognition and electronic device using same
KR1020150025041A