20 results about "Virtual mouse" patented technology

The present invention provides a solution of a human-computer interaction method and system based on three-dimensional coordinate measurement, and a plurality of solutions for applying same to solve technical problems. An operation body and / or an operator performs input and operation interaction by means of a virtual keyboard and a virtual mouse, or integrates a display picture space and carries out various participatory and interactive direct operations and experiences on object components and objects in virtual and real scenes. Virtual handwriting input, body movement posture recognition, and lip recognition interaction methods are further provided, and virtual mode control and interaction methods such as gesture recognition and virtual touch screen interaction are supported. Contact is not needed and there is no need to touch the screen, and mobility is achieved. The present invention is suitable for the two-dimensional conventional computing field, and particularly suitable for three-dimensional space computing fields (comprising VR, MR, AR, meta-universe, virtual simulation, software games, three-dimensional graphics, three-dimensional animation, and other three-dimensional scenes). Human-computer interaction operations in work and life of people can be greatly facilitated and optimized.

The invention provides a mouse control monitoring method and device, and the method comprises the steps: monitoring the movement of a mouse through a GCMouse module when a mouse mode of a cloud application is a mouse-free mode, obtaining the offset of the movement of the mouse, and determining first intermediate data according to the offset of the movement of the mouse; and sending the first intermediate data to a cloud server, so that the cloud server determines a first mouse movement event according to the first intermediate data, and sending the first mouse movement event to a system of the cloud server through the virtual mouse, the first intermediate data comprises source data or intermediate result data or target result data in the process of obtaining the first mouse movement event according to the offset of mouse movement; in the mouse-free mode scene of the cloud application, when the mouse cursor moves to the edge of the iPhone screen and cannot continue to move outwards, the movement of the mouse can still be monitored by moving the mouse outwards, and then the cloud application is controlled, and the mouse control response speed is superior to that of an H5 scheme.

A display keyboard, video, mouse (KVM) switch associates video and data ports with an information handling system by communicating identifiable information between the KVM switch and information handling system through both video and data ports to confirm which of the data ports is associated with a video port that presents visual images of the information handling system. The identifiable information includes a unique token or virtual mouse inputs communicated as data to an information handling system that are detected in visual information communicated as mouse cursor movements.

A gesture-based control system utilizes real-time camera input and artificial intelligence to interpret user hand gestures for controlling a digital interface. The system includes a camera and processor configured to analyze image data using machine learning models trained on a diverse set of stored hand gesture representations. Gestures are recognized based on positional attributes, handedness, and motion vectors, and are mapped to input commands such as swipe left, right, up, or down. The system is designed for simplicity, using natural, intuitive gestures, such as swiping, thumbs up, thumbs down, and the “OK” sign, requiring no memorization or complex training. These familiar motions enable touch-free navigation and interaction with digital content, including support for hierarchical menu structures. The system can operate with or without visual gesture feedback. Methods and non-transitory computer-readable media are also disclosed for performing gesture detection and command execution.

The present application provides a method and apparatus for handling manipulation events. The method includes: receiving first intermediate data and / or second intermediate data sent by a mobile device, determining a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data; sending the first mouse event to the system of a cloud server through a virtual mouse to move a target object of a cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application, and accurate positioning operations on the application object of the cloud application that only supports keyboard and mouse manipulation can be realized by a user.

To improve appropriate operation of a non-player object in a game using mouse input by a user.SOLUTION: A player object is controlled on the basis of mouse operation data acquired from a mouse, and a non-player object is controlled on the basis of travel distance in an input state of a virtual mouse that travels continuously within a virtual range in the input state or a non-input state.SELECTED DRAWING: Figure 7

Systems and methods are disclosed for providing a virtual mouse for a computing device have a touchscreen. A first placement region of the touchscreen may be determined. The first placement region may then be determined to contain a first portion of at least one touch target. The first portion of the at least one touch target may then be deactivated. A virtual mouse may then be activated at the first placement region.

The invention provides a position data transmission method and device.When a virtual mouse in second equipment is controlled through first equipment, the position data transmission method comprises the steps that current to-be-sent position data of the first equipment is stored in a set array; processing the position data in the set array by using a set algorithm to obtain current target position data, and resetting the set array; and controlling the position of a virtual mouse in the second equipment based on the current target position data. By means of the mode, under the condition that the data transmission frequency is limited, the optimal target position data can be found out and sent to the second device, and therefore it can still be guaranteed that the position data are more average under the condition that the sending frequency is reduced, the situation that movement of a virtual mouse in the second device is stuck is avoided, and the user experience is improved. Therefore, the movement of the virtual mouse in the second equipment is smoother, the interface operation of the second equipment is smoother, and the user experience is improved.

The present application relates to a multi-modal intelligent mouse control method and an intelligent mouse. The method includes: when a multi-modal wake-up instruction for the intelligent mouse is obtained, different candidate virtual mice are created in each application interface of the operating device, and different temporary storage spaces are created for each candidate virtual mouse; wherein the application interface is an operation page corresponding to an application in use in the operating device; when a data transfer instruction of the operator is obtained, the source candidate virtual mouse and the destination candidate virtual mouse corresponding to the data transfer instruction are determined from each candidate virtual mouse; the data to be transferred in the temporary storage space corresponding to the source candidate virtual mouse is transferred to the temporary storage space corresponding to the destination candidate virtual mouse; the data to be transferred in the temporary storage space corresponding to the destination candidate virtual mouse is displayed at the location of the destination candidate virtual mouse in the corresponding application interface.

1. Name of the product in this design: Graphical User Interface for Controlling Virtual Mouse in Electronic Devices. 2. Intended use of this design: for use in an electronic device. 3. The key design feature of this product is its graphical user interface. 4. The picture or photo that best illustrates the key design points: Design 1 front view. 5. Design 1 is designated as the basic design. 6. Purpose of graphical user interface: Used for virtual mouse control, replacing the use of a physical mouse. 7. Human-computer interaction method of graphical user interface: Clicking the left button of the virtual mouse in the main view of Design 1 will jump to the interface change state diagram of Design 1; clicking the right button of the virtual mouse in the main view of Design 2 will jump to the interface change state diagram of Design 2; clicking the top button of the virtual mouse in the main view of Design 3 will jump to the interface change state diagram of Design 3; clicking the bottom button of the virtual mouse in the main view of Design 4 will jump to the interface change state diagram of Design 4; clicking the middle button of the virtual mouse in the main view of Design 5 will jump to the interface change state diagram of Design 5. For the actual usage state of the main views and interface change state diagrams of Designs 1-5, please refer to the main view reference diagram and interface change state reference diagram of Designs 1-5 respectively.

The present application provides a method and device for monitoring mouse operations. The method includes: when the mouse mode of a cloud application is the mouse - less mode, monitoring the movement of the mouse through the GCMouse module, obtaining the offset of the mouse movement, and determining first intermediate data according to the offset of the mouse movement; sending the first intermediate data to a cloud server so that the cloud server determines a first mouse movement event according to the first intermediate data and sends the first mouse movement event to the system of the cloud server through a virtual mouse. Among them, the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse movement event according to the offset of the mouse movement. In the mouse - less mode scenario of the cloud application, when the mouse cursor moves to the edge of the iPhone screen and cannot move further outwards, moving the mouse outwards can still monitor the mouse movement and then control the cloud application, and the mouse operation response speed is better than that of the H5 solution.

The invention belongs to the field of remote interaction methods, and particularly relates to a remote interaction method and device based on intelligent equipment, and the method comprises the steps: obtaining a click operation of a user on a touch control end; according to the click operation of the user, the touch operation of the user is converted into a virtual mouse event, and the virtual mouse event comprises a click event, a drag event and a roller event; forming at least three feedback states according to the virtual mouse event; and feeding back the corresponding state to the user on the controlled computer terminal according to the feedback state. Through the visual key layout of the virtual mouse control and the 1: 1 logic mapping of the physical mouse and the interactive design of triggering the right key by long pressing of the touch screen, a user can directly migrate the use experience of the physical mouse to a mobile phone end without learning a new touch screen rule, the operation threshold is reduced, and the user experience is improved. Scenes such as right-click menu calling, roller sliding page turning and the like are completely consistent with those of the PC terminal.

The invention discloses a mouse synchronization method and system for cloud electronic sports, a storage medium and processing equipment, and the method comprises the steps: locally collecting first information of a physical mouse, and meanwhile, remotely collecting second information of a virtual mouse, the physical mouse being a main device of the virtual mouse; the local sends the first information to the remote end, and the remote end obtains third information based on integration of the second information and the picture information and returns the third information to the local; and locally performing optimization synchronization on the cursor position of the physical mouse based on the third information. In the application, the first information of the physical mouse and the second information of the virtual mouse are collected and are integrated at the far end by combining with the picture information to obtain the third information, and then the third information is returned to the local so as to adjust the cursor position of the physical mouse in real time. According to the method and the device, the physical mouse and the virtual mouse can be matched and synchronized while the remote picture information is considered, so that the movement of the mouse cursor is smoother and more stable, and the user experience can be improved.

During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The technology disclosed includes determining from the motion information whether a motion of the control object with respect to the virtual control construct is an engagement gesture, such as a virtual mouse click or other control device operation. The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

The embodiment of the invention discloses a display device and a virtual mouse control method, and the method comprises the steps: when a first page is displayed, in response to a direction key instruction, intercepting a page image corresponding to the first page; identifying element features of interactive elements contained in the page image; obtaining a structure tree corresponding to the first page, wherein the structure tree comprises element nodes in the first page; the interactive elements are matched with element nodes in the structure tree, an interactive element set is obtained, and the interactive element set comprises the interactive elements with element features matched with the element nodes; a first position where the virtual mouse is currently located in the first page is obtained, a target interactive element is determined from the interactive element set, the target interactive element is an interactive element located in the target direction of the first position, and the target direction is the key direction indicated by the direction key instruction; and the virtual mouse is moved to a second position corresponding to the target interactive element, so that automatic positioning and skipping of the virtual mouse are realized, and the operation efficiency is improved.

The invention relates to an intelligent mouse control method based on multiple modes and an intelligent mouse. The method comprises the steps that under the condition that a multi-mode wakeup instruction for the intelligent mouse is obtained, different candidate virtual mice are created in all application interfaces of operation equipment, and different temporary storage spaces are created for all the candidate virtual mice; wherein the application interface is an operation page corresponding to an application program in a use state in the operation equipment; under the condition that a data transfer instruction of an operator is obtained, determining a source candidate virtual mouse and a target candidate virtual mouse corresponding to the data transfer instruction from the candidate virtual mice; transferring data to be transferred in the temporary storage space corresponding to the source candidate virtual mouse to the temporary storage space corresponding to the target candidate virtual mouse; and displaying the to-be-transferred data in the temporary storage space corresponding to the target candidate virtual mouse at the position of the target candidate virtual mouse in the corresponding application interface.

The invention discloses an interaction method, device and equipment, a medium and a product, and belongs to the technical field of man-machine interaction. The interaction method is applied to the augmented reality device and comprises the steps that under the condition that a first gesture is captured, the first gesture is mapped into a target control behavior of a user on a virtual mouse; and controlling a mouse cursor displayed on a screen to execute an operation corresponding to the target control behavior according to the target control behavior.

During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object's movements relative to, and its penetration of, a virtual control construct (such as a virtual surface construct). The technology disclosed includes determining from the motion information whether a motion of the control object with respect to the virtual control construct is an engagement gesture, such as a virtual mouse click or other control device operation. The position of the virtual control construct can be updated, continuously or from time to time, based on the control object's location.

The embodiment of the invention discloses an intelligent tablet control method and device, equipment and a storage medium. The intelligent tablet control method provided by the embodiment of the invention is applied to the mobile terminal, and specifically comprises the following steps: identifying a control two-dimensional code displayed on an intelligent tablet to obtain first connection information of the intelligent tablet; generating second connection information according to the first connection information and self identity information; the second connection information is sent to the server, so that the server verifies the second connection information, and if the verification is passed, communication connection between the mobile terminal and the intelligent tablet computer is established; based on the communication connection, responding to the virtual control trigger instruction, and performing interaction control of a virtual mouse and / or a virtual keyboard on the intelligent tablet; performing interaction control on the intelligent tablet based on the communication connection; the problem of poor user experience of intelligent tablet interaction can be solved, remote interaction control is realized, the flexibility of intelligent tablet interaction control is improved, and the user experience is improved.

1. The name of the design product: hand-made (virtual mouse). 2. The use of the design product: hand-made products for display, play, collection, and decoration. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective drawing.