216 results about "Virtual keyboard" patented technology

The present invention provides a solution of a human-computer interaction method and system based on three-dimensional coordinate measurement, and a plurality of solutions for applying same to solve technical problems. An operation body and / or an operator performs input and operation interaction by means of a virtual keyboard and a virtual mouse, or integrates a display picture space and carries out various participatory and interactive direct operations and experiences on object components and objects in virtual and real scenes. Virtual handwriting input, body movement posture recognition, and lip recognition interaction methods are further provided, and virtual mode control and interaction methods such as gesture recognition and virtual touch screen interaction are supported. Contact is not needed and there is no need to touch the screen, and mobility is achieved. The present invention is suitable for the two-dimensional conventional computing field, and particularly suitable for three-dimensional space computing fields (comprising VR, MR, AR, meta-universe, virtual simulation, software games, three-dimensional graphics, three-dimensional animation, and other three-dimensional scenes). Human-computer interaction operations in work and life of people can be greatly facilitated and optimized.

A virtual object presenting arrangement (100) for providing text input comprising an image presenting device (110) arranged to display virtual keyboard (230) comprising one or more virtual keys (231), wherein the one or more keys (231) are arranged so that a movement over a distance for a finger is required to move from one key (231) to a next key (231), the virtual object presenting arrangement (100) comprising a controller (101) configured to determine a predicted next key (231) in the virtual keyboard (230) and to reduce the distance required to move to the predicted next key (231).

The invention relates to the technical field of brain-computer interfaces, and discloses a human-computer interaction virtual keyboard input method, device and equipment based on electroencephalogram signals. The method comprises the following steps: acquiring an original electroencephalogram time sequence and a corresponding spectrum feature, and performing wavelet packet decomposition on the original electroencephalogram time sequence to obtain a multi-scale electroencephalogram signal component; obtaining the complexity characteristic of the wavelet coefficient; determining a key wavelet coefficient most related to the user input intention in the plurality of wavelet coefficients; electroencephalogram baseline features, cognitive states and complexity features of a user are obtained, and the electroencephalogram baseline features, the cognitive states and the complexity features are used for obtaining the personalized optimal intention regulation and control frequency of the user; according to the key wavelet coefficient and the optimal intention regulation frequency, reconstructing and generating an electroencephalogram intention feature sequence; performing empirical mode decomposition on the electroencephalogram intention feature sequence to obtain a slow change component reflecting intention steady-state characteristics and a fast change component reflecting intention dynamic change; and obtaining an intention category corresponding to the user to generate a mapping relationship between the intention category and the keys of the virtual keyboard, and generating a control instruction of the virtual keyboard.

This application disclose a method and an electronic device. One example method includes: When a hand is located in a detection range of a depth detector, and the hand approaches a physical surface or when the hand is placed on the physical surface, a head mounted display device displays a virtual hand and a virtual keyboard in virtual space. The head mounted display device displays typed information in an interface of the virtual space in response to a typing operation of the finger of the hand. A size of the hand is positively correlated with a dimension of the virtual keyboard. When the hand is of a first size, the dimension of the virtual keyboard is a first dimension. When the hand is of a second size, the dimension of the virtual keyboard is a second dimension, where the first size is greater than the second size.

The invention discloses an interaction method and device, a storage medium and equipment. The method comprises the steps of displaying a three-dimensional environment generated by augmented reality equipment; displaying a three-dimensional virtual keyboard in the three-dimensional environment, wherein a plurality of virtual keys are displayed on the virtual keyboard; identifying a stamping gesture of the current object; determining an interaction event between the current object and the virtual keyboard according to a stamp gesture, a stamp gesture collision body corresponding to the stamp gesture and a hovering collision body corresponding to a virtual key in the virtual keyboard; in response to the interaction event, interaction feedback information is output, and the interaction feedback information at least comprises the visual indication. According to the virtual keyboard with the three-dimensional visual effect, interaction feedback information can be output, interaction convenience and input efficiency of the virtual keyboard are improved, and interaction intuition and naturalness are improved.

The invention provides an input method based on a virtual keyboard. The input method comprises the steps that first input operation acting on an operation area is detected; the first input operation is mapped into operation of corresponding keys in a key position display area, second input operation for the virtual keyboard is obtained, and the positions of the operation area and the key position display area are different; based on the second input operation, obtaining an input event; responding to the input event, and displaying input information corresponding to the input event in the input box. According to the input method, the operation area and the key position display area of the virtual keyboard are independently arranged, when the input method is applied to the wide-screen equipment, the operation area can be located in the area, easier to touch by hands, in the touch display screen, so that a user performs input operation in the operation area easier to touch by the hands, and the user experience is improved. Operation input is mapped to the virtual keyboard to achieve input, the key position display area is displayed in a centralized mode, the sight of a user can be concentrated in the key position display area, the sight moving distance of the user is reduced, and user experience is improved.

There are provided methods and systems for a user-adaptive virtual keyboard comprising a plurality of virtual adaptive keys. In examples, the systems, methods, and processor-readable media can be applied to dynamically configure a user interface of the user-adaptive virtual keyboard, to adapt to a user's needs and preferences, while the user is performing a typing action. In response to detecting a user touch input, the user-adaptive virtual keyboard may generate an updated virtual keyboard UI, by dynamically adjusting one or more properties of the plurality of virtual adaptive keys. The disclosed methods and systems may enable improved user interaction with a virtual keyboard on an electronic device, for example, while a user is performing blind typing actions.

An augmented reality (AR) device is provided and is capable of adaptively determining a virtual keyboard and an area where the virtual keyboard is to be overlaid based on attribute information of a surrounding real world and profile information of a virtual keyboard, and an operation method of the AR device is provided. The AR device may detect, by scanning the surrounding real world, at least one area including a plane on which no objects are detected; determine a type of a virtual keyboard capable of being overlaid on the at least one area, based on at least one from among a shape, a size, and an input language of the virtual keyboard; and perform rendering such that the virtual keyboard, having the type, is overlaid and displayed on the at least one area

A gesture-based text entry user interface for an Augmented Reality (AR) system is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system detects a hold of an enter text gesture made by the user. While the user holds the enter text gesture, the AR system collects continuous motion gesture data of a continuous motion as the user makes the continuous motion through the virtual keys of the virtual keyboard. The AR system detects a release of the enter text gesture by the user and generates entered text data based on the continuous motion gesture data.

Provided is a method for authenticating identity. The method includes: generating a target random mapping function in response to an identity verification instruction, wherein a random mapping function is a function defined to randomly map characters into gestures; displaying a virtual keyboard based on the target random mapping function, wherein password conversion prompt information corresponding to the target random mapping function is displayed in the virtual keyboard and is defined to prompt to convert password characters in an original password into gestures; acquiring facial feature data by performing facial feature extraction on identity verification images collected by a camera; acquiring a gesture sequence by performing activity detection on the identity verification images; acquiring the original password by performing password conversion on the gesture sequence based on the target random mapping function; and performing identity authentication based on the original password and the facial feature data.

This application disclose a method and an electronic device. One example method includes: When a hand is located in a detection range of a depth detector, and the hand approaches a physical surface or when the hand is placed on the physical surface, a head mounted display device displays a virtual hand and a virtual keyboard in virtual space. The head mounted display device displays typed information in an interface of the virtual space in response to a typing operation of the finger of the hand. A size of the hand is positively correlated with a dimension of the virtual keyboard. When the hand is of a first size, the dimension of the virtual keyboard is a first dimension. When the hand is of a second size, the dimension of the virtual keyboard is a second dimension, where the first size is greater than the second size.

An interactive coding environment is provided via an integrated mobile application. The interactive coding environment includes multiple user interface input elements including, but not limited to, a text editor, a virtual keyboard, a virtual autocomplete toolbar, a quick actions toolbar, and a virtual joystick. A user interacts with the coding environment via their user device, such as a mobile device. While coding within the text editor, the user is provided with auto-complete code suggestions and / or code snippets. Suggested inputs are obtained from a predictive model based on the user's input. A virtual joystick is provided to enable easy navigation within a text document shown within the text editor.

The invention relates to the technical field of industrial automation and computer vision, and particularly discloses a non-intrusive equipment monitoring system design method based on optical character recognition (OCR). The method comprises the following steps: firstly, transmitting a video source to an industrial personal computer through a video encoder and a switch; secondly, establishing a virtual keyboard and mouse remote control channel through the development board and the keyboard and mouse simulator; a template matching mechanism is introduced, corresponding characteristic values and content recognition templates are established for different interfaces of the equipment, and then a PP-OCRV4 model is used for carrying out recognition processing on the image; and finally, establishing monitoring to monitor and control the equipment identification process. According to the invention, a modularized system building method is adopted, the function of each module is specifically developed, a monitoring system for automatically identifying the interface data of the storage equipment is reasonably constructed, and the system can ensure long-time high-efficiency operation, accurately identify the data of each interface and store the data.

Method for providing a dynamically adapted virtual keyboard, the method comprising the following: on a display of a mobile computing device, displaying at least part of an electronic form that includes input objects for accepting user input; Automatic parsing of the electronic form to recognize attributes of at least one of the input objects; Automatically determining, based on parsing results, whether the electronic form includes a non-text input object; In response to the detection that the electronic form includes a non-text input object, a corresponding non-text component for virtual keyboards is automatically added to a virtual keyboard; and Displaying the virtual keyboard with the added non-text component for virtual keyboards on the mobile computing device's display; where the added non-text component is configured for virtual keyboards to allow a user to invoke a function associated with the corresponding non-text input object in the electronic form from the virtual keyboard.

Disclosed systems and methods enable a RESTful API server, e.g., a Redfish server, provisioned with virtual console resources running on a system management resource, e.g., a BMC, of an information handling system, to perform virtual console operations. The virtual console features include a virtual video feature for relaying frame buffers of video data, corresponding to video output from a host application, to a RESTful API client. The virtual console features may further include virtual keyboard and mouse features, which may be collectively referred to herein as virtual HID features, for relaying keyboard and mouse data, indicative of keyboard scan codes, mouse x, y coordinates, and mouse activity, e.g., Right Click, Left Click, etc., generated by a user of the RESTful API client.

A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.

This application provides an input method based on a virtual keyboard, including detecting a first input operation applied to an operation area; mapping the first input operation to the operation of a corresponding key in a key display area to obtain a second input operation for the virtual keyboard, wherein the operation area and the key display area are located in different positions; obtaining an input event based on the second input operation; and responding to the input event by displaying the input information corresponding to the input event in an input box. The input method provided in this application allows the operation area and key display area of ​​the virtual keyboard to be set independently. When applied to widescreen devices, the operation area can be located in an area of ​​the touch screen that is more easily accessible to the user's hands, enabling the user to perform input operations in an area more easily accessible to both hands. The operation input is mapped to the virtual keyboard for input, while the key display area is centrally displayed, allowing the user's gaze to focus on the key display area, reducing the distance the user's gaze travels and improving the user experience.

An electronic device according to an embodiment of the present disclosure may comprise: a display; and a processor which recognizes the execution of a virtual keyboard on a display device, displays, on the display, a notification for displaying a text input window according to the recognition of the execution of the virtual keyboard, and displays, on the display, the text input window according to the selection of the notification.

Method and system for mutual authentication. The system comprises:a virtual keyboard generation unit (210) for obtaining (110) a keyboard configuration (112) of a user (201), including graphical features (114), arrangements (116) and keyboard generation rules (118); and generating (120) a virtual keyboard (212) formed by keys (214) with combination of graphics features (114) in certain arrangements (116) based on the keyboard generation rules (118);an input interface (230) for receiving (140) a key selection (144) of the virtual keyboard (212);an authentication unit (240) for applying (160) user authentication rules (152) on the virtual keyboard (212), obtaining at least one correct key sequence (162), and authenticating (170) to the user (201) if the key selection (144) is validated with respect to a correct key sequence (162).

The embodiment of the invention relates to the technical field of computers, and discloses a notebook computer supporting naked eye three-dimensional display. Comprising a main screen used for displaying planar pictures and / or stereoscopic pictures; the auxiliary screen is used for displaying an input control interface; wherein the input control interface comprises one or more of a virtual keyboard, a user-defined control key, a map and an electronic canvas; the optical positioning module is arranged at the side edge position of the main screen and is used for acquiring an optical image; and the processing module is connected with the main screen and the optical positioning module, and is used for determining the human eye position of the user according to the optical image when the main screen displays the three-dimensional picture, and determining the display data of the main screen according to the human eye position. By the adoption of the scheme, convenience can be brought to operation of a user on the basis of the double-screen design, meanwhile, display of the three-dimensional image can be supported on the main screen, finally, position tracking can be conducted on human eyes, the holographic three-dimensional image display effect is provided for the user, and the use experience of the user is improved.

The invention discloses a display method, device and equipment of a virtual keyboard, and belongs to the technical field of virtual display. The method comprises the steps that under the condition that a first gesture is detected, a first virtual keyboard is generated, the first virtual keyboard is determined according to the first gesture, and the first gesture is characterized as a gesture that the two hands are at least partially overlapped and the palm centers of the two hands can be recognized. And displaying the first virtual keyboard at a display position, wherein the display position is located in an open space formed when the two hands present the first gesture. Because the first gesture is the gesture that at least parts of the two hands are overlapped and the palms of the two hands can be recognized, the user can be ensured to be in a comfortable input posture, and in the pressing input process, the pressing positions of the keyboard keys basically fall on the positions of the palms, so that the user can perceive touch feedback, and the user experience is improved. The fatigue problem caused by arm unbalance and long-time suspension is effectively avoided, and the input efficiency is improved.

1. Name of this design product: Virtual keyboard interface for electronic device. 2. Purpose of this design product: used for interaction and information input. 3. The key design point of this appearance design product lies in the virtual keyboard interface content. 4. The picture or photo that best illustrates the key points of the design: Main view of Design 1. 5. Designate Design 1 as the base design. 6. Purpose of the graphical user interface: When an electronic device displays a virtual keyboard interface, the electronic device adaptively displays the interface corresponding to the main view in Design 1, Design 2 or Design 3 according to the display parameters of its own display screen; when the interface in the main view of Design 1 is displayed, the user clicks the "number key" button in the interface to switch the interface to the interface in the interface change diagram of Design 1; when the interface in the main view of Design 2 is displayed, the user clicks the "number key" button in the interface to switch the interface to the interface in the interface change diagram of Design 2; when the interface in the main view of Design 2 is displayed, the user clicks the "number key" button in the interface to switch the interface to the interface in the interface change diagram of Design 2. In addition, in the interface of each view, the user can also select different "Please Add" in turn by clicking. After selecting a "Please Add", select a key from the keyboard at the bottom of the interface, and the content of the key will be displayed in the selected "Please Add". After the setting is completed, click "Save" or "Cancel" in the upper right corner of the interface to obtain a key combination control or cancel the setting of the combination control.

The application discloses an interface interaction method and device, electronic equipment and a storage medium, and applies to the technical field of interface interaction of games. The method comprises the following steps: displaying a game picture corresponding to a game, a chat channel and an information input control in a graphical user interface; in response to a first trigger operation acting on the information input control, controlling to render and display the game picture corresponding to the game in a first display area of the graphical user interface, and to render and display a virtual keyboard for information input in a second display area of the graphical user interface; wherein the display levels of the first display area and the second display area are consistent; in response to a second trigger operation acting in the first display area, executing a corresponding game function according to the second trigger operation, and in response to a third trigger operation acting in the second display area, controlling to execute a corresponding information input function. The game interaction is not affected when chatting, and the game experience can be improved.

1. Name of the Design Product: Electronic Device with a Graphical User Interface of a Virtual Keyboard. 2. Use of the Design Product: For an electronic device. 3. Design Feature of the Design Product: Lies in the content of the graphical user interface. 4. Picture or Photo Most Indicating the Design Feature: The front view of Design 1. 5. Design 1 is designated as the basic design. 6. Use of the Graphical User Interface: The graphical user interface of this design is an interactive interface for visualizing the display of a keyboard on a device. 7. Human - Machine Interaction Method of the Graphical User Interface: The front view of Design 1 is the interface for调出键盘 on the device in Design 1. After clicking the up - arrow icon on the left side of the keyboard in the front view of Design 1, enter the first state - change diagram of Design 1 (Figure 1 of the state - change diagram of Design 1); click the "EN / 中" icon in the lower - left corner of Figure 1 of the state - change diagram of Design 1 to enter Figure 2 of the state - change diagram of Design 1; click the "键 / 浮" icon in Figure 2 of the state - change diagram of Design 1 to enter Figure 3 of the state - change diagram of Design 1; click the "Next Page" icon in Figure 3 of the state - change diagram of Design 1 to enter Figure 4 of the state - change diagram of Design 1; click the "EN / 中" icon in Figure 4 of the state - change diagram of Design 1 to enter Figure 5 of the state - change diagram of Design 1; click the "Next Page" icon in Figure 5 of the state - change diagram of Design 1 to enter Figure 6 of the state - change diagram of Design 1; click the "123" icon in Figure 6 of the state - change diagram of Design 1 to enter Figure 7 of the state - change diagram of Design 1; click the "9 - key" icon in Figure 7 of the state - change diagram of Design 1 to enter Figure 8 of the state - change diagram of Design 1; click the "Remote Input" icon in Figure 8 of the state - change diagram of Design 1 to enter Figure 9 of the state - change diagram of Design 1; click one of the "My Android Tablet" icons in Figure 9 of the state - change diagram of Design 1 to enter Figure 10 of the state - change diagram of Design 1; the front view of Design 2 is the interface for调出键盘 on the device in Design 2; click the "123" icon in the front view of Design 2 to enter Figure 1 of the state - change diagram of Design 2; click the "Remote Input" icon in Figure 1 of the state - change diagram of Design 2 to enter Figure 2 of the state - change diagram of Design 2; click one of the "My Android Tablet" icons in Figure 2 of the state - change diagram of Design 2 to enter Figure 3 of the state - change diagram of Design 2. 8. Other Situations Needing Explanation - Explanation of State Changes: The reference diagrams 1 - 2 of the state - change of Design 1 are the reference diagrams for Figures 9 - 10 of the state - change diagram of Design 1 respectively; the reference diagrams 1 - 2 of the state - change of Design 2 are the reference diagrams for Figures 2 - 3 of the state - change diagram of Design 2 respectively. 9. Other Situations Needing Explanation - Other Explanation: The electronic device can perform click operations on icons by touch, or by using a remote control.

The present application provides a method and apparatus for handling manipulation events. The method includes: receiving first intermediate data and / or second intermediate data sent by a mobile device, determining a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data; sending the first mouse event to the system of a cloud server through a virtual mouse to move a target object of a cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application, and accurate positioning operations on the application object of the cloud application that only supports keyboard and mouse manipulation can be realized by a user.

In some implementations, a user device may obtain an input stream, wherein the input stream is obtained via a virtual keyboard provided by the user device. The user device may process the input stream to determine that the input stream includes particular information. The user device may cause, based on determining that the input stream includes the particular information, one or more security parameters associated with an account of a user of the user device to be modified.

1. The name of this design product: Virtual keyboard graphical user interface for programming learning of electronic devices. 2. Purpose of this design product: for use in an electronic device. 3. The key design point of this design product lies in the interface content of the graphical user interface. 4. The picture or photo that best illustrates the key points of the design: Main view of Design 1. 5. The design for which protection is sought includes color. 6. Designate Design 1 as the base design. 7.Purpose of the graphical user interface: This design is used for programming and learning virtual keyboard operations. The virtual keyboard areas in the main views of Design 1 and Design 2 are all clickable.

Systems and methods described herein include displaying a keyboard on a display. The virtual keyboard is split into a first keyboard portion including an inner zone including one or more letters and an outer zone including a first group of letters that are positioned to surround the inner zone of the first keyboard portion; and into a second keyboard portion including an inner zone including one or more letters and an outer zone including a second group of letters that are positioned to surround the inner zone of the second keyboard portion. The methods and systems described herein include respectively generate first and second signals pertaining to selection of a letter on the first and second keyboard portion in response to a user interacting with one or more control inputs in a first of second group of control inputs on a handheld controller.

The present application belongs to the technical field of data transfer. Disclosed in the embodiments of the present application are a file transfer method and a computing device, which can improve the efficiency of remotely transferring files into an OS. The method is applicable to a file transfer system, the file transfer system comprising a first computing device and a second computing device. The method comprises: the first computing device displays a remote control page, the remote control page being a page of a virtual keyboard video mouse (KVM) component of the second computing device; in response to a first operation, the first computing device connects a target file to a virtual optical disk drive interface of the KVM component, the target file being a file stored locally on the first computing device; when the second computing device detects that the target file has been connected to the virtual optical disk drive interface of the KVM component, the second computing device mounts the target file to a first directory of the second computing device, and the second computing device copies the target file to a desktop directory of the second computing device; and the first computing device displays in the remote control page an element corresponding to the target file.