344 results about "Virtual keyboard" patented technology

The present disclosure relates to virtual reality interaction methods, devices, and systems. In one example method, a head-mounted display device displays a virtual keyboard. In response to an input trigger operation of a user, a hand-mounted device sends hand detection data to the head-mounted display device based on a detected target sensor signal. After determining, based on the hand detection data, that an input trigger event occurs, the head-mounted display device determines an initial tap position of a target finger relative to the virtual keyboard based on a hand image captured by a camera. The hand-mounted device sends hand motion tracking data collected by a motion sensor to the head-mounted display device. In response to an input completion operation of the user, the head-mounted display device determines and displays an input result based on the initial tap position and the hand motion tracking data.

The present invention provides a solution of a human-computer interaction method and system based on three-dimensional coordinate measurement, and a plurality of solutions for applying same to solve technical problems. An operation body and / or an operator performs input and operation interaction by means of a virtual keyboard and a virtual mouse, or integrates a display picture space and carries out various participatory and interactive direct operations and experiences on object components and objects in virtual and real scenes. Virtual handwriting input, body movement posture recognition, and lip recognition interaction methods are further provided, and virtual mode control and interaction methods such as gesture recognition and virtual touch screen interaction are supported. Contact is not needed and there is no need to touch the screen, and mobility is achieved. The present invention is suitable for the two-dimensional conventional computing field, and particularly suitable for three-dimensional space computing fields (comprising VR, MR, AR, meta-universe, virtual simulation, software games, three-dimensional graphics, three-dimensional animation, and other three-dimensional scenes). Human-computer interaction operations in work and life of people can be greatly facilitated and optimized.

Systems, interfaces, and methods for implementing the systems and interfaces include a dynamic environment generation subsystem that changes objects and subobjects based on locations of the motion sensors and / or the nature, time and / or location of sensed motion and include selection attractive movement as the selection protocol, where a selection object is used to discriminate between selectable objects and attract a target object toward the selection objects, where the direction and speed of the motion controls, discriminates, attracts, and activates the selected objects.

A gesture-based text input user interface for an augmented reality (AR) system is provided. The AR system detects a start text input gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides the virtual keyboard user interface to the user. The AR system detects a retention of an input text gesture made by a user. When the user maintains an input text gesture, the AR system collects continuous motion gesture data for continuous motion as the user performs continuous motion across virtual keys of the virtual keyboard. The AR system detects a release of the input text gesture by the user and generates input text data based on the continuous motion gesture data.

A virtual object presenting arrangement (100) for providing text input comprising an image presenting device (110) arranged to display virtual keyboard (230) comprising one or more virtual keys (231), wherein the one or more keys (231) are arranged so that a movement over a distance for a finger is required to move from one key (231) to a next key (231), the virtual object presenting arrangement (100) comprising a controller (101) configured to determine a predicted next key (231) in the virtual keyboard (230) and to reduce the distance required to move to the predicted next key (231).

The invention relates to the technical field of brain-computer interfaces, and discloses a human-computer interaction virtual keyboard input method, device and equipment based on electroencephalogram signals. The method comprises the following steps: acquiring an original electroencephalogram time sequence and a corresponding spectrum feature, and performing wavelet packet decomposition on the original electroencephalogram time sequence to obtain a multi-scale electroencephalogram signal component; obtaining the complexity characteristic of the wavelet coefficient; determining a key wavelet coefficient most related to the user input intention in the plurality of wavelet coefficients; electroencephalogram baseline features, cognitive states and complexity features of a user are obtained, and the electroencephalogram baseline features, the cognitive states and the complexity features are used for obtaining the personalized optimal intention regulation and control frequency of the user; according to the key wavelet coefficient and the optimal intention regulation frequency, reconstructing and generating an electroencephalogram intention feature sequence; performing empirical mode decomposition on the electroencephalogram intention feature sequence to obtain a slow change component reflecting intention steady-state characteristics and a fast change component reflecting intention dynamic change; and obtaining an intention category corresponding to the user to generate a mapping relationship between the intention category and the keys of the virtual keyboard, and generating a control instruction of the virtual keyboard.

This application disclose a method and an electronic device. One example method includes: When a hand is located in a detection range of a depth detector, and the hand approaches a physical surface or when the hand is placed on the physical surface, a head mounted display device displays a virtual hand and a virtual keyboard in virtual space. The head mounted display device displays typed information in an interface of the virtual space in response to a typing operation of the finger of the hand. A size of the hand is positively correlated with a dimension of the virtual keyboard. When the hand is of a first size, the dimension of the virtual keyboard is a first dimension. When the hand is of a second size, the dimension of the virtual keyboard is a second dimension, where the first size is greater than the second size.

The present disclosure generally relates to methods and user interfaces for positioning a virtual keyboard in a three-dimensional environment, displaying various types of virtual keyboards, for switching between virtual keyboards, and / or displaying a virtual keyboard based on a position of a user.

The invention discloses an interaction method and device, a storage medium and equipment. The method comprises the steps of displaying a three-dimensional environment generated by augmented reality equipment; displaying a three-dimensional virtual keyboard in the three-dimensional environment, wherein a plurality of virtual keys are displayed on the virtual keyboard; identifying a stamping gesture of the current object; determining an interaction event between the current object and the virtual keyboard according to a stamp gesture, a stamp gesture collision body corresponding to the stamp gesture and a hovering collision body corresponding to a virtual key in the virtual keyboard; in response to the interaction event, interaction feedback information is output, and the interaction feedback information at least comprises the visual indication. According to the virtual keyboard with the three-dimensional visual effect, interaction feedback information can be output, interaction convenience and input efficiency of the virtual keyboard are improved, and interaction intuition and naturalness are improved.

A head-mounted device may have a head-mounted support structure, a gaze tracker in the head-mounted support structure, and one or more displays in the head-mounted support structure. For example, two displays may display images to two eye boxes. The display may display a virtual keyboard and may display a text input in response to a gaze location that is determined by the gaze tracker. The gaze tracker may additionally determine a gaze swipe input, or a camera in the support structure may determine a hand swipe input, and the swipe input may be used with the gaze location to determine the text input. In particular, the swipe input may create a swipe input curve that is fit to the text input to determine the text input. A user's hand may be used as a secondary input to indicate the start or end of a text input.

An electronic message content intercepting system has a virtual keyboard installed by an operating system of a supervised mobile communication device which is configured to process keypresses for software applications executed by the supervised mobile communication device. The system is configured to analyse message text input via the keyboard to identify categorised text strings which may be categorised as inappropriate, offensive, abusive and / or the like. Responsive to the disapproval input the system does not process input of the categorised text string so that the categorised text string is not transmitted to a recipient mobile communication device. However, responsive to the approval input, the system is configured to process input of the categorised text string so that the categorised text string is transmitted to the recipient mobile communication device and the text string is also transmitted to the supervisory mobile communication device for display as an alert.

The invention relates to a virtual keyboard management method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: in response to an input operation in an application program, determining a corresponding keyboard layout mode based on input habit data of a user or a security level corresponding to a current input environment; according to the keyboard layout mode, a virtual keyboard is displayed, input behavior data generated by a user based on the virtual keyboard are obtained, and the input behavior data comprise at least one of keystroke behavior data, modification behavior data, search behavior data, selection behavior data or confirmation behavior data; when the input behavior data is not matched with the input habit data of the user, sending out a safety warning; and under the condition that the input behavior data is matched with the input habit data of the user, sending the characters input by the user to a server. By adopting the method, the safety of the virtual keyboard in the using process can be enhanced.

The invention provides an input method based on a virtual keyboard. The input method comprises the steps that first input operation acting on an operation area is detected; the first input operation is mapped into operation of corresponding keys in a key position display area, second input operation for the virtual keyboard is obtained, and the positions of the operation area and the key position display area are different; based on the second input operation, obtaining an input event; responding to the input event, and displaying input information corresponding to the input event in the input box. According to the input method, the operation area and the key position display area of the virtual keyboard are independently arranged, when the input method is applied to the wide-screen equipment, the operation area can be located in the area, easier to touch by hands, in the touch display screen, so that a user performs input operation in the operation area easier to touch by the hands, and the user experience is improved. Operation input is mapped to the virtual keyboard to achieve input, the key position display area is displayed in a centralized mode, the sight of a user can be concentrated in the key position display area, the sight moving distance of the user is reduced, and user experience is improved.

There are provided methods and systems for a user-adaptive virtual keyboard comprising a plurality of virtual adaptive keys. In examples, the systems, methods, and processor-readable media can be applied to dynamically configure a user interface of the user-adaptive virtual keyboard, to adapt to a user's needs and preferences, while the user is performing a typing action. In response to detecting a user touch input, the user-adaptive virtual keyboard may generate an updated virtual keyboard UI, by dynamically adjusting one or more properties of the plurality of virtual adaptive keys. The disclosed methods and systems may enable improved user interaction with a virtual keyboard on an electronic device, for example, while a user is performing blind typing actions.

Embodiments relate to a method and an electronic device for modifying a user interface of the electronic device. The method includes detecting, on the electronic device, a selection of a multi-keypad configuration among a plurality of multi-keypad configurations. Based on the selection of the multi-keypad configuration, a plurality of virtual keys are displayed on the user interface. The method includes receiving, on the user interface, a user touch gestures to configure one or more of the plurality of virtual keys to generate a virtual keyboard. The method includes updating machine learning models, image classifier models, and memory of the electronic device to update and store the generated virtual keyboard including the configuration of the one or more of the plurality of virtual keys to initiate user authentication in real time.

A gesture-based text input user interface for an augmented reality (AR) device is provided. The AR system detects a start text input gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides the virtual keyboard user interface to the user. The AR system determines a user's selection of one or more selected virtual keys of the plurality of virtual keys using the one or more camera devices, and generates input text data based on the one or more selected virtual keys. The AR system provides input text data to a user using a display of the AR system.

A mobile device and operating method of input method thereof is related to the mobile device, which includes a general camera module, a specific camera module, a barcode-decoding module, a touch display module, and a control module. The barcode-decoding module is configured to capture one or more barcode patterns through the specific camera module and convert each of the barcode patterns into one or more first string. The touch display module is configured to display a display frame having an input field. The control module is configured to activate a virtual keyboard window of a system default input method and a trigger element of an image conversion input method in response to an input trigger event and control the touch display module to display an overlapping window of the image conversion input method on the display frame overlappingly in response to a first trigger event.

There is a need for design and implementation of interfaces for providing user-friendly feedback while creating and updating compliant passwords. This disclosure relates to a method of creating compliant password by in-place feedback to a password composition policy (PCP). A policy-enabled-virtual keyboard (PKBD) receives input from a user and is processed based on parameters associated with the PCP to identify accessible and inaccessible keys on the PKBD with in-place feedback. The in-place feedback is provided to highlight accessible keys of the PKBD for the user, if class associated with character, or mandated number of characters by the PCP are received are covered. Alternatively, the keys of the PKBD are disabled for access to the user by validating if class associated with character received are not covered, and a deviation of the parameters. A compliant password is created based on the PCP by providing in-place feedback for a resultant validation.

An augmented reality (AR) device is provided and is capable of adaptively determining a virtual keyboard and an area where the virtual keyboard is to be overlaid based on attribute information of a surrounding real world and profile information of a virtual keyboard, and an operation method of the AR device is provided. The AR device may detect, by scanning the surrounding real world, at least one area including a plane on which no objects are detected; determine a type of a virtual keyboard capable of being overlaid on the at least one area, based on at least one from among a shape, a size, and an input language of the virtual keyboard; and perform rendering such that the virtual keyboard, having the type, is overlaid and displayed on the at least one area

The utility model relates to the technical field of computers, and discloses a computer all-in-one machine with an auxiliary screen, which comprises the auxiliary screen, an auxiliary screen connecting plate and an all-in-one machine main body provided with a main screen, and one end of the auxiliary screen connecting plate is rotatably connected with an all-in-one machine base of the all-in-one machine main body through a first rotating shaft. The other end of the auxiliary screen connecting plate rotates with the auxiliary screen through a second rotating shaft so as to adjust the relative position of the auxiliary screen and the all-in-one machine base; when the auxiliary screen abuts against the base of the all-in-one machine, the auxiliary screen and the main screen can form double-screen display, and when the auxiliary screen is horizontally arranged and the display face is upward, the auxiliary screen can be used as an electronic drawing board or a virtual keyboard. The auxiliary screen is rotationally connected with the auxiliary screen connecting plate through the second rotating shaft, the auxiliary screen connecting plate is rotationally connected with the all-in-one machine base through the first rotating shaft, the space adjustment freedom degree of the auxiliary screen is high, the auxiliary screen can abut against the all-in-one machine base and be matched with the main screen to form double-splicing display, the auxiliary screen can be horizontally arranged to serve as an electronic drawing board or a virtual keyboard, functionality is high, and the practicability is high. And carrying and storage are convenient.

A gesture-based text entry user interface for an Augmented Reality (AR) system is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system detects a hold of an enter text gesture made by the user. While the user holds the enter text gesture, the AR system collects continuous motion gesture data of a continuous motion as the user makes the continuous motion through the virtual keys of the virtual keyboard. The AR system detects a release of the enter text gesture by the user and generates entered text data based on the continuous motion gesture data.

Provided is a method for authenticating identity. The method includes: generating a target random mapping function in response to an identity verification instruction, wherein a random mapping function is a function defined to randomly map characters into gestures; displaying a virtual keyboard based on the target random mapping function, wherein password conversion prompt information corresponding to the target random mapping function is displayed in the virtual keyboard and is defined to prompt to convert password characters in an original password into gestures; acquiring facial feature data by performing facial feature extraction on identity verification images collected by a camera; acquiring a gesture sequence by performing activity detection on the identity verification images; acquiring the original password by performing password conversion on the gesture sequence based on the target random mapping function; and performing identity authentication based on the original password and the facial feature data.

There is provided mechanisms for providing a complementary virtual keyboard of a virtual input device in a virtual environment. The virtual input device is a virtual keyboard comprising virtual keys. A method is performed by a control device. The method comprises identifying user interaction with the virtual input device. The user interaction comprises at least one hand of the user interacting with the virtual input device in the virtual environment. The method comprises calculating a virtual representation of the user interaction with the virtual input device. The method comprises identifying, from the virtual representation, that the user interaction comprises the hand of the user is turned so that a palm side of the hand faces away from the virtual keyboard. The method comprises, in response thereto, revealing the complementary virtual keyboard for receiving user input from the user in the virtual environment.

This application disclose a method and an electronic device. One example method includes: When a hand is located in a detection range of a depth detector, and the hand approaches a physical surface or when the hand is placed on the physical surface, a head mounted display device displays a virtual hand and a virtual keyboard in virtual space. The head mounted display device displays typed information in an interface of the virtual space in response to a typing operation of the finger of the hand. A size of the hand is positively correlated with a dimension of the virtual keyboard. When the hand is of a first size, the dimension of the virtual keyboard is a first dimension. When the hand is of a second size, the dimension of the virtual keyboard is a second dimension, where the first size is greater than the second size.

An interactive coding environment is provided via an integrated mobile application. The interactive coding environment includes multiple user interface input elements including, but not limited to, a text editor, a virtual keyboard, a virtual autocomplete toolbar, a quick actions toolbar, and a virtual joystick. A user interacts with the coding environment via their user device, such as a mobile device. While coding within the text editor, the user is provided with auto-complete code suggestions and / or code snippets. Suggested inputs are obtained from a predictive model based on the user's input. A virtual joystick is provided to enable easy navigation within a text document shown within the text editor.

The invention provides a virtual keyboard display method and device, equipment and a storage medium, and belongs to the field of image display.The method comprises the steps that a hand posture image of a wearer of the head-mounted display equipment is obtained, and a keyboard layout mode of a virtual keyboard is determined according to the hand posture image; determining display parameters of the virtual keyboard in the palm of the wearer according to the hand posture image and the keyboard layout mode; and projecting and displaying the virtual keyboard in the palm of the wearer according to the display parameters. According to the method and the device, the accuracy of the display position of the virtual keyboard and the suitability of the display size are greatly improved, so that the accuracy and the convenience of character input in the virtual keyboard by a wearer are improved, and the use experience of the wearer is greatly improved.

The invention relates to the technical field of industrial automation and computer vision, and particularly discloses a non-intrusive equipment monitoring system design method based on optical character recognition (OCR). The method comprises the following steps: firstly, transmitting a video source to an industrial personal computer through a video encoder and a switch; secondly, establishing a virtual keyboard and mouse remote control channel through the development board and the keyboard and mouse simulator; a template matching mechanism is introduced, corresponding characteristic values and content recognition templates are established for different interfaces of the equipment, and then a PP-OCRV4 model is used for carrying out recognition processing on the image; and finally, establishing monitoring to monitor and control the equipment identification process. According to the invention, a modularized system building method is adopted, the function of each module is specifically developed, a monitoring system for automatically identifying the interface data of the storage equipment is reasonably constructed, and the system can ensure long-time high-efficiency operation, accurately identify the data of each interface and store the data.

Method for providing a dynamically adapted virtual keyboard, the method comprising the following: on a display of a mobile computing device, displaying at least part of an electronic form that includes input objects for accepting user input; Automatic parsing of the electronic form to recognize attributes of at least one of the input objects; Automatically determining, based on parsing results, whether the electronic form includes a non-text input object; In response to the detection that the electronic form includes a non-text input object, a corresponding non-text component for virtual keyboards is automatically added to a virtual keyboard; and Displaying the virtual keyboard with the added non-text component for virtual keyboards on the mobile computing device's display; where the added non-text component is configured for virtual keyboards to allow a user to invoke a function associated with the corresponding non-text input object in the electronic form from the virtual keyboard.

Disclosed systems and methods enable a RESTful API server, e.g., a Redfish server, provisioned with virtual console resources running on a system management resource, e.g., a BMC, of an information handling system, to perform virtual console operations. The virtual console features include a virtual video feature for relaying frame buffers of video data, corresponding to video output from a host application, to a RESTful API client. The virtual console features may further include virtual keyboard and mouse features, which may be collectively referred to herein as virtual HID features, for relaying keyboard and mouse data, indicative of keyboard scan codes, mouse x, y coordinates, and mouse activity, e.g., Right Click, Left Click, etc., generated by a user of the RESTful API client.