Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

97 results about "Gesture tracking" patented technology

Human Interactions with Mid-Air Haptic Systems

Strategies for managing an “always on” solution for volumes with enhanced interactive haptic feedback and its implications are addressed. Ultrasound transducer arrays may be mounted on a person (such as on a head mounted display or other wearable accessory). This array may utilize some form of 6 degree-of-freedom tracking for both the body and hands of the user. The arrays coordinate to project focused acoustic pressure at specific locations on moving hands such that a touch sensation is simulated. Using wearable microphones, the ultrasonic signal reflected and transmitted into the body can be used for hand and gesture tracking.
Owner:HAPTICS IP PROTECTION LLC

Hybrid gesture tracking method, system, equipment and medium

A hybrid gesture tracking method comprises the following steps: S1, acquiring a first frame of image, performing hand recognition on the first frame of image, and combining with a preset depth range to obtain an initial hand region through fusion; s2, performing hand recognition on the initial hand region to obtain a first hand region; s3, recognizing a hand key point and a hand posture of the first hand region; s4, determining the position of a central hand key point of the first hand region; s5, calculating a motion included angle theta between the central hand key point and the previous frame of image in the three-dimensional space; and S6, determining a complete movement track of the hand according to the sum of the movement included angles theta, the position of the central hand key point and the movement amplitude. The method has the characteristics of good stability, high accuracy, rapidness and high efficiency.
Owner:SHENZHEN GUANGJIAN TECH CO LTD +2

Sign language translation training system based on gesture tracking and sign language tracking device

The invention relates to the technical field of sign language translation, in particular to a sign language translation training system based on gesture tracking and a sign language tracking device, and the system comprises a gesture tracking module, a skeleton structure completion module, a gesture standard comparison module, a gesture dynamic correction module and a training effect analysis module. According to the method, through screening visible skeleton joint points, detecting a space displacement trend and calculating a motion rate and a direction change rate, key frame data meeting a stability standard can be effectively extracted, the accuracy of gesture track analysis is improved, missing key points are complemented by using skeleton structure constraints, interference on an identification result caused by loss of the key points is avoided, and the accuracy of gesture track analysis is improved. Dynamic posture correction is performed by calculating the joint angle change rate and analyzing the deviation range and combining the finger opening and closing angle and the wrist rotation angle, adjustment suggestions are provided according to the correction angle, sign language training optimization guidance is achieved, and the pertinence and the refinement level of sign language training are improved.
Owner:SHANDONG VOCATIONAL COLLEGE OF SPECIAL EDUCATION

Immersive multisensory simulation system

A Multisensory Simulation System comprises systems including: an Omni-Directional Treadmill (ODT), a Gravity Modification System (GMS), a Motion and gesture Tracking System (MTS), a Data Analytics System (DAS), a Visual Stimulation System (VSS), an Auditory Stimulation System (AUSS), an Operator Interface System (OIS), a User Harness System (UHS), a Tactile Stimulation System (TSS), an Atmospheric Simulation System (ATSS), a Neurological Stimulation System (NSS), an Olfactory Stimulation System (OSS), a Gustatory System Stimulation System (GSS), a User Monitoring System (UMS), a Controller, a Game Engine System (GES), database, a Communication Unit (CU), a User Safety System (USS), and a communication bus.
Owner:NEWTON VR LTD

Hand gesture tracking device, method, and non-transitory computer readable storage medium thereof

A hand gesture tracking device, method, and non-transitory computer readable storage medium thereof are provided. The device performs hand gesture tracking corresponding to a user based on multiple real-time images and an inertial sensing data. The device determines whether a virtual object associated with a haptic feedback interaction is contacted based on the hand gesture tracking. In response to determining that the virtual object associated with the haptic feedback interaction is contacted, the device triggers a haptic feedback device of a wearable device to perform the haptic feedback interaction corresponding to a time interval. The device inactivates the inertial sensing data corresponding to the wearable device to perform the hand gesture tracking corresponding to the time interval.
Owner:HTC CORP

MR training system based on gesture tracking

The invention provides an MR training system based on gesture tracking. The MR training system comprises a head-mounted display device, a gesture tracking module, an environment sensing module, a virtual-real fusion engine, a training evaluation module and a multi-channel feedback module. The head display device is integrated with a binocular RGB camera, an infrared ToF depth sensor and a millimeter wave radar array, the RGB camera tracks and positions a hand position through a skeleton and collects a hand image at the same time, the millimeter wave radar array captures submillimeter displacement data of hand micro-motion, and the submillimeter displacement data is transmitted to the head display device through the infrared ToF depth sensor. Transmitting the acquired hand image and displacement data to a virtual-real fusion engine; the infrared ToF depth sensor directly calculates the distance between a target object and the sensor by emitting a modulated near-infrared light pulse and measuring the time difference of light reflected to the sensor, and generates a pixel-by-pixel depth map; a skeleton model of 21 joint points of a hand is constructed, the angle variation of the associated joints is calculated in real time, holding, rotating and pressing operation actions are recognized, and the operation actions are tracked and optimized according to image data and displacement data collected by head display equipment.
Owner:BEIJING LINGLONG TECHNOLOGY CO LTD

Gesture tracking device and method and non-transitory computer readable storage medium thereof

The invention discloses a gesture tracking device, a gesture tracking method and a non-transient computer readable storage medium thereof. The apparatus performs a gesture tracking corresponding to a user based on a plurality of real-time images and an inertial sensing data. The device determines whether a virtual object associated with a haptic feedback interaction is contacted based on the gesture tracking. In response to determining that the virtual object associated with the haptic feedback interaction is touched, the device triggers a haptic feedback device of a wearable device to perform the haptic feedback interaction corresponding to a time interval. The device disables the inertial sensing data corresponding to the wearable device to perform the gesture tracking corresponding to the time interval. The gesture tracking technology provided by the invention can improve the accuracy of gesture tracking.
Owner:HTC CORP

Gesture tracking method and system based on acoustic signal

According to the gesture tracking method and system based on the acoustic signals, distance, angle and speed information of signals reflected by multiple targets is fused based on a signal model of triangular chirp signals, the signals are analyzed through a joint estimation algorithm, signal separation is achieved through signal elimination and reconstruction, and multi-dimensional parameters of each target are obtained. According to the invention, the limit of motion tracking by using acoustic signals is broken through, and continuous real-time tracking is carried out on a plurality of targets at the same time with centimeter-level precision.
Owner:THE ACAD OF TIANJIN UNIV HEFEI

XR gesture tracking and recognition method based on multi-view depth fusion

The invention discloses an XR gesture tracking and recognition method based on multi-view depth fusion. The method comprises the following steps: constructing a virtual camera by adopting a perspective cutting method, and dynamically extracting a hand region after geometric correction through gesture detection and perspective cutting of each frame of image; in combination with internal and external parameters of a camera, through position coding and a multi-head attention mechanism, a geometrical relationship between visual angles is modeled, semantic relevance of multi-visual-angle 3D features is deeply excavated, globally consistent hand representation is constructed, then six-degree-of-freedom information of wrist joints and rotation angles of the joints are output based on a regression device, and forward kinematics and a linear skin algorithm are combined, so that the degree of freedom of the wrist joints is calculated. Generating a complete hand posture and skeleton key point coordinates; and based on the key point position and the rotation angle of each joint, gesture recognition is realized through template matching. According to the method, multi-view image information and hand kinematics constraints are combined, high-precision and high-robustness three-dimensional gesture attitude estimation and classification are achieved while real-time performance is guaranteed, and the method is suitable for various XR scenes.
Owner:FUDAN UNIVERSITY

A female pelvic cavity simulation module, a VR simulation training system and method for pelvic cavity examination

The application provides a female pelvic cavity simulation module, a VR simulation training system and method for pelvic cavity examination. The VR simulation training system comprises a female pelvic cavity simulation module, a speculum, a gesture tracking device, a mobile locator and VR glasses connected to the mobile locator. The female pelvic cavity simulation module comprises a shell, a suspension assembly, a vaginal simulation assembly, a sensing assembly and a controller. The shell has a receiving cavity. The vaginal simulation assembly is suspended in the receiving cavity through the suspension assembly. The vaginal simulation assembly comprises two simulation bodies arranged in an up-down manner. The simulation bodies are made of soft elastic material. The simulation bodies form a vaginal cavity with an open end when fitted. The sensing assembly is used to detect the moving distance of the two simulation bodies. The controller is electrically connected to the sensing assembly and located above the mobile locator. The application simulates a real clinic environment by using VR. In combination with a virtual character and a user interface, appropriate feedback is given to enhance the students' confidence and adaptability in gynecological examination training.
Owner:邓育明

A writing pen touch recognition method based on gesture recognition and inertial sensor

The application provides a writing pen touch recognition method based on gesture recognition and inertial sensors, relates to the touch recognition technical field, and is applied to a gesture-pen fusion positioning system. Inertial sensing device data is acquired and processed into the positioning coordinates of a writing pen nib in a three-dimensional space, then into the height information of the pen nib to a writing plane, and finally into the touch recognition result through linkage with the vibration information of the inertial sensing device. The application utilizes the gesture tracking capability commonly used in VR / MR / AR devices on the market, avoids customizing the writing pen, can be embedded in the existing devices at a low cost, is not limited to writing surfaces and writing pen types, has high universality, recognizes touch through the pen nib height auxiliary vibration intensity, and makes the recognition result more accurate and reliable.
Owner:JILIN UNIVERSITY

Gesture tracking in energy-constrained devices

There is provided techniques for gesture recognition in a gesture tracking application. A method is performed by a controller device. The method comprises receiving user input from a user of the gesture tracking application. The user input identifies a set of gestures for the gesture tracking application. The method comprises training a BSMGRS and a CAMGRS to independently of each other recognize the set of gestures for the user. The method comprises establishing a database of gestures for the user. The database of gestures comprises a set of approved gestures comprises those of the gestures in the set of gestures for which the training of both the BSMGRS and the CAMGRS was successful. The method comprises performing gesture recognition of the user for the gesture tracking application. The gesture recognition is performed using the BSMGRS and in accordance with the established database of gestures.
Owner:TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)

Gesture tracking method and device, electronic equipment and computer readable storage medium

The invention discloses a gesture tracking method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of computer vision, and the method comprises the steps: carrying out the time synchronization of an obtained hand motion data set and an obtained electromyographic signal data set based on a preset optical signal, and obtaining the synchronized hand motion data set and the synchronized electromyographic signal data set; associating the hand action data and the electromyographic signal data at the same moment in the synchronized hand action data set and the electromyographic signal data set to construct a plurality of training samples; according to each training sample, performing iterative training on a preset to-be-trained model to obtain a gesture tracking model; and tracking the gesture of the target user based on the gesture tracking model. According to the method and the device, the natural interaction experience between the user and the equipment can be improved while the gesture tracking precision is ensured.
Owner:GEER TECH CO LTD

Copying gesture tracking system for intelligent learning desk

The invention discloses a copying gesture tracking system for an intelligent learning desk, which comprises an overturning plate, the overturning plate is arranged on the desktop of the intelligent learning desk, the upper surface and the lower surface of the overturning plate are respectively provided with an upper sinking groove and a lower sinking groove, and the upper sinking groove is provided with an adaptive transparent plate; comprising a conveying unit, the conveying unit comprises two annular air belts symmetrically distributed on the left side and the right side of an upper sinking groove and two driving wheels corresponding to the annular air belts, the front side wall and the rear side wall of the upper sinking groove are each provided with an arc-shaped channel used for being communicated with a lower sinking groove, and one driving wheel is rotationally connected into each arc-shaped channel; and each annular air belt is arranged on two opposite driving wheels in a sleeving manner. According to the invention, the copying learning can be completed only through small-range rotation of eyeballs without neck movement, the sight line does not need to be repositioned in the whole process, the best state of copying and reading can be maintained, namely, the user can enter a concentration state more easily, so that the copying efficiency is improved.
Owner:ZHEJIANG ANJI CHILD CARE FURNITURE CO LTD

A high-precision gesture tracking method and system based on hand-handle fusion

PendingCN122363519AHand partsEngineering
This invention discloses a high-precision gesture tracking method and system based on hand and controller fusion, belonging to the field of virtual reality and augmented reality technology. It addresses the technical problems in existing VR / AR systems, such as unknown extrinsic parameter estimation for hands and controllers, difficulty in tightly coupling low-frequency vision with high-frequency IMU, and self-occlusion issues in handheld states. The method includes: determining the grip state between the controller and hand based on acquired multi-source data; if the grip state is unoccluded or low-occlusion, performing optimal solution calculations under relevant kinematic constraints to obtain the wrist 6-DoF pose; if the grip state is high-occlusion, performing regression mapping processing on the infrared spot data and controller IMU data based on relevant spatiotemporal feature sequences; dynamically switching the gesture tracking between the controller and hand, and outputting the final hand posture data.
Owner:NANJING UNIV

VR hand motion tracking method, medium and equipment

The invention relates to a VR hand motion tracking method, medium and device, and the method is based on the interaction of a head-mounted display camera and a somatosensory device, and carries out the interaction switching tracking of a gesture and the somatosensory device at a preset frequency for the hand motion. And hardware implementation is completed based on the method. Gesture tracking and somatosensory equipment tracking are realized by adopting a gesture and somatosensory equipment interactive switching mode without adding additional equipment, and finally alignment of the gesture tracking and the somatosensory equipment is realized; on this basis, hand tracking is obtained based on a long exposure image, tracking of the somatosensory device is continuously achieved through cooperation of short exposure, the refreshing speed is high, the jamming phenomenon of the somatosensory device is relieved, relatively stable cost input is maintained, and the tracking effect is good; the somatosensory device especially refers to a VR handle.
Owner:PIMAX TECH (SHANGHAI) CO LTD

RF-based micro-motion tracking for gesture tracking and recognition

This document describes techniques for radio frequency (RF) based micro-motion tracking. These techniques enable even millimeter-scale hand motions to be tracked. To do so, radar signals are used from radar systems that, with conventional techniques, would only permit resolutions of a centimeter or more.
Owner:GOOGLE LLC +1

Method, device and system for preventing fingertip kneading mold penetration in VR gesture tracking and application

The invention relates to a method, a device and a system for preventing fingertip pinching mold penetration in VR gesture tracking and application. The method comprises the following steps: acquiring real-time three-dimensional space coordinates of a thumb fingertip joint point and an index finger fingertip joint point, and calculating a distance d between the thumb fingertip joint point and the index finger fingertip joint point; establishing a multi-level threshold group including an approach threshold and a contact threshold, establishing an anti-mold-penetrating preparation mode and an anti-mold-penetrating constraint mode, and triggering a corresponding mode based on the relationship between d and the multi-level threshold group; after the anti-mold-penetration preparation mode is triggered, the three-dimensional space coordinate positions of the thumb fingertip joint point and the index finger fingertip joint point are corrected; driving a virtual hand model to render based on the corrected fingertip position and other uncorrected hand joint point data; the device and the system are implemented based on the method, and are applied to the correction of kneading mold penetration in a VR man-machine gesture interaction process. According to the method, the interaction naturalness and immersion are remarkably improved, stable system performance is ensured, the problem of physical authenticity of micro-interaction is solved, and coherence, smoothness and naturalness of the whole hand posture are ensured.
Owner:PIMAX TECH (SHANGHAI) CO LTD

Writing pen touch recognition method based on gesture recognition and inertial sensor

The invention provides a writing pen touch recognition method based on gesture recognition and an inertial sensor, and relates to the technical field of touch recognition, the method is applied to a gesture-pen type fusion positioning system, and data of an inertial sensing device are obtained and processed into positioning coordinates of a writing pen point in a three-dimensional space, so that the positioning coordinates of the writing pen point are obtained; then the height information is processed into height information from the pen point to the writing plane, and finally a touch recognition result is obtained through linkage with vibration information of the inertial sensing device. According to the method, the gesture tracking capability commonly used by VR / MR / AR equipment on the market is utilized, the whole writing pen is prevented from being customized, the method can be embedded and applied to existing equipment at low cost, the writing surface and the writing pen type are not limited, the method has high universality, the vibration intensity is assisted by the pen point height to recognize touch, and the method is suitable for popularization and application. And the identification result is more accurate and reliable.
Owner:JILIN UNIVERSITY

Interaction mode switching method and device, equipment, storage medium and program product

The invention discloses an interaction mode switching method and device, equipment, a storage medium and a program product, and belongs to the technical field of computers. The method comprises the steps of determining a first position of a hand and a second position of a handle according to an image under the condition that the image is acquired; according to the first position and the second position, the distance between the hand and the handle is determined; according to the distance and a distance threshold value, the interaction mode is switched to a target mode, and the target mode comprises a gesture tracking mode or a handle tracking mode.
Owner:VIVO MOBILE COMM CO LTD

A method for three-dimensional guided operation based on industrial scenes

The present invention discloses a method for three-dimensional guided operation based on industrial scenes, involving the fields of AR and AI visual technology, including making a device model for identifying target instruments in a real environment, using yolov5 to train a model for identifying target equipment; displaying a virtual prompt panel in space, using the ARCore framework to enhance the understanding of the environment, motion tracking, and illumination estimation; using the hands detection module of the MediaPipe open source framework to detect the human hand joint nodes through the trained model, and return the three-dimensional position in the image to perform gesture tracking; according to the coordinate position of the gesture joint obtained in the gesture tracking, processing is performed, converted into data for judgment, and judgment is performed. This method can greatly reduce the operating threshold and the possibility of errors of operators, thereby improving the safety management and control level of smart factories.
Owner:LUCULENT SMART TECHNOLOGIES CO LTD

Gesture tracking method, apparatus, terminal device, and computer-readable storage medium

The application is suitable for the technical field of image processing, and provides a gesture tracking method and device, terminal equipment and computer readable storage medium, the method comprises the following steps: inputting a target image into a gesture tracking network model for processing, and outputting a gesture tracking result; if the gesture tracking result is that the target image contains a gesture, determining a first gesture box corresponding to the target image, and the inside of the first gesture box contains target gesture content. The above method can improve the accuracy of the terminal equipment in tracking the hand. And by performing frame skipping processing on the video image, the processing amount of the terminal equipment in processing the video image can be reduced, and the processing efficiency of the terminal equipment can be improved.
Owner:WUHAN TCL CORP RES CO LTD

Gesture tracking method and apparatus, device, readable storage medium, and program product

The present application provides a gesture tracking method and apparatus, a device, a readable storage medium, and a program product. The method comprises: acquiring a current hand image corresponding to a current user; performing a search to determine whether hand skeleton information corresponding to the current user is stored; and, if it is found that the hand skeleton information corresponding to the current user is stored, determining a hand pose on the basis of the current hand image and the corresponding hand skeleton information. The method of the present application can solve the problem in the existing technology of significant computational resource waste.
Owner:GRAVITYXR ELECTRONICS & TECH CO LTD

Power mode switching in gaze-and-gesture tracking applications

There is provided techniques for switching power modes in a gaze-and-gesture tracking application. A method is performed by a controller device. The method comprises activating a first UI input mode for the gaze-and-gesture tracking application. The first UI input mode is based on a first combination of EOG-based or camera-based eye tracking and EMG-based or camera-based gesture tracking. The method comprises, responsive to detecting that eye tracking and / or gesture recognition performance of the first UI input mode fails to fulfil a performance criterion for the gaze-and-gesture tracking application, activating a second UI input mode for the gaze-and-gesture tracking application. The second UI input mode is based on a second combination of EOG-based or camera-based eye tracking and EMG-based or camera-based gesture tracking, different from the first combination.
Owner:TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)

Method for improving gesture tracking accuracy based on face recognition

The invention provides a method for improving gesture tracking accuracy based on face recognition. The method comprises the following steps: S0, starting; s1, acquiring an image; s2, performing face recognition; s3, gesture tracking; s4, gesture recognition; s5, judging whether to end or not: if so, ending the whole process; and if not, returning to the step S1. And verification matching is carried out by using a face recognition result, and if matching is consistent, the target is considered to be a tracking target, so that the accuracy of gesture recognition is greatly improved.
Owner:INGENIC SEMICON CO LTD

A three-dimensional gesture tracking method based on an RGB camera

The application provides a three-dimensional gesture tracking method based on an RGB camera, which comprises the following steps: taking the RGB camera as an input, performing standardization processing on a picture, and sending the picture into a three-dimensional joint detection module to extract image features, predict a preliminary three-dimensional joint and calculate a hand skeleton length; using a particle swarm optimization algorithm to iteratively fit the hand skeleton length and a MAMO hand model, finding an optimal hand shape and obtaining a new three-dimensional joint; sending the new three-dimensional joint into an inverse kinematics module to solve posture parameters required by the MAMO model; using a MANO model to combine the optimal hand shape and the posture parameters θ to obtain final joints and grid vertices; and performing reconstruction rendering on the obtained grid vertices and joints to output a final three-dimensional hand real-time tracking posture. The method provided by the application has high prediction accuracy and high three-dimensional gesture tracking effect precision, and the tracking process and result are easy to realize.
Owner:NANJING UNIV OF POSTS & TELECOMM

Gesture tracking method and apparatus, and computer device and readable storage medium

Provided in the present disclosure are a gesture tracking method and apparatus, and a computer device and a readable storage medium. The method comprises: acquiring a vehicle cabin video data stream, performing image capturing on the vehicle cabin video data stream to obtain several image frames; triggering hand detection on the image frames at preset time intervals, so as to obtain hand position information of each triggered image frame; for each triggered image frame, determining hand position information of each non-triggered image frame on the basis of the hand position information of the triggered image frame; matching hand position information of hands on the basis of hand position information of every two consecutive image frames to obtain a matching result of the hand position information of the hands; and determining a dynamic gesture in the vehicle cabin video data stream on the basis of the matching result of the hand position information of the hands in every two consecutive image frames. By means of the method, the computing power required for gesture tracking is reduced, the requirements for the computing capability of a device are lowered, and the limitations are reduced, thereby ensuring that gesture tracking can be normally performed by means of each device.
Owner:HANGZHOU RUIJIAN ZHIXING TECHNOLOGY CO LTD

Filtering method, device and system for improving kneading action stability in VR gesture tracking and application

The invention relates to a filtering method, device and system for improving kneading action stability in VR gesture tracking and application. A kneading action state classification model is established; real-time three-dimensional coordinates of a thumb fingertip joint point and an index finger fingertip joint point are obtained, the distance between the thumb fingertip joint point and the index finger fingertip joint point is calculated, and kneading action state classification is conducted through the model; on the basis of different kneading action state categories, adaptive filtering processing is executed, and the data of the thumb fingertip joint point and the index finger fingertip joint point after filtering processing is used for driving a virtual hand model; the filtering device and the filtering system are realized based on the method, and are applied to gesture tracking in VR human-computer interaction. According to the method, different stages of the kneading action are accurately identified, and an accurate context basis is provided for switching of filtering strategies; dynamically associating the identified kneading state with the filtering intensity to realize intelligent switching; and unification of calculation efficiency and problem pertinence is realized.
Owner:PIMAX TECH (SHANGHAI) CO LTD