89 results about "Hand region" patented technology

Example systems, devices, media, and methods are described for controlling the presentation of one or more virtual or graphical elements on a display in response to bimanual hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a first hand and defines a mapped region relative to a surface of the detected first hand. The system presents a virtual target icon at a position within or near the mapped region. The image processing system detects a series of bimanual hand shapes, including the detected first hand and at least one fingertip of a second hand. In response to determining whether the detected series of bimanual hand shapes matches a predefined hand gesture, the system executes a selecting action that includes presenting one or more graphical elements on the display.

The invention belongs to the field of millimeter-wave radar sensing and hand posture estimation, and discloses a millimeter-wave radar-based multi-target hand posture estimation method, which comprises the following steps of: 1, creating a hand region: detecting all objects in a millimeter-wave radar sensing region, detecting a predefined wake-up gesture through a wake-up detection model to recognize a target user, the method comprises the following steps: step 1, evaluating the occurrence probability of a wake-up gesture, and recognizing a hand region, step 2, in the created hand region, constructing a distance-azimuth-pitching three-dimensional feature cube which represents hand posture features; and step 3, estimating hand posture features through an m < 2 > HandNet model. The millimeter wave radar is used as a research object, hand posture estimation is achieved through the millimeter wave radar, multi-user and multi-hand interaction is supported, the shielding problem is effectively solved, and wide application scenes such as intelligent home control, intelligent terminal interaction, virtual reality equipment and sign language recognition are met.

A pressing tool includes a housing and pressing jaws arranged outside the housing. One or both pressing jaws can be pivoted into the open position by a user's hand acting upon the respective pressing jaw that faces the housing. An actuating switch is formed on a pin-like holding projection having a longitudinal extent with a free end which protrudes from the housing at an acute or right angle. A dimension of the holding projection transverse to the longitudinal extent is smaller than a smallest diameter of the hand region.

Electrically heated motorcycle glove with temperature overload control and uniform heating, characterized in that it comprises a back of the hand region (1), a palm region (2), a lacing (3) and a wrist region (4), wherein the back of the hand region (1) has a back of the hand base surface (11) in the interior of which a heating layer (14) is installed, in the central region of which an adjusting element (15) is installed, wherein the palm region (2) has a palm base surface (21) in the interior of which a heating layer (14) is installed, wherein the wrist region (4) has an extended thermal protection layer (41), above which an operating switch (42) is attached, and in the lower region of the extended thermal protection layer (41) a battery compartment (45) is formed, in the interior of which a rechargeable battery (46) is accommodated;wherein the back of the hand base (11) and the palm base (21) are sewn with sewing thread, the back of the hand base (11) and the extended heat protection layer (41) are sewn with sewing thread, and the palm base (21) and the extended heat protection layer (41) are sewn with sewing thread;

The invention relates to the technical field of part assembly detection, in particular to a visual identification method and system for a part assembly process, and the method comprises the following steps: obtaining a video stream in real time, carrying out the decoding preprocessing, and generating continuous frame images; identifying a hand region and an operation button region in the frame image, and judging the process starting condition by calculating the intersection-union ratio of the hand region and the operation button region; performing part state acquisition on the frame image based on the classification model, identifying the part state through a multi-frame joint judgment method, comparing the part state with a preset part target state, and judging a process expected condition of each part state; when the process meets the expectation, a target detection algorithm is combined with a multi-frame joint technology to carry out remnant identification; and when the expected condition of the working procedure is not consistent or the remnants are identified, outputting an alarm. The method has the advantages of being low in use cost and high in universality and adaptability.

The invention relates to the technical field of computer vision and human-computer interaction, and discloses a self-adaptive hand image recognition method and system based on multi-source feature fusion. The method comprises the following steps: acquiring a real-time video stream image from a camera, carrying out various filtering processing on the real-time video stream image, and respectively generating an illumination enhanced image, a background subtraction mask, a skin color area mask and a dynamic motion mask; dynamically adjusting the fusion weight of each filtering processing result according to the scene features of the real-time video stream image, and generating comprehensive filtering output through weighted fusion; performing multi-stage hand segmentation processing on the comprehensive filtering output to obtain an initial hand region mask, performing time sequence smoothing processing, and extracting a maximum connected domain as a final hand region mask; and inputting the final hand region mask into a convolutional neural network for gesture recognition, outputting a prediction probability of each type of gestures, and displaying a gesture classification result in real time. According to the method, the adaptability of hand detection to strong interference backgrounds and variable environments is enhanced.

The invention discloses an XR gesture tracking and recognition method based on multi-view depth fusion. The method comprises the following steps: constructing a virtual camera by adopting a perspective cutting method, and dynamically extracting a hand region after geometric correction through gesture detection and perspective cutting of each frame of image; in combination with internal and external parameters of a camera, through position coding and a multi-head attention mechanism, a geometrical relationship between visual angles is modeled, semantic relevance of multi-visual-angle 3D features is deeply excavated, globally consistent hand representation is constructed, then six-degree-of-freedom information of wrist joints and rotation angles of the joints are output based on a regression device, and forward kinematics and a linear skin algorithm are combined, so that the degree of freedom of the wrist joints is calculated. Generating a complete hand posture and skeleton key point coordinates; and based on the key point position and the rotation angle of each joint, gesture recognition is realized through template matching. According to the method, multi-view image information and hand kinematics constraints are combined, high-precision and high-robustness three-dimensional gesture attitude estimation and classification are achieved while real-time performance is guaranteed, and the method is suitable for various XR scenes.

The application relates to the technical field of image three-dimensional reconstruction. The application discloses a monocular hand-object interaction three-dimensional reconstruction method and device, a terminal and a storage medium, which can improve the quality of a hand-object interaction reconstruction result. The method comprises the following steps: acquiring an initial object grid, an initial hand grid and a target hand-object interaction grid corresponding to a target image; performing hand region and object region extraction processing on the target hand-object interaction grid to obtain a target hand rough region and a target object rough region; performing coarse registration of the initial object grid to the target object rough region by using an object registration algorithm to obtain an optimized object grid; performing coarse registration of the initial hand grid to the target hand rough region by using a hand registration algorithm to obtain an optimized hand grid; and performing parameter adjustment processing on the optimized object grid and the optimized hand grid by using a joint optimization algorithm to obtain a hand-object interaction reconstruction result corresponding to the target image.

The invention provides a finger motion capturing method, system and device, a storage medium and a program product, and the method comprises the steps: obtaining a target person image containing a target hand; detecting a target position of a target hand in the target person image; cutting a hand region image of a target hand in the target person image based on the target position; acquiring hand model parameters based on the hand region image; and acquiring a hand model of the target hand based on the hand model parameters. According to the scheme, the hand region image can be extracted from the target person image in a large visual angle range, and then the hand model parameters are acquired by utilizing the hand region image, so that the finger motion capturing method can keep robustness and stability in a large-range field, and the adaptability of the finger motion capturing method is improved.

The invention provides a dynamic gesture preprocessing and authentication method, a medium and equipment. The method comprises a preprocessing stage and an authentication stage. The preprocessing stage comprises the following steps: carrying out hand region segmentation and skeleton information extraction on input video data; performing standardization processing on the input video data to obtain a standardized image sequence and a corresponding skeleton sequence; the authentication stage comprises the steps of inputting a standardized image sequence and a corresponding skeleton sequence into an appearance and motion network for feature extraction; the appearance and motion network comprises appearance branches and motion branches; the appearance branch extracts appearance features from the standardized image sequence, and the motion branch extracts motion features from the skeleton sequence; and carrying out feature level fusion through a self-adaptive recoupling and fusion mechanism to obtain a final identity feature. According to the method, a double-flow authentication network is adopted, decoupling of appearance and motion features is achieved, targeted extraction and complementary expression of the features are achieved, and therefore the authentication efficiency and accuracy are improved.

The invention discloses a finger joint point spatial position estimation method, a finger joint point spatial position estimation device and head-mounted display equipment. The method comprises the following steps: performing hand recognition on an image acquired by a depth camera through a palm region detection model, and if the image has a hand region, marking the hand region from the image to obtain a hand region image; correcting the hand region image to obtain a distortionless hand region image; identifying the pixel coordinates of the articulation points in the distortionless hand region image and the relative distance of each articulation point through an articulation point detection model; and according to the pixel coordinates of the joint points and the relative distance, calculating through a preset objective function to obtain the absolute distance of the joint points. According to the invention, the calculation amount in the 3D hand joint point estimation process can be reduced, and the technical effects of meeting the high real-time requirement in AR / VR application are achieved.

The invention discloses a gesture recognition method and device based on a pulse camera, a medium and a product, relates to the technical field of gesture recognition, and discloses the gesture recognition method based on the pulse camera, and the method comprises the steps: taking pulse image data collected by the pulse camera as the input of a hand detection network, and obtaining dimension rising feature data based on an expansion convolution layer; expanding the dimension raising feature data in an inverse residual block of the hand detection network based on a target expansion coefficient to obtain an expanded deep convolutional feature, the target expansion coefficient being smaller than a default expansion coefficient of the hand detection network; obtaining a weighted feature map obtained after the expanded depth convolution feature passes through an embedded SE architecture; performing multi-dimensional collaborative hand region directional extraction processing based on the weighted feature map to obtain a hand region of the pulse image data; and identifying the gesture type of the hand region. The stability and accuracy of gesture recognition under a low-computing-power platform are improved.

Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for the tracking of interacting hands using a sensor of a wearable multimedia device. In an embodiment, a method comprises: obtaining, with a sensor of a wearable multimedia device, a first frame of two-dimensional (2D) image data and a second frame of three-dimensional (3D) depth data; determining multiple hand regions in the first frame of 2D image data; determining a location of each hand region in the first frame of 2D image data; detecting at least one landmark in each detected hand region; generating a confidence score for each landmark detected in each detected hand region; determining 3D world coordinates for each landmark that is visible in the first frame of the 2D image data; tracking each landmark in 3D world coordinates; and determining an interaction with the hands based on the tracking of each landmark in 3D world coordinates.

The invention discloses a hand detection method and device, a nonvolatile storage medium and electronic equipment. The method comprises the following steps: processing an image by using a computer vision model to obtain a plurality of prediction frames and a left-hand confidence score and a right-hand confidence score corresponding to each prediction frame; marking a left-hand prediction frame and a right-hand prediction frame in the plurality of prediction frames; copying the target prediction box to obtain a first copy and a second copy, marking the first copy as a left-hand prediction box, and marking the second copy as a right-hand prediction box; performing feature modulation processing on the left hand prediction frame set to obtain key point coordinates corresponding to a hand region in a left hand prediction frame; and performing feature modulation processing on the right-hand prediction frame set to obtain key point coordinates corresponding to the hand region in the right-hand prediction frame. The technical problems of detection confusion and key point identity confusion caused by difficulty in accurately distinguishing the left hand and the right hand in hand detection and hand key point positioning are solved.

The invention discloses a hand movement track recognition method, system and device and a medium. The hand motion trail recognition method comprises the following steps: acquiring hand shot image data; the hand shot image data image is input into an improved YOLOv5 gesture detection model to obtain a hand area, the improved YOLOv5 gesture detection model comprises a backbone network, a neck network and a head network, C3 modules in the backbone network and the neck network are replaced with C3Rep modules, and a SimAM attention mechanism is introduced into the backbone network; and according to the hand region, obtaining a hand motion track. By adopting the embodiment of the invention, the hand region can be quickly positioned, and the hand motion track can be accurately identified and fitted, so that the track identification speed and precision can be improved, and reliable data support can be provided for related technologies.

This invention discloses a machine vision-based method and system for monitoring medication dispensing. The method involves acquiring a multi-view polarized image sequence and corresponding depth image sequence of the medication dispensing operation area; performing physical-level specular de-illumination on the multi-view polarized images and identifying transparent material regions to generate multimodal fusion data with transparency priors; detecting the operator's hand posture in real time to generate a dynamic occlusion mask; constructing and training a dynamic neural radiation field, incorporating a temporal de-occlusion prior loss during training to utilize unoccluded spatiotemporal information to recover the visual features of the area marked by the dynamic occlusion mask; and based on the trained dynamic neural radiation field, removing the hand region and rendering a de-occluded and specular-de-illumination virtual monitoring view. This invention solves the problems of target loss, inaccurate measurement, and poor interpretability caused by specular reflection, transparent objects, and dynamic occlusion.

The application discloses a gesture recognition method and a display device. The method uses hand posture confidence to determine whether to simplify the step of determining hand region position information. When the hand posture confidence corresponding to the previous frame of original color image is not less than the preset confidence, the step of determining the second hand information can be simplified, and the time for recognizing the gesture is shortened. The method comprises the following steps: when the obtained original color image is not the first frame of original color image, determining the hand posture confidence corresponding to the previous frame of original color image; if the hand posture confidence is not less than the preset confidence, predicting the hand region position information of the obtained original color image according to the first hand information obtained from the previous frame of original color image; removing the interference pixel points by using the hand region position information to obtain the first depth image; determining the second hand information by using the first depth image; and determining the hand posture information according to the first hand information and the second hand information.

The application discloses a method for determining the centroid of a human hand region and a display device. When a user performs 3D gesture interaction, an image collector collects an RGB image and a depth image. Based on the coordinates of the center point of the human hand detection frame in the RGB image, the coordinates of a target point corresponding to the center point of the human hand detection frame in the depth image are calculated. Based on the coordinates of the target point and the depth value of the human hand region where the target point is located, the coordinates of the centroid of the human hand region in the depth image are calculated. The method and the display device are based on non-aligned RGBD images, do not need complex calculation to realize the alignment function of the RGB image and the depth image, but greatly simplify the calculation method of the centroid of the human hand region in the depth image using the epipolar constraint method, reduce the search range of the corresponding feature points from the RGB image to the depth image, can timely determine the centroid of the human hand region, realize real-time interaction of the 3D gesture algorithm in an embedded terminal, and improve the immersive interaction experience of the user.

The invention relates to a hand-held vacuum cleaner, comprising - a handle (1) with a hand area (11) designed to position a user's hand, - a sensor (3) arranged in the hand area (11) and designed to sense the presence and absence of a user's hand in the hand area (11), - another sensor (4) designed to sense a movement of the vacuum cleaner, and - a control and / or regulating device (6) which is set up and designed to switch on the vacuum cleaner when the sensor (3) senses the presence of the user's hand in the hand area (11) and the further sensor (4) senses a movement of the vacuum cleaner, and to switch off the vacuum cleaner when the sensor senses an absence of the user's hand in the hand area (11) and the further sensor (4) senses a lack of movement of the vacuum cleaner (21).

Embodiments of the present application disclose a gesture recognition method and device, and a storage medium, including: in a case where a to-be-processed image is acquired, processing the to-be-processed image according to a plurality of preset image reduction rules to obtain a plurality of reduced to-be-processed images; performing hand detection on the plurality of reduced to-be-processed images to obtain a hand detection frame; acquiring an image in the hand detection frame from the to-be-processed image to obtain a hand region image; and determining a target gesture in the to-be-processed image according to the hand region image.

The invention provides a double-branch fusion-based dynamic gesture recognition method, a model training method and equipment, and the recognition method comprises the steps: extracting a plurality of target images containing hand targets from target video data, and generating a first image and a second image corresponding to each target image to form a target image sequence, the resolution of the first image is smaller than that of the second image; inputting the target image sequence into a dynamic gesture recognition model to enable the image feature extraction branch, the hand feature extraction branch and the recognition head to obtain gesture category prediction result data corresponding to the target image sequence; and outputting gesture category prediction result data. According to the method and the device, the problems that the model feature extraction capability is reduced and the gesture recognition precision is not high due to the fact that the distance between the hand and the camera is changed to cause the scale inconsistency of the hand region in the existing dynamic gesture recognition mode can be solved.

This invention provides a gesture command recognition method based on an improved contactless data stream network. It utilizes the coordinates of key points in hand data extracted using an improved MediaPipe network algorithm framework based on artificial intelligence. The improvements to the MediaPipe network include increasing the recognition rate of the network model, enhancing the accuracy of key gesture features, and optimizing scene adaptability. The method achieves rapid gesture category determination by "precise hand region cropping and positioning—multi-scale key feature point fusion enhancement—gesture category static and dynamic classification adjustment." This invention addresses the recognition bias caused by excessively small gestures in long-distance photography and detailed gestures in close-up photography by adding a multi-scale feature enhancement module; it also reduces the misjudgment rate of gesture recognition by adding limb nodes and fusing the association between limbs such as the arm and torso; it enhances robustness in complex environments, reducing background interference and occlusion; and it strengthens the motion features between image frames, distinguishing between static and dynamic gestures and improving the dynamic gesture recognition rate.

The embodiment of the application provides a kind of server and portrait segmentation method, hand recognition is carried out to the original picture collected;When there is no hand region, the original picture is input to portrait segmentation network, and first portrait mask chart is obtained;When there is hand region, if hand region and human region coincide, the original picture is input to portrait segmentation network, and first portrait mask chart is obtained;If they do not coincide, hand picture is copied and input to hand segmentation network, and hand mask chart is obtained, and the original picture is input to portrait segmentation network, and second portrait mask chart is obtained;Hand mask chart and second portrait mask chart are fused, and third portrait mask chart is obtained;According to first or third portrait mask chart, portrait part is segmented out.The application trains portrait segmentation network using multi-scale edge supervision, improves image edge segmentation effect, separately processes hand picture through hand segmentation network, improves the integrity of portrait segmentation, and improves the overall experience of user.

The present disclosure relates to an information processing device and an information processing method that make it possible to improve the accuracy of estimating the shape of a person's hand estimated from a captured image of the person who is a subject. In the present invention, a mesh is estimated from an image of the person who is the subject, the mesh is used to set a hand joint parameter to 0 and determine the size from the wrist to the tip of the middle finger when the palm is opened as the size of a hand region, the skeleton of the person is estimated from the image, a center position of the hand region is determined from the joint group corresponding to the skeleton of the person, and the hand shape is estimated on the basis of a hand image obtained by cutting out, with the center position of the hand region as a reference, the size range obtained by multiplying the size of the hand region by a prescribed coefficient. The present disclosure can be applied to virtual viewpoint image reproduction apparatuses.

The application relates to the field of video applications, and provides a video desensitization method and device, electronic equipment and a computer program product. The method comprises the following steps: acquiring video data, identifying a human hand region based on the video data, obtaining N gesture recognition results and M hand contact article recognition results, determining a sensitive region and a target sensitive level according to the N gesture recognition results and the M hand contact article recognition results, and performing desensitization processing on the video data according to the sensitive region and the target sensitive level. The video desensitization method provided in the embodiment of the application can solve the technical problem that a hand contact article or hand operation of a photographed person cannot be desensitized, personal information of the photographed person is easily leaked, and the personal information safety of the photographed person is improved.

The application provides a gesture recognition method, a model construction method, a device and a storage medium. The recognition method comprises: inputting a to-be-recognized image into a pre-constructed gesture recognition model to obtain a first recognition result; in the gesture recognition model, the first recognition model comprises a first feature extraction module, a second feature extraction module, a feature fusion module and a first recognition layer, the first feature extraction module extracts image features of the to-be-recognized image layer by layer to obtain shallow layer features; the feature fusion module determines position features of a user gesture according to the shallow layer features, fuses the shallow layer features and the position features and inputs the fused features into the second feature extraction module; the second feature extraction module is used for feature extraction; and the first recognition layer recognizes image features extracted by the second feature extraction module to obtain the first recognition result. The application can fuse key point features of the to-be-recognized image and the shallow layer features, strengthens hand region features and thus makes the recognition result more accurate.

The application discloses a hand detection method based on a RetinaHand light infrared image, and comprises the following steps: S100, generating a hand region image by using a hand detection network based on RetinaHand; and S200, performing enhancement processing on the generated hand region image. The method has the characteristics of short delay, accurate hand detection positioning and real-time generation support, and can be widely used in natural interaction in the fields of intelligent vehicles, intelligent homes and robots.

This invention relates to the field of wearable device technology, specifically disclosing a wearable hand device, a physiological monitoring component, a signal processing method, and a system. The device includes an elastic wrapper with a palm region and a back of hand region. The palm region has a conductive coupling portion; in the wearing state, both sides of the conductive coupling portion are electrically connected to the user's palm skin and electrodes of an external device, respectively. The back of hand region has a physiological monitoring component, including a physiological signal acquisition module, a signal processing module, and a status indication module. The signal processing module is electrically connected to the physiological signal acquisition module and the status indication module, and controls the status indication module to indicate the physiological state based on the physiological signals acquired by the physiological signal acquisition module. At least one of the elastic modulus, hardness, and thickness of the palm region is lower than the corresponding parameter of the back of hand region. This solution enables physical interaction between the wearable hand device and external devices, as well as real-time physiological state perception under high-load training scenarios.

This application discloses a method, apparatus, and method for training a dynamic gesture detection network. The network training method includes: acquiring multiple gesture videos, each corresponding to a dynamic gesture; performing image processing on each gesture video to determine a first feature map and a second feature map corresponding to each gesture video; wherein the first feature map corresponding to any gesture video is used to represent: motion information between two adjacent frames in any gesture video, or hand contour information in any gesture video; the second feature map corresponding to any gesture video is used to represent: the position information of the hand region in any gesture video; and iteratively training the dynamic gesture detection network based on the first and second feature maps corresponding to each gesture video to obtain a target detection network. This application solves the technical problem in related technologies that training a dynamic gesture detection network requires a large amount of training data and involves a complex training process.

The invention discloses a chemical experiment dangerous action identification method, and relates to the technical field of dangerous action identification, and the method comprises the following steps: obtaining an experiment video stream, and carrying out frame extraction analysis to obtain frame picture data; extracting a region of interest of the frame picture data; detecting an experiment bottleneck area, a human face area and a human hand area in the interested area; detecting a nose area according to the face area; calculating a cosine distance between the experimental bottleneck area and the nose area, calculating an overlapping area between the experimental bottleneck area and the human hand area, and if the overlapping area is greater than a preset threshold value, detecting a human hand state; judging whether dangerous actions exist or not according to the cosine distance and the hand state. According to the method, multi-dimensional joint judgment is realized by combining multi-region detection, nose region detection and human hand state detection, and the accuracy of chemical experiment dangerous action recognition is improved.