368 results about "Hand position" patented technology

The invention relates to the technical field of electromagnetic valves, in particular to an intelligent control faucet and a faucet body, the faucet carries a control system, and the system comprises an environment interference suppression module, a gesture recognition processing module, an electromagnetic hysteresis compensation module, a multi-parameter coupling optimization module and a residual magnetism elimination control module. According to the method, the infrared compensation proportion is dynamically adjusted by fusing the environment light intensity and the hand position information, the interference suppression capability is improved, the recognition stability under complex illumination is enhanced, the action consistency is extracted in combination with the gesture track waveform and the dynamic response feature, and the recognition accuracy is improved; electromagnetic hysteresis is dynamically corrected based on real-time current and displacement deviation combined with a temperature factor, motion feedback precision is improved, multi-parameter coupling is fused with multi-physical field data to construct a stable control reference, system sensitivity is enhanced, a reverse pulse sequence is designed by capturing a current attenuation waveform, residual magnetism interference is effectively eliminated, and system performance is improved. And multi-dimensional improvement of identification precision, control stability and response efficiency is integrally realized.

An augmented reality (AR) device generates hand annotations for an image depicting a user's hand. The device includes a display, a processor, and a memory storing instructions for performing operations. The device performs a calibration operation to generate a 3-D model of the user's hand based on measurements. The calibration operation prompts the user to mimic the hand gesture presented by the animated virtual representation of a hand to obtain optimal images of the hand for hand pose estimation. A 3-D virtual representation of a hand in a hand pose corresponding with a hand gesture is generated based on the 3-D model. The device presents the 3-D virtual representation of the hand in AR via the display. During presentation, the device detects an input and captures an image of the user's hand positioned to correspond with the 3-D virtual representation. The captured image is stored with corresponding hand annotations based on the 3-D model.

The invention discloses a video stream-based hand hygiene qualified behavior subject identification method for a hand hygiene behavior. The method comprises the following steps of: acquiring a gait, posture and hand action feature image frame sequence; hand position detection and tracking are performed through a target detection model and an optical flow method; classifying hand actions in each image frame through a fine-grained feature extraction model; the effectiveness of the action classification result is judged through a sliding window method, and a final action classification sequence is output; user identity recognition is carried out by fusing the gait, the posture and the hand action features through an identity recognition network, and user identity information is obtained; and finally, counting a comprehensive score of the hand hygiene process in combination with the action classification sequence and the related time, associating the score with the user identity information, and screening out a hand hygiene behavior subject with a qualified evaluation result. According to the invention, high-precision and real-time hand hygiene behavior detection and user identity information identification can be realized, and a more comprehensive scheme is provided for hand hygiene evaluation and management.

The invention discloses a gesture recognition method and device based on YOLOv5-FGS and Mediape and a medium. The method comprises the steps that a hand detection data set is constructed, and an improved YOLOv5-FGS hand detection model is obtained through training; performing hand detection on the gesture classification data set by using a YOLOv5-FGS hand detection model, performing hand key point detection through Mediape, training a naive Bayes classifier in combination with hand key point information output by the Mediape, and generating a gesture classification model; according to a video image to be detected, single-frame detection and hand position positioning are firstly carried out through the YOLOv5-FGS hand detection model, then hand key point detection is carried out through Mediape, hand key point features obtained through processing are detected through the gesture classification model, and a final gesture target positioning result and a final gesture target classification result are output.

To more stably determine the position and attitude of a hand gripping a target object.An information processing device includes: a position / attitude estimation unit that, taking each of points included in point cloud data generated based on a sensing result for a target object as contact points, estimates, for each of the points, candidates for a position and an attitude of a hand that grips the target object; a target object shape estimation unit that estimates a shape of the target object based on a distribution of the candidates for the position and the attitude estimated for each of the points; and a position / attitude determination unit that determines the position and the attitude of the hand gripping the target object based on the shape of the target object estimated.

The embodiment of the invention discloses a robot and a behavior planning method and control method thereof, and the behavior planning method of the robot comprises the steps: determining a target grabbing pose of the robot for grabbing a target object based on an object pose of the target object; the target grabbing pose comprises a target base pose and a target gripper pose; based on the target base posture and the current base posture of the robot, a motion control strategy of mechanical legs of the robot is determined; the motion control strategy is used for controlling the mechanical legs to drive the robot to move, so that a base of the robot reaches a target base posture; on the basis of the target gripper pose and the current gripper pose of the robot, a gripping control strategy of a mechanical arm of the robot is determined; the grabbing control strategy is used for controlling the mechanical arm to drive the gripper of the robot to grab the target object at the target gripper pose under the condition that the base reaches the target base seat pose.

A training aid for throwing a curveball is disclosed herein. The training aid can include a base member that can coupled to a user's wrist. The training aid can further include a first stiffener and a second stiffener coupled to the base member and extending towards the fingertips of the user. The first stiffener can extend over the top of the user's hand and the second stiffener can extend over the palm of the user's hand. The first stiffener and the second stiffener can maintain the wrist / hand position by preventing the wrist from flexing and extending.

An extended Reality (XR) system is provided for providing a user interface in an XR environment. The XR system detects a position and an orientation of a hand of a user. The XR system determines a user view of the hand using the detected position and orientation. In response to determining the user view is of a dorsal surface of the hand, the XR system causes display of a hand-centric user interface using a set of dorsal surface user interface elements. In response to determining the user view is of a palmar surface of the hand, the XR system causes display of the hand-centric user interface using a set of palmar user interface elements. The XR system detects, using the set of tracking sensors, a user input based on an interaction with the hand-centric user interface. The XR system then performs an action based on the detected user input.

An extended Reality (XR) system is provided for providing a user interface in an XR environment. The XR system detects a position and an orientation of a hand of a user. The XR system determines a user view of the hand using the detected position and orientation. In response to determining the user view is of a dorsal surface of the hand, the XR system causes display of a hand-centric user interface using a set of dorsal surface user interface elements. In response to determining the user view is of a palmar surface of the hand, the XR system causes display of the hand-centric user interface using a set of palmar user interface elements. The XR system detects, using the set of tracking sensors, a user input based on an interaction with the hand-centric user interface. The XR system then performs an action based on the detected user input.

System, process, and device configurations are provided for posture position detection and user feedback. A method can include capturing posture position data for the user using at least one imaging device, detecting a change in posture position, and controlling output of a posture position notification to the user in response to the change in posture position. Embodiments can include use of an imaging device on at least one of a display, gaming console, and head mounted gaming unit to capture posture position data. Capturing posture position data can include capturing image data of a reflection of the user for at least one of head position, shoulder position and hand position. Output of posture notifications can include controlling display of a message including a notice to correct user posture, or controlling operation of an electronic game for at least one of slowing game play and restricting game play operation.

A wearable device may include an actuator including a motor and / or circuitry, a sensor configured to generate motion data corresponding to a motion of a hand of a user, at least one processor configured to control the actuator, a cable connected to the actuator, and a body coupling component connected to the cable and connected or fixed to a body part of the user, wherein the processor is individually and / or collectively configured to estimate a position of the hand of the user based on the motion data corresponding to the motion of the hand of the user, determine a tension value to be applied to the cable at the position of the hand of the user based on the position of the hand of the user and a tension control model defined with respect to a surrounding space of the user, and control the actuator to generate tension at the determined tension value on the cable.

A computing system includes a distance measuring module, for detecting a spatial coordinate of a portion of a hand of a user, wherein the location or orientation of the portion of the hand is used for determining a first input data inputted by a user, a processing unit, generating an output data in based on the first input data; and a head wearable display. The processing unit is configured to compare a current spatial location of the binocular virtual image, which is located at the intersection of the optical path extension of the first collimated light signal and the optical path extension of the second collimated light signal, with the spatial coordinates of the part of the user's hand measured by the distance measuring module, and based on the comparison, to change the binocular virtual image or activate an application program.

The invention provides an MR training system based on gesture tracking. The MR training system comprises a head-mounted display device, a gesture tracking module, an environment sensing module, a virtual-real fusion engine, a training evaluation module and a multi-channel feedback module. The head display device is integrated with a binocular RGB camera, an infrared ToF depth sensor and a millimeter wave radar array, the RGB camera tracks and positions a hand position through a skeleton and collects a hand image at the same time, the millimeter wave radar array captures submillimeter displacement data of hand micro-motion, and the submillimeter displacement data is transmitted to the head display device through the infrared ToF depth sensor. Transmitting the acquired hand image and displacement data to a virtual-real fusion engine; the infrared ToF depth sensor directly calculates the distance between a target object and the sensor by emitting a modulated near-infrared light pulse and measuring the time difference of light reflected to the sensor, and generates a pixel-by-pixel depth map; a skeleton model of 21 joint points of a hand is constructed, the angle variation of the associated joints is calculated in real time, holding, rotating and pressing operation actions are recognized, and the operation actions are tracked and optimized according to image data and displacement data collected by head display equipment.

One aspect of the invention relates to a steering assistance system for a vehicle, comprising a steering wheel configured to provide steering wheel data describing the current hand position of the vehicle's driver. The steering assistance system further comprises a computing unit configured to receive the steering wheel data from the steering wheel, to receive trajectory data describing the vehicle's trajectory, to determine engine torque as a function of the steering wheel data and the trajectory data, and finally to provide a control signal describing the engine torque. The steering assistance system also includes an electric motor for the vehicle's steering gear, configured to receive the control signal and generate torque equal to the engine torque.

The invention provides an interaction method and device based on a vehicle-mounted screen, electronic equipment and a storage medium, according to the embodiment of the invention, a first user gesture is recognized through a high-definition camera arranged in a cabin, and under the condition that the first user gesture correspondingly activates a gesture control mode, the gesture control mode is started; in the gesture control mode, mapping the spatial position of the hand of the user in the vehicle to a cursor position corresponding to a display screen in a vehicle cabin; and executing a corresponding vehicle control instruction according to the current cursor position corresponding to the second user gesture in the display screen in the vehicle cabin and the gesture action corresponding to the second user gesture. By means of the scheme, gesture interaction of the multiple vehicle-mounted screens can be achieved, various different control logics are adopted according to different hand positions and gesture actions of the user so as to control the vehicle-mounted application program or the vehicle control component, the gesture control freedom degree is improved, and interaction between the user and the vehicle-mounted screens is more convenient.

1. Name of the designed product: waterproof mobile phone shell (with buckle hand position). 2. Use of the designed product: for waterproof mobile phone shell. 3. Design points of the designed product: in shape. 4. Pictures or photos that best show the design points: perspective view 1. 5. Other circumstances that need to be explained: A and B are transparent surfaces.

A three-dimensional positioning and motion-detecting system for human body and object status in mixed reality and a method thereof are disclosed. A virtualization computing device performs gesture recognition for scaling, moving or 3D rotating a virtual posture model, to make posture model aligning points of the virtual posture model correspond to the posture model positioning points one by one, a virtual-and-real display device displays the adjusted virtual posture model in real time, when the virtual posture model is fixed, the virtualization computing device recognizes a hand position on the physical environment image, and detects a motion on the hand position based on the posture model positioning points, to generate operating position information and hand motion information. The virtual-and-real display device displays virtual-and-real integration of operating position information, hand motion information and a physical space.

The invention provides a sewing action recognition method and system, a medium and a terminal. The method comprises the following steps: acquiring a sewing machine working area image when a turner performs sewing operation; acquiring a cloth contour and a hand position in the working area image of the sewing machine; acquiring sewing action information of the sewing machine; the sewing action information comprises the sewing needle number, the presser foot lifting state and the thread trimming frequency; and obtaining a sewing action recognition result according to the cloth contour, the hand position and the sewing action information. According to the sewing action recognition method and system, the medium and the terminal, accurate recognition of the sewing action is achieved through fusion of multi-modal data, and rapidness and high efficiency are achieved.

The invention provides an unhooking robot, and belongs to the technical field of compartment unhooking, the unhooking robot specifically comprises a chassis and a mechanical arm, the mechanical arm is connected with a manipulator, and the manipulator is used for carrying out unhooking operation on a compartment; the mechanical arm is connected with the manipulator and used for adjusting the position of the manipulator. The chassis is used for bearing the mechanical arm, and the chassis is arranged on the side of the carriage and can move in the same direction as the carriage; a telescopic positioning device is arranged on the chassis, and the two ends of the telescopic positioning device are connected to the chassis and the compartment respectively. Compared with the prior art, the time for unhooking operation through the mechanical arm is short, other preparatory work is completed before the compartment stops, namely the chassis is driven to move through movement of the compartment, in this way, in the compartment deceleration process, the mechanical arm can be controlled to move, and operation such as alignment of the mechanical arm and a hook handle is completed; and therefore, when the carriage stops, quick unhooking operation can be carried out through the manipulator.

The utility model discloses a physiotherapy instrument for postpartum rehabilitation treatment, and relates to the technical field of medical care, the physiotherapy instrument comprises a therapeutic instrument main body, the surface of the therapeutic instrument main body is fixedly connected with a storage box, the top wall of the storage box is fixedly provided with a sterilization lamp, the bottom wall of the storage box is provided with a groove, and the inside of the groove is slidably connected with a placing plate; the surface of the storage box is provided with an automatic opening and closing device, the automatic opening and closing device comprises two connecting lugs, and the two connecting lugs are both fixedly connected to the surface of the storage box. The rotating shaft rotates reversely and drives the sealing plate to rotate reversely to seal the storage box, the medical staff does not need to touch the sealing plate with hands in the process of opening and closing the storage box, the sealing plate can be opened and closed only with feet, the hands of the medical staff are prevented from being contaminated by bacteria, and then the safety of the medical staff for treating the postpartum pregnant woman is improved.

The invention relates to the technical field of robots, and discloses a finger capturing device and method for reinforcement learning of a humanoid robot, and the device comprises finger modules which are disposed on each finger of the humanoid robot, and each finger module comprises an IMU sensor, an LED lamp, a touch sensor, and a processing module; the IMU sensor is used for collecting motion state data of fingers; the LED lamps are used for carrying out ID identification on each finger through a flicker sequence of the LED lamps; the processing module is used for processing data acquired by the IMU sensor and controlling the LED lamp; the touch sensor is used for sensing the contact state of the finger and an external object; the camera is used for acquiring two-dimensional image data of the hand position of the humanoid robot in multiple directions; and the analysis center is used for identifying and obtaining the spatial position coordinates of each finger according to the two-dimensional image data in the multiple directions, and judging the hand posture according to the spatial position coordinates of each finger and the contact state and motion state data of the finger and the external object, so that the anti-interference performance and the accuracy of optical motion capture are improved.

The invention relates to the technical field of data anomaly detection, in particular to a monitoring video data anomaly behavior detection method based on deep learning. The method comprises the following steps: acquiring a figure video image of any figure in real time, detecting the figure video image, marking the figure video image as a target image when the front position information of the figure cannot be detected, and acquiring continuous multi-frame target images to obtain a target image set; according to the head position information and the hand position information of any person in each frame of target image in the target image set, acquiring a motion coefficient, and identifying whether any person has a suspected abnormal behavior; and if any person has the suspected abnormal behavior, determining an abnormal behavior detection result of any person according to the smoke concentration data in the target place and the pixel value difference of the pixel points in each frame of target image in the target image set. According to the invention, the abnormal behaviors of the employees in the target place can be accurately identified.

Systems and processors associated with an electronic keyboard are described. An example system includes an electronic keyboard with a threshold number of keys extending across a first width; and a display positioned above the electronic keyboard, the display extending at least as wide as the first width. The display provides real-time visual prompts aligned with each key, including the partially covered edge keys, and hosts an Al-driven user interface. A camera may capture a player's posture, hand position, gaze, and facial expressions. Transformer-based models may process inputs to generate adaptive feedback, emotion-aware coaching, and / or gamified scoring. Haptic key actuators, synchronized LEDs, and audio cues reinforce the feedback, while on-device encrypted inference and differential-privacy may filter and secure all biometric data.

An object detection method, electronic apparatus and gesture detection system are provided. A processor is configured to implement the following steps, including: executing an object detection module to detect an original image, and obtaining a first position information, a second position information and a third position information related to the same human body object from the original image through the object detection module; setting a valid determination range based on at least one of the first position information and the second position information; obtaining a hand position in the original image based on the third position information; in response to the hand position being within the valid determination range, executing a gesture recognition module; and in response to the hand position not being within the valid determination range, not executing the gesture recognition module.

The invention discloses an immersive sound effect VR sound console space positioning method and a related device, which can be used in the field of virtual reality, and the method comprises the steps: collecting the hand motion information of a user in real time, and determining the hand position; generating tactile feedback parameters based on the hand motion information; based on the tactile feedback parameters, establishing a space mapping relation between the hand and the virtual control, and calculating to obtain a coherence index of a motion trail of the virtual control; adjusting the vibration parameter based on the coherence index, and rendering the roughness corresponding to the texture parameter in real time based on the adjusted vibration parameter to obtain an optimized tactile feedback parameter; based on the optimized tactile feedback parameter, generating an audio parameter adjustment instruction and updating a visual display effect of the virtual control; and outputting an audio parameter regulation and control signal based on the visual display effect, the optimized tactile feedback parameter and the audio parameter regulation instruction. Therefore, the continuity of sensing the spatial position of the virtual control by the user is improved, and the user interaction experience is improved.

The invention discloses a driving test simulation control interaction method and related equipment. The method comprises the steps that under the condition that driving test simulation is carried out in a closed VR visual environment, the position and posture of the hand of a user are captured in real time, and the user is located in a simulator cabin; mapping the acquired position and posture of the hand to a virtual environment of a VR visual environment, a virtual operation part in the virtual environment being consistent with a physical part for realizing the same function in the simulator cabin in position and proportion; and obtaining the operation of a user on the physical component and / or the virtual operation component so as to perform driving test simulation control in the simulator cabin. The problem that in driving test simulator training, although a VR simulator can really provide higher simulation reality and immersion, students cannot observe the real world when wearing VR glasses can be solved.

A method (100) for automatically positioning a display (52) relative to an occupant (56) interacting with the display (52) in a vehicle (10), comprising: Identifying (104) user preferences for a position of the display (52) relative to the occupant (56) in the vehicle (10) with a system controller (34A); Monitoring (106) the posture, hand position, hand movements, head movements and gaze of the occupant (56) with an occupant monitoring system (50) within the vehicle (10) and in communication with the system controller (34A); Receiving (108) a verbal input from the occupant (56) with the system controller (34A) via a microphone (58) in communication with the system controller (34A); Determining (110), with the system controller (34A), based on the data received from the occupant monitoring system (50) and the microphone (58), that the occupant (56) is performing one of the following: Reaching towards the display (52); or Viewing the display (52); when the system controller (34A) determines that the occupant (56) is reaching for the display (52), automatically moving (112) the display (52) to a first position optimal to facilitate physical interaction of the occupant (56) with the display (52); and when the system controller (34A) determines that the occupant (56) is viewing the display (52), automatically moving (114) the display (52) to a second position that is optimal for the occupant (56) to view the display (52), characterized in that identifying (104) user preferences for a position of the display (52) relative to the occupant (56) in the vehicle (10) with the system controller (34A) further includes at least one of the following: Receiving a real-time input from the occupant (56) with the system controller (34A); and Accessing, with the system controller (34A), a machine learning model (60) of the occupant's (56) preferences based on previous interactions.

The present invention provides a DJ system for processing audio data, comprising an audio input unit for receiving audio data representing a piece of music, an audio processing unit for processing the audio data, an audio output unit for playing the audio data, and a gesture detecting apparatus for detecting a hand position, which is a position in space of a hand of a user of the system, and wherein the gesture detecting apparatus is configured to detect a turntable approach gesture or a transport control gesture.

The utility model relates to the field of electric vehicle accessories, and discloses an electric vehicle head vertical handle with an embedded design, which comprises a transverse handle main body and a vertical pipe, a handle stem is arranged in the middle of the transverse handle main body, the transverse handle main body is connected to the vertical pipe through the handle stem, grips are symmetrically connected to two sides of the handle stem, and an instrument display screen is mounted on the top surface of the handle stem. A car lamp button and a horn button are installed on one grip, a shift-up button, a shift-down button and an instrument setting button are installed on the other grip, a speed regulator is further arranged on one side of the instrument setting button, and a protective layer is arranged on the outer side of the grip. Due to the highly-integrated control function, a rider can complete operation without frequently shifting the sight line or the hand position, and riding safety and convenience are improved; due to the embedded design, water can be prevented from entering, the situation of damage caused by collision is reduced, and the durability of the product is improved; and in combination with an intelligent management system, more personalized and convenient use experience is provided for a rider.

The invention relates to the technical field of AR glasses, in particular to an intelligent AR glasses interaction system which comprises the following modules: a gesture recognition module which is used for recognizing a hand action of a user in real time and judging whether the hand action is matched with a preset interaction action; the interaction interface generation module is used for generating a corresponding interaction interface according to a preset interaction action when the gesture recognition module recognizes that the hand action is matched with the preset interaction action and outputting the interaction interface in the AR glasses, and the interaction interface is distributed at the hand position of the user according to a preset arrangement mode. According to the method and the device, the eyeball movement track of the user is captured and tracked in real time, the sight focus and the gazing duration of the user are analyzed to judge the attention direction and the potential interest point of the user, multiple interaction modes are realized, more natural, smoother and personalized interaction experience is provided for the user, and the intelligence of the AR glasses interaction system is improved.