135 results about "Movement tracking" patented technology

The invention relates to the technical field of dynamic visual target motion tracking control, in particular to a dynamic visual target motion tracking control method and system based on deep learning, and the method comprises the steps: synchronously collecting continuous multi-frame target scene image data through a visual multi-frame collection module; and performing time sequence association and memory fusion on target features in continuous multi-frame target scene image data through a cross-frame feature memory fusion module, and constructing a target feature model. According to the invention, the current and historical stable features are dynamically fused through the cross-frame feature memory fusion module, time sequence association is realized in combination with the long and short-term memory network, and the problem of slow feature model updating under target deformation and shielding is solved; the deformation-shielding bimodal recognition module accurately recognizes a scene state, provides a basis for the multi-branch Kalman filtering prediction module, enables the multi-branch Kalman filtering prediction module to call a corresponding branch, corrects a prediction equation through a compensation factor, and improves the position prediction accuracy.

The invention relates to the technical field of metallurgical continuous casting production, in particular to a continuous casting blank movement tracking method, which comprises the following steps of: calculating the thermal deformation of each section of a casting blank according to the section temperature of the casting blank along the length direction in combination with the material thermal expansion coefficient and the section length at the corresponding section temperature, and generating the real-time correction position of the casting blank after a physical correction track is generated; on the basis of the real-time correction position, a preset casting blank benchmark reference position, the real-time pulling speed, the real-time cooling water amount, respective preset benchmarks and motion inertia deviations calculated on the basis of material physical properties and the real-time pulling speed, track prediction adjustment factors are generated; generating a compensation amount for the reference disturbance compensation amount by combining the matching degree of the visual solidification front edge and the model prediction, obtaining a position compensation value, superposing the position compensation value to the original trajectory, obtaining a final tracking trajectory, converting the final tracking trajectory into a servo control instruction, and dynamically correcting the casting blank tracking position. According to the invention, the precision, the dynamic performance and the intelligent performance of the continuous casting blank movement tracking are realized.

A method and system for motion tracking that integrates pose estimation and segmentation. The method includes accessing a first set of keypoints generated by processing at least one image of a body area of a person. The first set of keypoints can be generated via pose estimation. The method further includes processing the at least one image to generate a body mask subsequently filtered to identify a second set of body contour keypoints, executing a predetermined function to identify a new keypoint based on the first set of keypoint and the second set of keypoints, generating a third set of keypoints based on the first set of keypoints and the new keypoint, and tracking the third set of keypoints to generate motion tracking data. The method generates feedback for the person based on the motion tracking data. The new keypoint and / or feedback can be generated based on a physical activity.

A user's accommodative spasm can be evaluated and mitigated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments, which can include objects, optotypes, various lighting conditions, and various weather conditions, to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she focuses on various objects placed at different distances away from her in the virtual environments. Optionally, advanced algorithms in the computing device dynamically alter the virtual environments and the visual tasks and analyze the user's responses to evaluate the user's accommodative spasm.

The invention discloses a distributed electric vehicle motion planning method and system considering surrounding vehicle interactive perception, and relates to the technical field of electric vehicle motion planning. The method comprises the following steps: constructing a distributed electrically-driven automobile nonlinear dynamic model, and designing a motion tracking controller by adopting a feedback linearization method; based on the constructed vehicle closed-loop dynamics system, a regional polyhedron approximation method is adopted to carry out modeling and characterization on a safety forward reachable set of the vehicle; and in combination with a probability distribution model of interaction behaviors of surrounding vehicles, introducing a conditional value-at-risk constraint mechanism, converting an automobile motion planning problem into a trajectory optimization problem, and solving and outputting a final motion planning trajectory. According to the method, the advantage that four wheels of a distributed electric drive automobile are independent and controllable is fully utilized, the control freedom degree of the method is remarkably improved compared with centralized drive, a conditional value-at-risk constraint mechanism is introduced to be combined with a surrounding automobile interaction behavior probability distribution model, and safety and agility balance in an uncertain environment is guaranteed.

Embodiments described herein relate to systems, devices, and methods for use in the implementation of a brain-computer interface that integrates real-time eye-movement tracking with brain activity tracking to present and update a user interface that is strategically designed for high speed and accuracy of human—machine interaction. Embodiments described herein also relate to the implementation of a hardware agnostic brain-computer interface with specific user interface adaptations to enable high-speed, intuitive, and accurate user manipulation of applications and / or machines.

Vision safety protocols in workplaces (e.g., a construction site, factory, or hospital) can be evaluated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments with virtual hazards to be displayed on the VR headset. The computing device can prompt the user to complete a task in the virtual environment while adhering to a set of vision safety protocols. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she completes the task. Optionally, algorithms in the computing device can assess the efficacy of the vision safety protocols based on the user's performance of the task and recommend changes to the vision safety protocols that increase workplace safety and efficiency. Optionally, the computing device can cause the virtual hazards to be changed.

A user's visual disorders can be treated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes vision tests to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset can collect data about the user as she completes the vision tests. Using the data collected by the VR headset, the computing device can evaluate the user for various visual disorders and develop a personalized vision therapy plan for the user. Optionally, advanced algorithms in the computing device dynamically alter the vision therapy plan based on the user's performance and the progression of her visual disorders.

The invention discloses a respiratory movement tracking method and system, computer equipment and a medium thereof, which are applied to the technical field of medical treatment, and the method comprises the following steps: inputting a CT image sequence into a network model pre-constructed based on a conditional diffusion model, identifying the morphological change of a target area along with respiration, and generating a sequential deformation field changing along with respiration; selecting representative tracking points such as organ edge special position points and focus area center points from a target area, tracing position information at different moments according to a time sequence deformation field, calculating displacement and forming a displacement track; irrelevant frequency interference in displacement track data is filtered out through a band-pass filtering technology, breathing movement related signals are highlighted, phase information is extracted through Hilbert transform, a breathing movement curve is drawn, visual presentation and tracking of breathing movement are achieved, doctors can be helped to more accurately grasp the breathing law of a patient, and the accuracy of breathing movement tracking is improved. Errors caused by respiratory movement are avoided in advance in surgical planning.

A moving body tracking device obtains the position of a tracking object 55, and generates a signal for permitting irradiation of a target 50 with radiation when it is determined that the tracking object 55 exists inside a gate range. In the moving body tracking device, the gate range varies between timing when the tracking object 55 enters the inside from the outside of the gate range and timing when the tracking object exits from the inside to the outside. Accordingly, provided are a moving body tracking device and a radiation irradiation system with which it is possible to suppress a change in the dose distribution and a decrease in irradiation efficiency due to the influence of latency.

Motion tracking accuracy is an important feature to an immersive augmented or virtual reality experience. Motion tracking may be computed based on data from an inertial measurement unit of a device. This data may include errors that can vary with temperature. The disclosure describes a calibration process to reduce or eliminate these errors. The calibration process does not require special equipment and can be performed while the device is in use (i.e., online).

An apparatus for configuring a wearable device for exercise tracking includes a data storage unit for storing sensor data generated by a sensor arrangement in the wearable device based on sensed movement of the wearable device and optical movement data including representations of an individual obtained from an image-based monitoring system; and a processing unit configured to: execute a movement tracker model on the sensor data to determine a first exercise activity and an associated first confidence indicator; execute an optical tracker model on the optical movement data to determine a second exercise activity and an associated second confidence indicator; process the movement tracker model based on the first confidence indicator and the second confidence indicator.

The invention discloses a digital photo frame angle adjusting method and system based on human body movement tracking, and the method comprises the steps: obtaining gravity center distribution data in the movement process of a user, processing the gravity center distribution data, and obtaining a gravity center distribution data set; generating an initial data set, and determining gravity center distribution characteristics; the intermittent static duration in the user moving process is analyzed, segmented labeling is carried out, and boundary point data are obtained; extracting moving intermittent features in the intermittent feature time sequence, and generating fluctuation mode distribution information; a segmented adjustment mechanism is adopted to generate an initial angle adjustment scheme; tracking the dynamic posture of the user in real time to obtain a dynamic posture estimation result; determining a final angle adjusting path; determining an angle adjustment opportunity based on the final angle adjustment path; and adjusting the pitch angle of the digital photo frame. According to the method, the pitching angle of the photo frame can be accurately adjusted in time at a proper adjusting time.

The invention discloses a bicycle driving risk early warning method and system based on visual identification, and relates to the technical field of visual identification. The method comprises the following steps: acquiring driving sensing data through a sensing module carried on a bicycle body; identifying a plurality of dynamic traffic participants based on the visual perception data, and predicting future behavior intentions and motion trails; carrying out risk assessment by fusing the predicted behavior intention, the motion trail and the running state data of the bicycle, and constructing a risk perception grid which comprises a traffic event, a participant, a risk level and a movement tracking state; and based on the risk perception grid, identifying the traffic event with the risk level or the mobile tracking state reaching an early warning threshold value and the positioning space, and generating early warning feedback information. The technical problems of insufficient bicycle driving risk identification and untimely early warning in the prior art are solved, and the technical effects of driving risk active perception and timely early warning based on visual prediction are achieved.

Methods and systems for performing computer-assisted surgery, including robot-assisted image-guided surgery. Embodiments include marker devices for an image guided surgery system, marker systems and arrays for tracking a robotic arm using a motion tracking system, and image guided surgery methods and systems using optical sensors.

A method, system, and computer readable medium for switching between motion tracking mode. The method includes detecting a significant change in confidence level for motion tracking. A change from a first tracking mode to a second tracking mode is initiated when a significant change in confidence level is detected and the change is paused until a saccade or blink is detected. by eye tracking device. After a saccade or blink is detected the tracking mode switches from the first tracking mode to the second tracking mode.

The application provides a human motion tracking method and system based on regional saliency analysis in the technical field of motion tracking, and the method comprises the following steps: step S10, creating a gating network model and a plurality of expert models based on a convolutional neural network, and training each gating network model and expert model; step S20, acquiring human posture data and monitoring data of a flexible sensor; step S30, inputting the human posture data into the gating network model to obtain weight coefficients of each expert model; step S40, inputting the monitoring data into each expert model to obtain posture prediction results, obtaining the human posture of a current frame based on the weight coefficients and the posture prediction results, and then completing human motion tracking. The application has the advantage that the accuracy of human motion tracking is greatly improved.

The invention discloses an optical flow-driven remote sensing video multi-target tracking method and system. The method comprises the following steps: acquiring an image sequence of a remote sensing video; estimating a two-dimensional displacement diagram of the current frame image by using a sparse optical flow algorithm; performing multi-frame feature fusion based on the two-dimensional displacement diagram to obtain a final fusion feature, and performing detection by using a detection head to obtain a target set; combining the target set obtained by detecting the previous frame of image with the displacement vector of the target to obtain a forward estimation set of a group of targets; and matching the two sets, constructing an association cost matrix by using an IoU overlapping degree, and performing optimal allocation by using a Hungary algorithm or a greedy matching algorithm to allocate a unique identity identifier to each target so as to realize consistent association of inter-frame targets. The invention aims to solve the problems that the inter-frame displacement of the target in the remote sensing video is extremely small and the motion information is difficult to fully perceive and utilize, the detection precision and track stability of the target are improved, and the detection perception capability and identity consistency in a weak motion tracking scene are improved.

The application provides a kind of park lane line perception method and system based on multi-source data fusion and prior map constraint, it is related to map and positioning navigation technical field, this method includes: collecting multi-source data and pre-processing image;Extract color, edge and semantic feature for weighted fusion, generate candidate lane line heat map;Obtain high-precision map prior information and project to image coordinate system, spatial screening is carried out to candidate point;Adaptive model fitting is carried out to effective point set, and lane line observation value is obtained;Kalman filtering tracking and prediction are carried out in combination with vehicle kinematic model;Comprehensive multi-dimensional index calculates confidence and carries out hierarchical processing.The application improves the detection robustness in complex environment by multi-feature fusion, uses map prior to carry out flexible constraint to eliminate noise, introduces motion tracking to ensure continuity when shielding, and realizes abnormal response through confidence evaluation, effectively solves the perception problem caused by unclear park lane line feature and variable environment.

The present invention provides a system for monitoring and improving toothbrushing effectiveness. The system comprises a camera device comprising a camera or similar visual sensor configured to capture real-time footage of a user brushing their teeth an AI-powered software module is designed to analyse the footage using object recognition, pose estimation, and motion tracking algorithms to detect the user's hand, toothbrush, and face, a feedback device that comprises a feedback interface that provides real-time visual, auditory, or haptic feedback based on brushing technique, including parameters such as angle, coverage, and movement speed and movement patterns. Wherein the feedback provided comprises instructions to the user to alter their toothbrushing technique to bring the parameters closer to a predetermined set of ideal values. Thereby providing a system operates independently of sensors, accelerometers, or physical markers embedded in or attached to the toothbrush.

In described techniques, a first sensor signal is received from a first sensor coupled to an extended reality device within a moving frame of reference. A second sensor signal is received from an image sensor within the moving frame of reference and in communication with the extended reality device. A motion of the extended reality device with respect to the moving frame of reference may be determined, based on the first sensor signal and the second sensor signal.

The invention discloses a visual odometer method with mine weak texture perception enhancement and a related device. The method comprises the following steps: acquiring a mine frame stream image; evaluating the brightness of the mine frame stream images, and screening out mine frame stream images which need or do not need image restoration processing; processing the mine frame stream image needing to be subjected to image restoration processing by adopting a multi-stage image illumination restoration method; adopting an ORB feature point extraction framework, performing texture measurement on the mine frame stream restored image and the mine frame stream image which does not need to be subjected to image restoration processing based on a Tamura theory, and obtaining feature point distribution density; improving the quadtree homogenization based on the sensing condition of the mine frame stream image texture; performing pre-integration and initialization on the IMU data by using all the IMU data in a time period from a previous frame to a current frame in the mine frame stream image; carrying out tight coupling on the matching motion tracking information of the mine frame stream image and the IMU motion information, and calculating the relative pose of the equipment main body carrying the speedometer.

Parallel processing computer systems and methods for real-time multimodal behavioral classification and dynamic content adaptation are provided. A parallel processing pipeline implements concurrent execution of sensor data ingestion, neural network inference, content adaptation, and rendering stages across specialized processor resources including graphics processing units and tensor processing units. The parallel processing pipeline achieves end-to-end latency of less than 200 milliseconds from sensor data capture to rendered content output, representing a reduction of at least 60% compared to conventional sequential architectures exhibiting latencies exceeding 500 milliseconds. A trained neural network model comprising feature extraction modules with parallel convolutional branches, a bidirectional Long Short-Term Memory temporal processing module, and a classification module processes multimodal sensor data including video frame data, audio waveform data, motion tracking data, and physiological sensor data to classify behavioral states and calculate engagement levels. A dynamic adjustment algorithm modifies content parameters including difficulty level, environmental complexity, and reinforcement schedule based on real-time performance metrics to maintain user performance within target ranges.

The application discloses a system for quickly solving tag coordinates by using multiple UWB base stations, which comprises multiple (more than 3) UWB base stations, and the multiple base stations are arranged as equidistant squares; a layout schematic diagram of 9 base stations is shown in the drawing, and the distance between every two adjacent base stations is 8 meters; the steps of the new method for solving tag coordinates are as follows: S1, first, the ranging values TD[i] (i=0, 1, 2, … n, n=4, 9, 16, 25, 36…) of a tag T to each base station are acquired; the method for solving tag coordinates by using two base stations and three base stations in the conventional technology has some problems, such as no solution, conjugate coordinate solution, etc.; and by using the positioning system and the quick solving method, the positioning accuracy and stability are improved by simultaneously positioning by using multiple base stations; and because the tag position is estimated and tracked, the uncertainty and change of the tag in motion can be better handled, so that better tag motion tracking effect is realized.

The invention relates to the technical field of visual SLAM positioning and mapping, and discloses a visual map data processing method and device, computer equipment and a storage medium. Firstly, panoramic semantic segmentation is carried out on an original image, a panoramic segmented image is generated, the panoramic segmented image comprises semantic information of each pixel, and the semantic information comprises prior dynamic semantic information. And performing optical flow estimation processing on the original image to obtain an optical flow image. Then, based on the panoramic segmented image, the optical flow image and the original image, feature points of a dynamic area are removed in real time, and a static feature image with higher precision is obtained; and finally, under the condition of performing motion tracking based on the static feature image and determining that the static feature image is a key frame, generating a dense point cloud map endowed with semantic information based on the original image, the static feature image and the panoramic segmentation image, and removing a point cloud with prior dynamic semantic information from the dense point cloud map. And a more accurate static environment map is constructed to update the point cloud map.

Techniques and systems are provided for pose prediction. For instance, a process can include combining image features detected from an obtained image with estimated image features to generate combined features; generating temporally encoded features by temporally encoding the combined features; combining detected motion tracking information with estimated motion tracking information to generate combined motion tracking information; generating temporally encoded motion tracking information by temporally encoding the combined motion tracking information; generating spatially encoded multi-modal information by spatially encoding the temporally encoded features and the temporally encoded motion tracking information; and predicting a body pose by regressing the spatially encoded multi-modal information.

The invention aims to provide a cerebral apoplexy swallowing assessment and extubation decision-making system based on ultrasound and video stream fusion, and the system comprises an ultrasound image collection module which focuses on the dynamic movement of tongue muscles, throat muscles, tongue bones and throat lacuna; the video stream acquisition module is used for calculating facial expression, oral activity and throat form change characteristics by using a motion tracking algorithm; the analysis module is used for analyzing spatial characteristics of muscle movement; identifying time sequence characteristics of the swallowing action; the evaluation and decision module is used for generating a swallowing function evaluation report; and the user interface and report output module is used for outputting an automatically generated swallowing function evaluation report to a clinician. The swallowing function can be evaluated in real time, noninvasively and accurately through a multi-modal data fusion technology in combination with a deep learning algorithm, a more reliable swallowing function evaluation basis is provided for clinicians, and rehabilitation treatment and intervention of stroke patients are helped.

A method of motion tracking and a motion tracking device are provided. The method includes: obtaining a first command; in response to the first command, detecting a first height via an inertial measurement unit to determine a first boundary; capturing a first map via a camera to establish a first coverage of the first map and determining whether the first coverage is complete according to the first boundary; and in response to the first coverage being complete, performing motion tracking according to the first map.

The invention discloses a spanning frame path tracking control method and system based on variable universe fuzzy control, and the method comprises the steps: firstly analyzing the driving characteristics of a mobile umbrella-shaped spanning frame, building a chassis kinematics model, and constructing a path tracking deviation model with a motion tracking deviation as a state variable; then constructing a controller and a rule base, improving a spider bee optimization algorithm, optimizing a controller telescopic factor, finally inputting a driving error into the controller, adjusting the position of equipment, and feeding back a new error to form a closed loop so as to realize accurate path tracking; according to the method, a theoretical basis is laid for accurate control by constructing an accurate chassis and path tracking deviation model, then a fuzzy controller is combined with a fuzzy rule, a discourse domain is dynamically adjusted to adapt to error changes, meanwhile, a spider bee algorithm is improved to optimize a telescopic factor, and key parameters are accurately optimized by optimizing an initialization and search mechanism, so that the accuracy of a path tracking algorithm is improved. And finally, closed-loop control feedback is realized, so that the deviation is corrected in time, and the path tracking precision of the mobile umbrella-shaped crossing frame is improved.