828 results about "Somatosensory system" patented technology

Aspects of the invention relate to compositions and methods for using recombinant cells to sense and destroy specific pathogens.

A method of providing user somatosensory experience for “thrill seeking jumping like activities” (for purposes such as but not limited to training, game, or entertainment) involves:

Providing means for changing elevation of user that rapid enough for user to feel the difference of gravity feeling or “G force” with feelings of user under stationary situation, wherein the facing direction relative to the direction of movement and/or pose of the user can be changed, and the speed of elevation change provide by the means can be controlled/adjusted;

While the user using the elevation changing means, using a computer-implemented virtual reality system to present to the user a virtual reality environment. The view point and/or direction changes in the virtual reality environment are consistent with the position changes and/or self motion of the user in the elevation changing means;

So that the user experiences the virtual reality environment under a “variable gravity” condition or “G-Force” provided by the elevation changing means in a synchronized way, such “variable gravity” condition enhancing experience of the virtual reality environment. It is also possible for users to interact with the system by means such as game controller or gesture and etc, so that the output of the elevation means could be affected/changed by user input.

The invention provides a contact network three-dimensional reconstruction method based on SIFT and LBP point cloud registration. The method comprises the first step of obtaining initial three-dimensional point cloud data of the environment where parts of a contact network to be reconstructed are located through motion-sensing peripheral Kinect for Windows, and conducting denoising, simplifying, partitioning clustering, fusing and other preprocessing operations on the initial three-dimensional point cloud data to obtain single-view-angle point cloud data of the parts of the contact network to be reconstructed, the second step of extracting key points through an SIFT algorithm, constructing description vectors of the key points by means of LBP features of uniform patterns and determining the corresponding relations between the key points in different point clouds according to the distances between the vectors, the third step of completing point cloud registration through a rough registration method and an ICP fine registration method and obtaining the complete three-dimensional point cloud data of the parts of the contact network to be reconstructed, and the fourth step of completing three-dimensional reconstruction through the Poisson surface reconstruction method and obtaining a three-dimensional model. According to the method, the key factor is point cloud registration which is the key step influencing the three-dimensional reconstruction speed; the description vectors of the key points are constructed by means of the LBP features of the uniform patterns, so that vector dimensions are reduced, the matching speed of the corresponding relations is increased, registration is accelerated, and the three-dimensional reconstruction speed is increased.

The invention relates to a three dimensional (3D) virtual fitting method based on somatosensory technology. The 3D virtual fitting method based on the somatosensory technology is characterized by including the steps: step one, setting up a hardware system; step two, tracking human skeleton; step three, reconstructing three dimensions; step four, conducting real-time measurement on three dimensional sign information of a human three-dimensional model, utilizing a measured characteristic size to adjust the size of corresponding place of a garment model and enabling the garment model to fit in with a human body figure and to be superimposed on the human three-dimensional model; steps five, fitting in a scene. Due to the novel information technology of somatosensory location, strengthening reality and image recognition, the 3D virtual fitting method based on somatosensory technology shoots and manufactures real garments into high definition images which fit in with a certain specification, utilizes a depth camera sensor to collect image information of human skeleton and depth, perfectly mixes the garments and real images and produces display effects of different garments in different scenes in a mode of strengthening reality.

The invention relates to a human body skeleton-based action recognition method. The method is characterized by comprising the following basic steps that: step 1, a continuous skeleton data frame sequence of a person who is executing target actions is obtained from a somatosensory device; step 2, main joint point data which can characterize the actions are screened out from the skeleton data; step 3, action feature values are extracted from the main joint point data and are calculated, and a feature vector sequence of the actions is constructed; step 4, the feature vectors are preprocessed; step 4, the feature vector sequence of an action sample set is saved as an action sample template library; step 6, actions are acquired in real time, the distance value of the feature vector sequence of the actions and the feature vector sequence of all action samples in the template library is calculated by using a dynamic time warping algorithm; and step 7, the actions are classified and recognized. The method of the invention has the advantages of high real-time performance, high robustness, high accuracy and simple and reliable implementation, and is suitable for a real-time action recognition system.

The invention discloses a traction substation watchkeeper virtual immersion type training simulation system and method. Virtual three-dimensional scenes and related animations of a traction substation are established with three-dimensional modeling and animation software, the visual and auditory senses of training objects can be effectively enhanced, and the understanding of the training objects on study content can be intensified; the three training patterns of free exercising, situational teaching and simulation checking, and specific task training content are established with a three-dimensional engine and a database, and the training content is high in pertinence and capable of being freely modified; the scene perceptual feelings are further enhanced through virtual reality immersion type helmets and somatosensory interaction equipment. According to the method, the three-dimensional scene of the whole traction substation can be vividly and visually established through three-dimensional visualization simulation, the daily operation of patrolling, switching, overhauling and the like is simulated through service training content based on the three-dimensional scene, safe operation, a high immersion degree, high visualizability and a short training period are achieved in the training process, and good application prospects are achieved.

The invention discloses an upper limb movement rehabilitation training system and method based on a Kinect sensor. The system comprises the Kinect sensor and a computer carrying an upper limb movement rehabilitation training module. The Kinect sensor is connected with the computer through a data line and arranged above a computer display screen. The upper limb movement rehabilitation training module comprises a single-joint rehabilitation training module, a comprehensive rehabilitation training module, a grading module and a correcting module and can conduct upper limb single-joint training and comprehensive training of shoulders, elbows and wrist joints. Patients do not need to wear or operate any interactive devices and only need to face the Kinect sensor and finish rehabilitation training movement according to the words or voice prompt on the display screen. The Kinect sensor conducts position capture on the upper limb joints, records and feeds back space position information of the upper limb joints of the patients in real time, guides the patients to finish rehabilitation training through motion sensing interaction and corrects non-standard training movement. The training method is simple, easy to master, good in enjoyment and low in use device cost.

The invention discloses a method for intelligent control over operation of an air conditioner through human physiological parameters. The method is characterized in that a control system is composed of wearable equipment, an indoor control system and an outdoor control system; due to arrangement of an acceleration sensor, a temperature sensor, a heart rate sensor, an optical line sensor, a GPS module, an audio module, a weather forecast reception module and others arranged in the wearable equipment and human physiological parameters detected, the most comfortable sendible temperature is calculated. The operation of the air conditioner is controlled by combination of most comfortable sendible temperature, heart rate and exercise amount.

The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP/IP (transmission control protocol/Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.

The invention discloses a somatosensory-based natural interaction method for a virtual mine. The method comprises the steps of applying a Kinect to acquire gesture signals, depth information and bone point information of a user; carrying out smoothing filtering on images, depth information and bone information of the gesture signals; dividing gesture images by using a depth histogram, applying an eight neighborhood outline tracking algorithm to find out a gesture outline, and identifying static gestures; planning feature matching identification of dynamic gestures by improving dynamic time according to the bone information; triggering corresponding Win32 instruction information by using a gesture identification result, and transmitting the information to a virtual reality engine, respectively mapping the instruction information to the primary keyboard mouse operation of a virtual mining natural interaction system, so as to realize the somatosensory interaction control of the virtual mine. According to the method provided by the invention, the natural efficiency of man-machine interaction can be improved, and the immersion and natural infection represented by the virtual mine can be improved, and the application of the virtual reality and a somatosensory interaction technology can be effectively popularized in coal mines and other fields.

The invention relates to a motion-sensing technology based kindergarten intelligent monitoring method, which comprises the steps of installing 3D motion-sensing equipment in a kindergarten, capturing 3D human body skeleton images of children in real time, extracting key joint feature vectors, inputting the feature vectors into a motion classifier so as to carry out motion classification, and finding out motions with the highest matching degree, wherein motion classification is trained in advance through a machine learning method. The method provided by the invention can realize detection, analysis and tracking for human body motion postures and figure motion trails through a three-dimensional visual perception technology, and motions of the children are captured dynamically in real time, so that dangerous behaviors such as fighting, tumbling and boundary crossing can be predicted, and a warning is given out in advance so as to reduce occurrence of kindergarten accidents.

The invention relates to a music sleeping apparatus and a method for controlling sleeping to prevent sudden death in dream; the music sleeping apparatus is an apparatus enabling people to sleep fast via heart rate feedback control as well as brainwave feedback control. The method includes sending a signal to intentionally awake people in order to prevent sudden death in dream, while detecting that heart rate is more than 105 times per minute or less than 48 times per minute in sleeping. The apparatus comprises a control module, an externally-connected detection module, a music playing module, a music listening module, a colored light module, a current stimulating module, a high-voltage field effect module and a music somatosensory vibrator sub-module. The apparatus has selectable functions on controlling sleeping state, preventing sudden death in dream, and controlling sleeping state and synchronously preventing sudden death in dream. Sleeping state can be controlled through heart rate feedback control or brainwave feedback control singly. The sleeping state is controlled to induce brainwave used by a human brain to be generated by a brainwave generator, or sleeping state is controlled using randomly-recorded user brainwaves of multiple stages in sleeping.

The invention discloses a method for enhancing a depth image of a Microsoft somatosensory device. The method comprises the following steps of: carrying out an edge detection on a color image and a depth image respectively, and obtaining a region at which an error pixel is located by using a region growing method in a mode of inputting two edge images; moving an error pixel depth value; constructing a smooth region around an invalid pixel by using the region growing method; estimating an invalid pixel depth value in the smooth region by using a bilateral filtering method; and estimating remaining invalid pixel depth values by using the bilateral filtering method so as to obtain the enhanced depth image. The invention points out that the problem that edges of the depth image and the corresponding color image are not matched is caused by error pixels for the first time, then provides a detection method for the error pixels, and can effectively fill cavity of a Kinect depth image; the problem that the edges of depth images are not matched is solved well, and quality of the Kinect depth image is improved greatly.

The invention relates to an alarming device, in particular to a drowning alarming device and the method of the drowning alarming device, and designs a drowning alarming device based on body feeling and the method of the drowning alarming device in detail. The drowning alarming device based on body feeling comprises a power supply module providing power for the drowning alarming device, an acceleration sensor module, a water pressure sensor, a microprocessor and an alarming unit, wherein the acceleration sensor module is used for detecting the acceleration of human motion and judging the motion range of human body, the water pressure sensor is used for detecting the pressure of the human body in water and judging the depth of the human body in the water, the microprocessor is used for reading and processing the data detected by the acceleration sensor module and the water pressure sensor and judging whether drowning exists, and the alarming unit is used for sending alarms according to the judging result of the microprocessor. The method of the drowning alarming device based on body feeling comprises the following steps that whether the depth of human body in water larger than 50 centimeters is detected; the accelerated speeds in three directions of the human body in the water are detected and processed through a three-axis acceleration sensor, and whether a user is in a drowning state is judged; alarming information is given out through an alarming unit.

The invention provides a method and a system for non-contact sleep monitoring. The method comprises the following steps: using an infrared monitoring camera to acquire video images of a head region and abdomen and thorax regions of a human body, and using a somatosensory device to acquire attitude information of the human body; acquiring sleep information of the human body; and comparing the sleep information of the human body with preset standard sleep information, and analyzing health degree of human body sleep quality. The method is based on an image processing technology, and acquires sleep signals of a human body by a non-contact method. The method maintains natural sleep state of a user to the greatest extent, and sleep state information with physiological significance is extracted through a video image processing technology. The system is low in device cost, and provides convenience for daily use of a family.

The invention discloses a man-machine interaction system and interaction method based on a virtual reality technique. The man-machine interaction system comprises a virtual reality head display device, a controller and a somatosensory identification device. When a user needs to perform interaction with a virtual world, the somatosensory identification device captures somatosensory data information of the user and output the somatosensory data information to the controller, the controller converts the obtained somatosensory data information into user exercise data processing signals, outputs the signals to the virtual reality head display device and controls a motion model in a virtual scene displayed by the virtual reality head display device to move synchronously so as to complete man-machine interaction. Therefore, man-machine interaction between somatosensory actions of the user and displayed contents of the virtual reality head display device is achieved, and accordingly the truth of immersive experience is improved greatly.

The invention discloses a multi-user immersion type full interaction virtual reality system for project training; the system takes each participant as an unit, and endows each participant as specific character in the virtual environment; the participant wears a head-mounted display, and stands on an all-round slide platform to move; a body sensing device can obtain motion information of the participant, and drives motions and visual angles of the corresponding character in the virtual environment; a hand-held input device can realize interactions with devices and other characters in a virtual scene; each unit is connected with a host through the network, thus realizing communication between training units; a host display can monitor the characters and works in the virtual system, and can give evaluations and guidance. The novel system can enhance human-machine interaction experience, immersion feelings and participating feelings in the project training system, thus effectively solving the occupation and personnel cooperation problems in the virtual reality system.

The invention discloses a Kinect-based badminton motion guidance system, which comprises a pre-processing module, a similarity measurement module, and a motion evaluation and display module. The pre-processing module adopts Microsoft's kinect motion sensing equipment, tracks user motions through a kinectSDK, and obtains skeleton features of a human body; the similarity measurement module matches the obtained skeleton features of the human body with skeleton features of standard badminton actions and carries out similarity measurement; the motion evaluation and display module carries out distance comparison on a motion time period (during which user motion poses are matched with standard motion poses) obtained by the similarity measurement module, so as to obtain distance differences between joint points at corresponding positions of user motions and a standard notion sequence, and displays results on a screen. According to the Kinect-based badminton motion guidance system, the user does not need to wear clothes provided with sensors, and can learn badminton standard motions by following videos in a self-aid manner under the condition without a coach, thereby improving accuracy of badminton racket swinging motions of the user.

The invention aims to provide a Kinect-based motion sensing-control method for manipulator comprising the following steps of obtaining the three-diemnsional coordinates of five joints of the right upper limb of a human body by a Kinect sensor; smoothing the obtained five joint coordinate data of the right upper limb by a double-exponential filtering algorithm; constructing vectors in the three-dimensional space coordinate system of the Kinect by utilizing the smoothed 5 joint coordinates of right upper limb, and obtaining the angles of the right upper limb by calculating the vector included angles, wherein the angles of the right upper limb comprise a right shoulder joint angle, a right elbow joint angle and a right wrist joint angle; fusing the angle information to form a data package, adding with a data package head and a checksum, and sending to a robot by a wireless serial port to perform manipulator control. The Kinect-based motion sensing-control method for the manipulator can finish the flexible and accurate control on the manipulator and the moving robot by accurate identification on the human body actions, thus enabling the interaction between people and the robot to be more friendly and improving the intelligence of the robot.

An exercise/therapy device has a base, a foot receptacle rotatably mounted to the base, and one or more rollers mounted to the base and aligned with the foot receptacle. Somatosensory proprioceptive neuromuscular re-education (SPNRED) material is provided on the foot receptacle and/or rollers to stimulate the user's foot during exercise. The exercise device allows for Active Isolated Stretching by enabling multiple exercises and stimulation materials that can be quickly interchanged.

The invention relates to the related technical field of behavior analysis simulation, and discloses a method of pedestrian monitoring and behavior recognition. The method comprises the following steps: S1, video acquisition is carried out on a somatosensory video device, and a corresponding depth image data stream and a color image data stream are acquired; S2, a system spatial coordinate-ground coordinate conversion matrix is calculated, ground projection is carried out on the depth information, a single human body is effectively segmented in the case of occlusion entering of multiple bodies, and non-human body targets are eliminated according to the ground projection; S3, three-dimensional depth information of a target body is acquired, and three-dimensional coordinates of 15 joints of the human body are positioned according to the depth information; S4, a human body three-dimensional model is built; S5, motion parameters of the human body are acquired; and S6, behavior features of the human body are acquired, and a processing result is fed back. The method and the system of the invention have the beneficial effects that the mounting is convenient and flexible; the pedestrian in-out conditions in a specified area is monitored and detected in a real time mode; and tracking and behavior recognition is carried out on a pedestrian entering.

An image display device capable of reducing the burden on a passenger and reducing the occurrence of motion sickness, by giving the passenger, through a visual sense, perception (visually induced self-motion perception) of his/her own body moving while viewing an image of a TV and the like in a vehicle, and thus by matching visual information to vestibular information obtained from the motion of the vehicle, particularly to a sense of rotation and somatosensory information which are detected by his/her semicircular canals, is provided. The image display device includes: a behavior detection section (101) for detecting a behavior of a vehicle; a background image generation section (102) for generating a background image based on the behavior detected by the behavior detection section (101); an image generation section (103) for generating an image; an image transformation section (104) for, based on the behavior detected by the behavior detection section (101), transforming the image generated by the image generation section (103); a composition section (105) for making a composite image of the background image generated by the background image generation section (102) and the image transformed by the image transformation section (104); and a display section (106) for displaying the composite image made by the composition section (105).