124 results about "Dual reality" patented technology

The technology disclosed relates to a method of realistic rotation of a virtual object for an interaction between a control object in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a two e sub-component free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting rotation of the virtual object by the 3D solid control object model.

A locomotion platform device enables a user to perform a simulation of various motions including walking and running. The device comprises a locomotion platform having a concave upward facing surface. The platform and / or the user's footwear incorporate a mechanism to reduce friction between the user and the surface of the platform in order to allow the user's feet to move freely.

Systems and methods for generating an action in a virtual reality or augmented reality environment based on position or movement of a mobile device in the real world are disclosed. A particular embodiment includes: displaying an optical marker on a display device of a motion-tracking controller; receiving a set of reference data from the motion-tracking controller; receiving captured marker image data from an image capturing subsystem of an eyewear system; comparing reference marker image data with the captured marker image data, the reference marker image data corresponding to the optical marker; generating a transformation matrix using the reference marker image data and the captured marker image data, the transformation matrix corresponding to a position and orientation of the motion-tracking controller relative to the eyewear system; and generating an action in a virtual world, the action corresponding to the transformation matrix.

A combination of interacting virtual reality (VR) and augmented reality (AR) system is provided where the system automatically switches from VR to AR when the user selected viewpoint coincides, within tolerance, with the observable AR viewpoint. The invention discloses an apparatus adapted to provide easy access and automatic switching between AR and VR, and method thehrefor.

A system and method for defining an augmented reality character in a computer game having multiple players uses a portable cellular communications device having a camera. Tags are used comprising patterns which are scanned by the camera and transmitted to a game server. The pattern is translated by the server into an augmented reality item, being either a person or a character. The augmented reality item is transmitted to the camera and displayed to the gamer transposed over the object upon which the tag is placed.

Embodiments disclosed herein provide methods, systems, and computer readable storage media for facilitating enhanced visual communication between remote participants. In a particular embodiment, a method provides, during a conference session, receiving first video captured of a first participant remote to a physical meeting location. The method further provides determining a first position for the first participant in the physical meeting location and determining a view of an Augmented Reality (AR) head mounted display worn by a second participant at the physical meeting location. From the first video, the method provides generating AR video that makes the first participant appear to the second participant at the first position when viewed through the AR head mounted display. The method also includes transferring the AR video to the AR head mounted display for presentation to the second participant.

The invention discloses a virtual reality system which comprises a wearable virtual reality device. The device comprises a headset device, a motion capture device and an integrated backpack. The headset device comprises a headset displayer used for displaying virtual scenes. The motion capture device comprises a plurality of motion capture inductors arranged on multiple portions of the body of a user. The motion capture inductors are used for inducting motions of the multiple portions of the body of the user. The integrated backpack comprises a processor and at least one containing space. The processor is connected with the motion capture device and the headset displayer. The processor is used for receiving reality motion information obtained by the motion capture device, achieves the virtual reality effect on the basis of the reality motion information and preset virtual scenes and sends corresponding virtual reality images to the headset displayer. The containing space is used for containing the motion capture device. The virtual reality system is designed in the mode that a user can wear the virtual reality system, and the complete virtual reality experience can be achieved when the user wears the virtual reality system.

A method and system for coordinating placement of an augmented reality / virtual world object(s) into a scene relative to position and orientation. The object(s) can be connected to an anchor point having an absolute location relative to the marker via a connector (e.g., spring-like connector) in such a way that the behavior of the object responds to a physical force and a collision which exists in the augmented reality scene. The connection between the virtual object and location of the marker permits the object to exactly track the marker when there are no real world collisions between the markers. The virtual objects can be displaced so the objects do not pass through one another when the real world markers come into a close spatial proximity and the corresponding virtual objects begin to collide.

A method of measuring a user's range of motion, comprising: tracking user movement of at least one body portion using at least one sensor; correlating the tracked user movement to an avatar of the user in a virtual environment using at least one controller; displaying on an output device the summation of tracked user movement graphically in the virtual environment such that user movement with respect to the user is represented in the virtual environment as avatar movement with respect to the avatar, in the same relative relationship.

The invention discloses an intelligent operation auxiliary system based on virtual reality and augmented reality. The intelligent operation auxiliary system comprises a data preprocessing unit (1), a preoperative planning unit (2) and an intranperative auxiliary unit (3), and the data preprocessing unit rebuilds a three-dimensional focus model through an original CT / MRI image; the preoperative planning unit builds a virtual image studio through virtual reality equipment, loads the three-dimensional focus model for a user to go deep inside the lesion organ to make an operation scheme plan, and exports a three-dimensional planning model; the intranperative auxiliary unit calls the three-dimensional planning model through augmented reality equipment to obtain space characteristic points of the three-dimensional planning model, conducts registration and fusion on a real focus part, helps a doctor to recognize a dissection structure, displays an operation scheme decision and quantifies physiological data at the same time at the same time to execute an intranperative plan. The intelligent operation auxiliary system based on the virtual reality and the augmented reality solves the problems that the dissection structure is difficult to recognize and intranperative real-time navigation is lacking, and the success rate of a surgical operation is increased.

The invention provides an interaction handle used in interaction control of virtual reality and augmented reality. The interaction handle comprises: a handheld housing; a controller arranged in the handheld housing and used for controlling the interaction handle to work; one or more luminous units connected with the controller, arranged on the surface of the handheld housing and used for enabling an identification device to track and identify the position and action of the interaction handle; a plurality of control keys connected with the controller, arranged on the corresponding finger holding part of the handheld housing and used for operating the interaction handle to perform interaction control; and a connector connected with the handheld housing and wound around a hand of a user to fix the interaction handle to the palm of the user. The interaction handle and / or gestures can be utilized to perform interaction, and two interaction forms can be seamlessly switched, so that the fidelity and immersion of a game are improved and the user experience is enhanced.

The invention provides a virtual reality system implementation method and a virtual reality device. The method comprises the following steps of: generating a three-dimensional interaction scene, and generating a three-dimensional virtual assistant in the three-dimensional interaction scene; identifying acquired user input into computer identifiable data; matching the computer identifiable data, and returning matched response data; converting the response data into at least one of a voice signal, a tactile feedback vibration signal and a visual form signal; and outputting at least one of the voice signal, the tactile feedback vibration signal and the visual form signal in the image of the three-dimensional virtual assistant. By means of the method provided by the invention, the three-dimensional virtual assistant is arranged to acquire input of users, so that identification, matching and conversion are carried out; therefore, the three-dimensional virtual assistant can output an intelligent service, the vision, the hearing sense and the tactile sense of which accord with user requirements; humanized resonance is provided for users; and the user experience enjoyment and the user experience can be improved.

The invention discloses a lower limb rehabilitation training robot system based on virtual reality, which comprises a virtual interaction scene module, a physiological parameter acquisition module, a man-machine interaction module, a control module and a lower limb rehabilitation training robot, wherein the virtual interaction scene module simulates motion of a virtual person in a virtual scene and calculates an interaction force between the virtual person and a virtual environment; the man-machine interaction module displays and transmits physiological parameters of a patient, a motion state of the lower limb rehabilitation training robot and the acting forces of the patient in all directions to the control module; the control module generates and issues a control instruction; and the lower limb rehabilitation training robot is responsible for force feedback output under an active rehabilitation condition and traction of the patient for rehabilitation training under a passive rehabilitation training condition. According to the system, simpler virtual scene interaction is achieved by establishing a virtual person model; a real-time and friendly virtual scene interaction system with feedback of a visual sense, an auditory sense and a touch sense is provided for the rehabilitation training robot; and the patient is encouraged to actively perform rehabilitation training.

A method, apparatus and smart wearable device for fusing augmented reality and virtual reality are provided. The method for fusing augmented reality (AR) and virtual reality (VR), comprising acquiring real-world scene information collected by dual cameras mimicking human eyes in real time from an AR operation; based on virtual reality scene information from a VR operation and the acquired real-world scene information, generating a fused scene; and displaying the fused scene.

An apparatus for merging real and virtual images in which points in three dimensions of an actual scene are obtained and selected in a random fashion and in a number sufficient to track the movement of the three dimensional scene relative to an observer wearing the apparatus. Updating of selected points occurs responsive to movement of a video camera pair observing the actual scene. The position and orientation of the unit housing the video camera pair is utilized to properly merge a generated virtual image with the real image. Selection of points and orientation of the unit relative to a three dimensional real image are obtained in real time. Microprocessor-based apparatus is utilized to perform the method of the invention.

The invention provides a virtual reality interaction method, a virtual reality interaction device and a virtual reality system. The virtual reality interaction method includes providing at least one option region in a virtual reality scene; detecting the locations of users in real spaces, recording the locations of the users as initial locations and acquiring displacement between current locations and the initial locations when change of the locations of the users is detected; shifting virtual characters in the virtual reality scene on the basis of the displacement under the control in real time and activating functions of options corresponding to the option regions where the virtual characters are currently located when the virtual characters are shifted into the option regions. Each option region corresponds to the single option. The virtual reality interaction method, the virtual reality interaction device and the virtual reality system have the advantages that other external input equipment can be omitted, only the locations of the users need to be detected, the locations of the virtual characters in the virtual reality scene are controlled according to the locations of the users, accordingly, the functions of the options can be activated, the operational flexibility can be enhanced, and the operational accuracy can be improved.

A trampoline exercise system that is designed to show an avatar of a user, which is jumping on a trampoline. The exercise system includes a computer module, a trampoline configured to provide a platform for a user to perform exercises thereon, and a sensor module designed to sense movements of a user performed on the trampoline. The sensor module provides information that is received by the computer module that controls the display of a users' avatar on a video monitor in response to the users' motion on the trampoline. Several types of sensor may be used to sense the movement of the user, including body mounted sensors, trampoline mounted sensors, and remote viewing sensors.

The present invention discloses a virtual reality driving method and a virtual reality system based on arm motion capture. The method comprises: when a human body wears a motion capturing system, initializing a preset posture to obtain initial posture data; capturing real-time posture data of the human body, and according to the real-time posture data and the initial posture data, determining a first arm posture by using a transformation matrix method between links of the arm; and according to a preset built-in model, converting the first arm posture into a second arm posture of a preset virtual character, and driving a preset virtual character according to the second arm posture. By using the technical scheme of the present application, according to the obtained initial posture data andreal-time posture data, the arm posture data can be determined by using an arm motion link structure in the form of a transformation matrix between the links, and the accuracy of the arm motion recognition can be determined; and based on the built-in model, the arm posture data is converted to drive the motion of a 3D virtual character, so that the arm spatial position of the virtual character isconsistent with the spatial position of the real character.

The invention discloses a biological information feedback system based on virtual reality, which comprises an acquisition system S1 and a virtual reality feedback system S2; the acquisition system S1 comprises a plurality of scalp electrodes, an electroencephalogram (EEG) signal extraction module and an EEG signal processing module; and the virtual reality feedback system S2 comprises a management module, a database, a feedback training module, a display module, an off-line analysis module, a communication logic module and an EEG secondary processing module. The biological information feedback system of the invention accurately collects the biological electric signals, processes and extracts the pure EEG signals, processes signal characteristics, and compares with the database and analyzes to obtain an accuracy pressure level; an intervention system can be configured for different diseases to achieve a targeted intervention system; real-time operation realizes a real-time feedback system, so that the current state of a subject can be visually observed, thus achieving self-training and adjustment; and good virtual reality system and the new design of interactive scenes and interactive means can enhance the sense of interaction and immersion and operability.

The invention discloses a motion capture glove for a virtual reality system and the virtual reality system. The motion capture glove comprises a three-finger fingerstall, a glove body, a wrist part and an optical mark; the three-finger fingerstall comprises a first inertial sensor, a second inertial sensor and a third inertial sensor which are respectively arranged at the second knuckles of a first fingerstall, a second fingerstall and a third fingerstall for the virtual reality system to determine the motion information of a first finger, a second finger and a third finger which wear the motion capture glove; the glove body comprises a fourth inertial sensor which is arranged at the hand back of the glove body, and is used for sending the motion information of the fourth inertial sensor for the virtual reality system to determine the motion information of a palm which wears the glove body; the wrist part comprises a fifth inertial sensor which is arranged on the back side of a wrist part, and is used for sending the motion information of the fifth inertial sensor for the virtual reality system to determine the motion information of the wrist which wears the wrist part; the optical mark is arranged on the back side of the wrist part for the virtual reality system to track to acquire an absolute position of the wrist which wears the wrist part.

The invention discloses a simulated gunnery method and system based on virtual reality. The method comprises the following steps of collecting tension data during shooting and posture data of a bow; utilizing the tension data for determining the initial velocity of a virtual arrow, and calculating the angle of emergence of the virtual arrow according to the gesture data; calculating the motion trajectory of the virtual arrow according to the initial velocity of the angle of emergence of the virtual arrow; displaying the motion trajectory of the virtual arrow in a virtual scene. The virtual reality technology is introduced, a user can carry out the shooting activity in the virtual scene, and the interactive experience similar to the real shooting activity is obtained.

A system, method, and apparatus for virtual reality and augmented reality training comprises a headset for displaying at least one virtual object, at least one processor, and a storage device communicatively coupled to the at least one processor, the storage device storing instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising: providing a virtual environment, providing one or more demonstration steps, providing one or more practice steps, collecting the user's real world physical movements, collecting the user's virtual decisions, evaluating the user's virtual decisions and physical movements to determine if the virtual decisions and the physical movements constitute safe behavior and correcting an incorrect physical movement and an incorrect virtual decision.

The invention provides a body data acquisition and feedback device and method for a virtual reality environment. The device comprises a body posture data acquisition module and a force feedback data output module, wherein the body posture data acquisition module comprises an inertial sensor, a UWB ultra-wide-band ranging submodule and a wireless network submodule which are used for acquiring body posture data information and acquisition point relative position information in real time, and the information is transmitted to a central controller in a wireless mode. The force feedback data output module comprises an electrical pulse feedback device used for wirelessly receiving force feedback signals sent by the central controller, and acting on corresponding body parts by receiving and recognizing feedback data transmitted by a core.

The embodiment of the invention provides an exercise training method and device based on virtual reality, relates to the field of intelligent hardware, and solves such a problem as poor training effect caused by the fact that motion analysis and guidance of existing exercise training lack timeliness. The method includes the following steps: obtaining current motion data of an user at the time of movement; based on the current motion data, displaying current virtual action; comparing the current virtual action with an standard action in a virtual training scene; determining whether the difference between the current virtual action and the standard action is within a preset error tolerance or not. The exercise training method and device are mainly applied in training activities of physical exercise.

The invention provides a pair of gloves used in interaction control of virtual reality and augmented reality. Each of the pair of gloves used in the interaction control of the virtual reality and the augmented reality comprises: a glove body; and a plurality of luminous units embedded on the glove body and used for an identification device to track and position the glove body according to the luminous units. According to the pair of gloves, accurate identification and tracking of hand actions of a user are realized, the fidelity and immersion of a game are ensured, and the user experience is improved.

The invention discloses a virtual reality realizing system. Wearable virtual reality equipment comprises headset equipment and action capturing equipment, wherein the headset equipment comprises a headset display device, and the headset display device is used for displaying a virtual scene; the action capturing equipment comprises a plurality of action capturing sensors, and the action capturing sensors are optical action capturing devices. The system also comprises a processor, wherein the processor is respectively connected with the action capturing equipment and the headset display device, and is connected with a peripheral panorama camera; the processor is used for splicing footages of the panorama camera, and generating a preset virtual scene; according to reality action information and the preset virtual scene, the virtual reality effect is realized, and a corresponding virtual reality image is sent to the headset display device. The virtual reality realizing system has the advantage that the panorama framing is realized in a virtual reality technique.

An improved virtual reality system comprises a chair 110 integrated with a pedestal 120, which contains a motion platform 150 and base 160. The chair 110 can be rotated continuously in the yaw axis by a stepper motor 230 and substantially in the pitch axis by an additional stepper motor 240 in coordination with the content of the VR display as directed by a chair controller located on the motion platform 150.

The invention discloses a motion capturing glove for a virtual reality system and the virtual reality system. The motion capturing glove comprises three finger stalls, a glove body, a wrist part and an upper arm part, wherein the three finger stalls comprise a first inertial sensor, a second inertial sensor and a third inertial sensor which are arranged at second knuckles of a first finger stall, a second finger stall and a third finger stall respectively, so as to enable the virtual reality system to confirm movement information of a first finger, a second finger and a third finger wearing the motion capturing glove; the glove body comprises a fourth inertial sensor arranged at the back of the glove body, and is used for transmitting the movement information of the fourth inertial sensor so as to enable the virtual reality system to confirm the movement information of a palm wearing the glove body; the wrist part comprises a fifth inertial sensor arranged on a back side of the wrist part and is used for transmitting movement information of the fifth inertial sensor so as to enable the virtual reality system to confirm the movement information of a wrist wearing the wrist part; the upper arm part comprises a sixth inertial sensor so as to enable the virtual reality system to confirm the movement information of an upper arm wearing the upper arm part.