1359results about How to "Improve immersion" patented technology

Embodiments of the invention provide a unique interactive game that includes multiple dynamic layers in which a participant may complete a variety of challenges and / or tasks. For example, the participant may obtain a toy “wand” from a retail phase that is usable in an interactive entertainment phase. The interactive entertainment phase may include multiple interrelated layers such that progress in one or more layers may affect the participant's experience in one or more other layers. The participant may also receive training on how to use the wand and / or complete one or more special effects, adventures and / or quests. During or following the interactive entertainment phase, the participant may use accumulated points and / or powers to redeem prizes and / or compete against other participants, such as in a duel.

The invention provides a unique interactive play experience carried out utilizing a toy “wand” and / or other actuation / tracking device. In one embodiment the wand incorporates a wireless transmitter and motion-sensitive circuitry adapted to actuate the transmitter in response to particular learned wand motions. The wand allows play participants to electronically and “magically” interact with their surrounding play environment simply by pointing, touching and / or using their wands in a particular manner to achieve desired goals or produce desired effects. Various wireless receivers or actuators are distributed throughout the play facility to support such wireless interaction and to facilitate full immersion in a fantasy experience in which participants can enjoy the realistic illusion of practicing, performing and mastering “real” magic.

The invention provides a unique interactive play experience carried out utilizing a toy “wand” and / or other actuation / tracking device. In one embodiment the wand incorporates a wireless transmitter and motion-sensitive circuitry adapted to actuate the transmitter in response to particular learned wand motions. The wand allows play participants to electronically and “magically” interact with their surrounding play environment simply by pointing, touching and / or using their wands in a particular manner to achieve desired goals or produce desired effects. Various wireless receivers or actuators are distributed throughout the play facility to support such wireless interaction and to facilitate full immersion in a fantasy experience in which participants can enjoy the realistic illusion of practicing, performing and mastering “real” magic.

Embodiments of the invention provide a unique interactive game that includes multiple dynamic layers in which a participant may complete a variety of challenges and / or tasks. For example, the participant may obtain a toy “wand” from a retail phase that is usable in an interactive entertainment phase. The interactive entertainment phase may include multiple interrelated layers such that progress in one or more layers may affect the participant's experience in one or more other layers. The participant may also receive training on how to use the wand and / or complete one or more special effects, adventures and / or quests. During or following the interactive entertainment phase, the participant may use accumulated points and / or powers to redeem prizes and / or compete against other participants, such as in a duel.

A locomotion platform device enables a user to perform a simulation of various motions including walking and running. The device comprises a locomotion platform having a concave upward facing surface. The platform and / or the user's footwear incorporate a mechanism to reduce friction between the user and the surface of the platform in order to allow the user's feet to move freely.

A virtual reality display apparatus and display method thereof are provided. The display method includes displaying a virtual reality image; acquiring object information regarding a real-world object based on a binocular view of the user; and displaying the acquired object information together with the virtual reality image.

The invention provides a unique interactive play experience carried out utilizing a toy “wand” and / or other actuation / tracking device. In one embodiment the wand incorporates a wireless transmitter and motion-sensitive circuitry adapted to actuate the transmitter in response to particular learned wand motions. The wand allows play participants to electronically and “magically” interact with their surrounding play environment simply by pointing, touching and / or using their wands in a particular manner to achieve desired goals or produce desired effects. Various wireless receivers or actuators are distributed throughout the play facility to support such wireless interaction and to facilitate full immersion in a fantasy experience in which participants can enjoy the realistic illusion of practicing, performing and mastering “real” magic.

A method and apparatus for providing content experience service are disclosed. The apparatus includes a camera device tracking unit, a user behavior tracking unit, a real image acquisition unit, a motion information processing unit, a virtual space control unit, and a virtual multi-image generation unit. The camera device tracking unit collects camera motion information. The user behavior tracking unit collects user motion information. The real image acquisition unit photographs a space including the user, and separates a real image into a foreground and a background using a background key table. The motion information processing unit corrects the camera motion information and the user motion information. The virtual space control unit generates virtual space control information and virtual space information. The virtual multi-image generation unit generates a virtual multi-image, and provides the content experience service based on the generated virtual multi-image.

A system and method for incorporating biofeedback training into each user's interaction with a multi-user virtual environment, such as a multi-user videogame or a multi-user computer-simulated task, and for enhancing each user's sense of immersion in the multi-user virtual environment, by using measured values of physiological functions received as real-time outputs from at least one biosensory device operatively connected to each user while each user is interacting with the multi-user virtual environment to influence a score of each user's performance, such that each user demonstrating relatively superior physiological self-regulatory skill is rewarded and each user demonstrating relatively inferior physiological self-regulatory skill is penalized.

Systems and methods for detection of the head and arms of a user to interact with an immersive virtual environment are disclosed. In some embodiments, a method comprises generating a virtual representation of a non-virtual environment, determining a position of a user relative to the display using an overhead sensor when the user is within a predetermined proximity to a display, determining a position of a user's head relative to the display using the overhead sensor, and displaying the virtual representation on the display in a spatial relationship with the non-virtual environment based on the position of the user's head relative to the display.

The invention discloses a ground station of a universalized configurable unmanned aerial vehicle, belonging to the technical field of unmanned aerial vehicle control. The ground station comprises a task planning module, a HOTAS (Hands on the Throttle and Stick) and pedal manipulation data acquisition module, a voice identifying and alarming module, an electronic flying information module and a multi-point touch module which are deployed on a computer A, and a flying information communication module, a training communication module, an aircraft adapting module, a databank module, a voice and video acquisition module and a 3D (Three-dimensional) view display module which are deployed on a computer B. On the basis that the psychological and physiological characteristics of a unmanned aerial vehicle manipulator are considered, the comprehensive problems of flying control and task control, and the problems of three-dimensional information sensation and fatigue caused by long-time operation are solved well; the universalization of the ground station of the unmanned aerial vehicle is realized; and the repeated construction is reduced.

The invention discloses a medical simulation training system and method. The system comprises an object model building module, a model database, a sensor tracking module, a data processing module, an image generation module and a display module; the object model building module acquires the three-dimensional model data of a specific part of a human body and builds a corresponding three-dimensional virtual model object based on the acquired three-dimensional model data; the model database stores the three-dimensional virtual model object data; the sensor tracking module acquires a user' operation data of a three-dimensional model; the data processing module processes the acquired data to obtain the shape data of the three-dimensional model and the user' operation data of the three-dimensional model and outputs the shape data and the user' operation data; the image genera module generates a three-dimensional virtual image including simulation operation result information according to the shape data of the three-dimensional model and the user's operation data of the three-dimensional model; and the display module displays and outputs the three-dimensional virtual image for the user to view a simulation operation result. With the system and method provided by the embodiments of the present invention adopted, a strong sense of immersion can be realized, a real medical scene can be simulated to the greatest extent, the costs of clinical teaching and training about surgeries, intravenous injection and the like can be reduced.

The invention relates to a somatosensory interactive broadcasting guide system and method based on free viewpoints. The system comprises a server side, a video transmission network and a client side, wherein, the server side comprises a multi-camera system, a video processing server and a streaming media server which are used for completing multi-channel video capture, panoramic video synthesis, H.264 encoding and RTSP (real time streaming protocol) streaming media service; the video transmission network is a local area network (LAN) or wide area network (WAN) based on a TCP / IP (transmission control protocol / Internet protocol); and the client side comprises a free viewpoint playing terminal and a somatosensory sensor, wherein, the free viewpoint playing terminal comprises functional modules which are used for completing video streaming media receiving and decoding, gesture recognition based on a somatosensory controller, free viewpoint generation and other tasks. The somatosensory interactive broadcasting guide system and method have the beneficial effects that by combining multi-channel video into panoramic video, software and hardware investment and technical cost can be saved by directly utilizing the currently mature video coding and streaming media transmission technology, and meanwhile panoramic seamless roaming at 360 degrees and free viewpoint switchover can be really realized.

Systems and methods for interaction with a virtual environment are disclosed. In some embodiments, a method comprises generating a virtual representation of a user's non-virtual environment, determining a viewpoint of a user in a non-virtual environment relative to a display, and displaying, with the display, the virtual representation in a spatial relationship with the user's non-virtual environment based on the viewpoint of the user.

The invention relates to a true 3D (three dimension) modeling system and method based on video perspective type augmented reality, namely a technology organically combining a video perspective type augmented reality technology and computer 3D modeling for the first time. With the rapid development of a multi-media technology, the true 3D design method becomes an inescapable trend, and a new revolution is bound to occur in the fields of computer auxiliary modeling and design platform development. In fact, a fully novel design development concept is proposed in the invention. A work area of a designer is expanded from a 2D plane to a true 3D space zone. The limitation that 3D modeling can only be carried out in the 2D plane previously is relieved, the design efficiency is increased, and the design flow is simplified. Due to the application of the augmented reality technology in human-computer interaction and feedback display, a user can be deep immersed in design development and fully enjoy unrestrained and vigorous creating pleasure.

The invention provides a device and method integrating gesture recognition and ultrasonic tactile feedback. The device integrates a functional unit comprising a camera, an illumination unit and an ultrasonic spray head assembly inside gloves, feeds back the hand operation in real time, achieves accurate identification and tracing to the hand actions of a user and converts tactile information fed back into forces or force moments directly acting the hands of the user, so that an operator can produce a real touch feeling in a virtual environment, and meanwhile touch feeling at multiple angle and strengths can be also simulated, the gesture recognition speed and accuracy are improved, and the fidelity and immersion degree of virtual reality experience are increased. The invention also relates to application of the device integrating gesture recognition and ultrasonic tactile feedback in virtual reality, augmented reality and mixed reality.

The invention discloses a calculation method for force feedback in a virtual system, which comprises the following steps: step 1: a virtual environment comprising a virtual space, a virtual object and a virtual tool is established, attributes of the virtual tool are set, and a point set model which includes a plurality of mass points and surrounds the virtual tool is constructed; step 2: the virtual tool and a force feedback device are bound, the motion states of the virtual tool and the virtual object in the virtual space are tracked, whether the virtual tool and the virtual object collide or not is judged, if yes, step 3 is implemented; the step 3: the line speeds and the motion speeds before and after the collision of all the collision mass points of the virtual tool during the collision are respectively calculated, and the received impact during the collision process is also calculated; step 4: the resultant forces and the resultant moments of forces of all the collision mass points of the virtual tool are calculated and sent to the force feedback device. The calculation method takes full account of the self-rotation features of a virtual surgical instrument and can be applied in a surface model or a body model adopted in the virtual surgery.

An adapter device is provided to be disposed on the wearer's head. A mobile phone or other mobile graphical device can be inserted in the front of the device so this is opposite the user's eyes at a short distance. The device also incorporates lenses and adjustment mechanisms of the lenses that allow proper display of the graphic display device that is inserted in the adapter. Thus the device is designed to achieve stereoscopic 3D vision, configuring the adapter assembly and the device graphic as a device that allows multiplexing (two or more information channels on a single means of transmission) for position (side-by-side) in a mobile phone or other device with graphic screen TV, merging both visual content and receiving a three-dimensional image.

Disclosed herein is a method of generating multi-projection images. The method of generating multi-projection images includes performing, by a wide view angle filming device capable of implementing an angle of view of 360°, a filming operation and specifying a main image region from among all the image regions filmed by the wide view angle filming device in a direction of 360°.

The invention relates to a virtual maintenance distribution interactive simulation support platform of large equipment and a collaborative maintenance method. Combined hierarchical structure and modular design are adopted, a general service program is provided for various types of simulation application by a bottom-layer standardized communication protocol to realize data communication and interaction control among different software and hardware function modules; the virtual maintenance distribution interactive simulation support platform is composed of a simulation operation management module, a fault maintenance simulation module, a maintenance operation module and a basic function module for visual scene simulation; the platform captures the operation input, the body gesture and the hand space action data information of each training person by standard peripheral equipment and VR (Virtual Reality) interactive equipment; different collaborative maintenance modes are set, and various three-dimensional solid models in the virtual maintenance environment are driven; and collaborative interactive simulation and state information are updated in real time to realize the operation cooperation and the motor coordination in the collaborative maintenance process. The virtual maintenance distribution interactive simulation support platform has the advantages of good popularity, expansibility, instantaneity and illusion of immersion, and can support the simulation training of collaborative maintenance tasks of multiple maintenance personnel on different stations of large equipment.

The invention discloses a welding operation training simulation method and system based on augmented reality. The welding operation training simulation method includes the first step of catching a space motion trail of an AR welding gun in a monocular vision locating method, the second step of displaying the space motion trail of the AR welding gun on a display screen, the third step of establishing temperature fields and simulated weld joints of weldments in a finite difference method and displaying the established weld joints on the display screen, and the fourth step of displaying virtual images on an augmented reality displayer with a vision stereo display function, wherein the virtual images at least comprise the space motion trail of the AR welding gun and the simulated weld joints.

A VR house viewing system provided by the present invention includes a system front-end cloud network and a network internal system; the network internal system includes a VR terminal server, a VR personal device and a user motion capture device, wherein the VR terminal server, VR personal device, motion capture The devices are all interconnected through the network; the VR terminal server communicates with the front-end cloud network, obtains VR content data through a broadband network or broadcast channel, and uploads feedback information or interactive data to the front-end cloud network; the front-end cloud network includes Join module, automatic decoration module, virtual reality scene generation module, background management module. The VR viewing system enhances the fidelity and immersion of the virtual system, provides users with a more realistic virtual reality, improves user experience, and meets the needs of home entertainment.

The invention discloses a virtual reality system and a scene presentation method thereof. The system comprises a visual angle determination device for determining a visual angle of a user, a graphics processor for rendering a first virtual scene image which is to be presented to the user and corresponds to a determined first visual angle in response to the determined first visual angle, and performing projection transformation on the first virtual scene image in response to a determined second visual angle so as to obtain a second virtual scene image corresponding to the second visual angle, and a virtual scene presentation device for presenting the second virtual scene image to the user, wherein the scene range of the first virtual scene image is larger than the scene range actually presented by the presentation device to the user. Therefore, the problems of dizziness caused by delay of a visual field and a black boundary caused by the schemes such as a time distortion technology can be solved; and the user can better devote to a virtual reality scene, and the use experience of the user is enhanced.

An embodiment of the invention provides an interactive type visual simulation system under the vehicle road collaborative environments.The system comprises a real traffic simulation three-dimensional model, a virtual driving vehicle, a driver-vehicle interactive simulation unit and a traffic flow model, and the traffic flow model considers driver factors and combines a vehicle starting and stop module.The system is based on the three-dimensional simulation environments, an interactive type dynamic mapping model corresponding to the virtual vehicle, different typical scene simulation and the like, the traffic flow model considering the driver behavior is designed, the behavior and the effect of a cooperative vehicle infrastructure system can be displayed to a user from multiple angles, at the same time, the acceptance degree of the driver on vehicle road collaboration certain functions and the design rationality of certain functions are analyzed, and a virtual driving environment with sense of reality and sense of immersion can be provided for the driver.

A method for generating augmented reality content includes receiving an augmented reality mode execution request for generating augmented reality content based on electronic book content, activating a camera in response to the request to provide a preview image, loading book data of the electronic book on the preview image, detecting an event occurring in the augmented reality mode, retrieving reaction data pre-mapped to the event, and loading the reaction data on the preview image.

The invention discloses a content projection system and a content projection method. The system comprises a fixation point detection device used for detecting a present fixation point position of eyes; an image generation device used for generating a virtual image in dependence on visualization information and the fixation point position; and a virtual image projection device used for projecting the virtual image to eye grounds in dependence on the fixation point position. In the system and the method provided by the embodiment, the fixation point position of a user can be detected in real time, imaging parameters of corresponding visualization information are obtained according to the fixation point position, furthermore the virtual image is generated and projected to the eye grounds, virtual figure information and real information can be fused better, and furthermore the user can obtain better immersion.

The invention relates to a 3D virtual community construction method based on panoramic and real image and geographic information. The method comprises the following steps: establishing a virtual community structure; establishing a virtual community display platform through three procedures, including the first procedure of creating a virtual space based on a scene display outer curtain, creating a virtual ground and setting a wandering mode of a user on the virtual ground; the second procedure of adding a 3D entity on the virtual ground and the third procedure of synchronizing the virtual space and the geographic information of the real world; obtaining a virtual community based on panoramic and real image and geographic information; and enabling the environmental interaction of users in the virtual community and the interaction of a current user and other users. The inventive method increases the virtual community scene construction efficiency, improves the realistic effect, ensures the scene of the virtual community consistent to the scene of the real community, allows the user in the virtual space to not only enjoy the environment of the real world but also know the current geographical location, and enhances the realistic effect of the virtual community.

The invention discloses a decoration information model-based VR virtual decoration method. The method comprises the steps of S1, shooting a two-dimensional photo of a room all-directionally, generating a three-dimensional model of the room through a multi-dimensional fusion method, and converting the three-dimensional model into a VR scene model; S2, constructing a decoration component characteristic module based on the VR scene model; S3, sending a decoration instruction according to the decoration component characteristic module and the VR scene model, and performing decoration on the three-dimensional model; and S4, obtaining observation point information of a user, establishing a VR scene, corresponding to current observation point information of the user, in the three-dimensional model, and displaying the VR scene in a VR wearable device. According to the method, a corresponding relationship between the VR scene model and the three-dimensional model is established, so that VR scenes in different view angles can be updated in real time, and the vividness and immersion of VR virtual decoration are improved.