188results about How to "Strong sense of immersion" patented technology

The invention discloses a mining operation multi-operation realization method based on virtual reality and augmented reality, and belongs to the technical field of the virtual reality and the augmented reality. The method comprises two patterns including the virtual reality and the augmented reality. Under a virtual reality scene, the selection and the replacement of a material and a material in the virtual reality scene can be realized, scene exploration is realized, the model can be moved and placed at will, a video is embedded, a two-dimensional code is generated, and a trigger realizes natural interaction, voice interaction and the like; under an augmented reality scene, the model can be selected, voice is played, the operation dynamics of the model can be demonstrated, and the rotation stopping, screen capture and function expansion of the model can be controlled; and under two patterns, various interaction ways of voice control, gesture control and keyboard mouse control can be realized. The method is applied to the virtual simulation application scene of the mining operation, can be used for training mine lot mining workers and students of the mining engineering specialty, reducing training capital and improving the skills of workers and provides an advanced and quick meaning for guiding production construction and science and technology studies.

The invention relates to a 3D virtual community construction method based on panoramic and real image and geographic information. The method comprises the following steps: establishing a virtual community structure; establishing a virtual community display platform through three procedures, including the first procedure of creating a virtual space based on a scene display outer curtain, creating a virtual ground and setting a wandering mode of a user on the virtual ground; the second procedure of adding a 3D entity on the virtual ground and the third procedure of synchronizing the virtual space and the geographic information of the real world; obtaining a virtual community based on panoramic and real image and geographic information; and enabling the environmental interaction of users in the virtual community and the interaction of a current user and other users. The inventive method increases the virtual community scene construction efficiency, improves the realistic effect, ensures the scene of the virtual community consistent to the scene of the real community, allows the user in the virtual space to not only enjoy the environment of the real world but also know the current geographical location, and enhances the realistic effect of the virtual community.

The invention provides a BIM based virtual reality displaying method and system. The BIM based virtual reality displaying method comprises the steps of 1 generating a BIM building model; 2 transmitting the BIM building model to a display helmet worn by an observer; 3 utilizing a sensor installed on the display helmet to obtain observation information of a user and transmitting the observation information of the user to the BIM building model and enabling the BIM building model to receive the observation information of the user; 4 updating BIM building model data according to the observation information of the observer and repeating the step 2 to continue to execute the steps. By means of the BIM based virtual reality displaying method, required building information can be only locally displayed at the viewing angle of the observer, the burden of an image processing device is reduced, the field requirement is low, and the method is not limited by environment and enables the observer to have strong immersion and to be personally on the scene.

The invention discloses a decoration effect display method based on a panoramic platform. The method comprises: S1, taking two-dimensional photographs of a room in all directions and conducting mosaicking on the two-dimensional photographs to obtain a panoramic photograph; S2, according to the two-dimensional photographs and the panoramic photograph, generating a three-dimensional model of the room; S3, converting the three-dimensional model to a virtual reality (VR) scene model and displaying the VR scene model in a VR wearable device; S4, sending decoration instructions according to the VR scene model, and decorating on the basis of the three-dimensional model; and S5, updating the VR scene model in real time according to the decorated three-dimensional model, at the same time displaying the updated VR scene model in the VR wearable device. The method can realize the decoration effect display based on the panoramic platform, and the displayed decoration effect has high fidelity and the sense of immersion, so as to provide users with more real virtual reality.

The invention provides a wide-range high-precision matched digital channel three-dimensional visualization method. For a scene graph technology-based channel scene organization method and an incremental component-based similar model modeling method, a wide-range channel terrain which accords with earth curvature change and is completely matched with an electronic chart is established, a k-crossing tree structure scene graph of a channel scene three-dimensional entity model is established, and the channel scene three-dimensional entity model which has the characteristics of wide ranges of three dimension, dynamic and scene, irregular entity and the like is organized, expressed, multiplexed and parallelly quickly developed; and based on a dynamic data configuration technology, a database paging scheduling policy is combined, and the wide-range channel three-dimensional entity model is subjected to high-precision matching, dynamic management and real-time smooth drawing. By the method, wide-range channel high-precision and high-efficiency three-dimensional visualization is realized, and inland water transportation boatmanship training and the visualization construction of Yangtze River digital channels are promoted.

The invention relates to an immersive three-dimensional rendering projection system and method for a moving view point on a curved screen. The method is based on an immersive three-dimensional rendering projection system for a moving view point on a curved screen. The method comprises the following steps: acquiring user information: tracking user's head position and posture information, and estimating user's binocular positions and sight direction; setting three-dimensional rendering parameters: according to the estimated user's binocular positions and sight direction, adjusting a three-dimensional camera in real time to perform three-dimensional rendering of the moving view point on the parameters; performing dynamic parallax adjustment: performing post processing on the parallax of the rendered three-dimensional image according to the relative position relation between the user and the screen and the geometric shape information of the projection screen, so that the user views comfortable and correct three-dimensional images at his position; optimizing user perception: for user's head posture and eyeball movement, further optimizing the image respectively after the dynamic parallax adjustment; and projecting a three-dimensional scene: watching a virtual roaming three-dimensional scene by the user wearing a pair of three-dimensional glasses.

The embodiment of the invention provides an augmented reality-based information providing method and device, equipment and a storage medium. The method comprises the steps of obtaining a scene image of a reality scene collected by an image collection device; according to the scene image, obtaining to-be-displayed augmented reality AR content and a display target of the AR content in the scene image; fusing the AR content with the display target so as to provide the fused content for the user; wherein the AR content is determined by the following modes: identifying a scene image to obtain scene information of the scene image; and determining AR content corresponding to the scene information based on the scene information. Based on the scheme provided by the embodiment of the invention, the information associated with the scene where the user is located can be provided for the user, and the information is displayed to the user based on the AR technology, so that the immersion of the user is effectively improved, and the actual application requirement can be better met.

The invention discloses a digital Bianzhong-of-Marquis-Yi-of-Zeng interactive system based on immersive virtual reality equipment. The digital Bianzhong-of-Marquis-Yi-of-Zeng interactive system is achieved through a head-mounted display, a stereo headphone, wireless control handles, laser locators, a computer and matched virtual reality software. The stereo headphone is connected with the head-mounted display, the matched virtual reality software is installed in the computer, and the wireless control handles and the laser locators are interacted with the head-mounted display. Through the head-mounted display, a visitor can directly observe a Bianzhong at a first-person perspective of the visitor, and the immersion feeling is higher; the visitor can also freely walk in virtual scenes in cooperation with the laser locators, the Bianzhong is observed from any position angle, and the observation mode is more natural. The wireless control handles are matched with the laser locators, the visitor can be interacted with the Bianzhong in the virtual scenes, and the interactive mode is simple and natural.

The invention relates to virtual and actual technologies and particularly relates to a 360-degree panoramic multi-point touch display platform establishment method which is used for solving the problem of incapability of combination of a three-dimensional display platform and a touch interactive platform in the prior art. The method comprises the following steps of: generating a file set with a map sign by using panoramic 360-degree pictures; inducing the file set into a computer with an optical touch platform; rendering the file set to ensure that the scene of the file set is matched with the optical touch platform; and switching the scene of the file set by operating the optical touch platform with gestural motions so as to obtain features of objects in the scene. According to the method provided by the invention, panoramic pictures are combined with the optical touch platform so that brand new visual and sensory experiences are brought to users; and users can arbitrarily touch the screen by single-point touching, clicking, doubly-clicking, translating, rotating and the like through the hands so as to obtain relevant features of objects more comprehensively.

The invention discloses a method for visualizing a three-dimensional environmental map in a virtual reality system. The method includes: S1, acquiring and controlling real environment data of an environment where a target locates; S2, constructing a corresponding three-dimensional environmental map according to the real environment data acquired in real time; S3, acquiring updating incremental data of the three-dimensional environmental map at specified period intervals to obtain increment map data; S4, transmitting the increment map data acquired in real time to a control end, and displaying in the virtual reality system to realize visualization of the three-dimensional environmental map. The method is capable of realizing visualization of the three-dimensional environmental map in the virtual reality system and has the advantages of simplicity in realizing method, low realizing cost, small needed communication bandwidth, flexibility in application environments, good realizing effect and the like.

The invention provides an interconversion method of a sequence frame and a panorama, and relates to the technology of display of virtual reality and virtual images. The method comprises the steps of storing the sequence frame for displaying automatic roam effect and a 360-degree panorama file of a swf format under the created working directory; building a correspondence relationship between the sequence frame file and the 360-degree panorama file; implementing a conversion interface by flex; adding a button for triggering the conversion interface to a front page; triggering the button to convert the sequence frame and the 360-degree panorama. With the adoption of the method, the problem of failure of roam of 360-degree panorama display can be solved, and meanwhile, the problem of blockage caused by that unity 3D needs a large space of an internal memory can be solved; the automatic roam effect is achieved; the sense of reality is improved; the interaction performance is high; the manufacturing cost is relatively low; the method is applied to network.

The invention discloses a handmade product and virtual reality experience system and a method based on a mobile terminal. The system comprises a handmade subsystem, a position and object recognition subsystem, a storyline generation subsystem and a scene generation and roaming subsystem, wherein the handmade subsystem is configured to generate an expanded drawing for a handmade product according to a model and providing a teaching video; the position and object recognition subsystem is configured to recognize and output names and coordinates of multiple objects with the handmade product included in a physical world; the storyline generation subsystem is configured to edit the showing order and the lines of the model; and the scene generation and roaming subsystem is configured to generatea corresponding scene according to the names and the coordinates of the object, generate a corresponding storyline according to the lines of the storyline and use a virtual scene and a plot generatedthrough experience of a virtual reality device to realize interaction.

The invention relates to an aeronautical equipment repair assistance system based on hybrid reality and a method for using the same. By using a head-mounted hybrid reality device to build a repair assistance system, and the system includes a login management identity authentication module for login authentication, a holographic three-dimensional model display module for demonstration, an image, audio and video presentation module used to explain the operation, a holographic three-dimensional animation superimposing display module for superimposing a reality and a virtual scene, a gesture recognition interaction processing module and a speech recognition interaction processing module for gesture interaction and speech interaction, a two-dimensional code and image recognition module for scanning and matching database feature information, and an operation record module for uploading and saving maintenance records. The invention has the advantages of simple operation, easy access to maintenance personnel, updating maintenance data, intuitively displaying maintenance operation, recording maintenance process in detail, facilitating enterprise traceability management, and greatly improving maintenance efficiency of aeronautical equipment.

The invention discloses a virtual assembly method based on Leap Motion and cooperation in a local area network, and belongs to the technical field of multi-person gesture cooperation virtual assembly.Based on the cooperative technology in the local area network, the virtual assembly method takes Leap Motion as main hardware equipment to perform virtual assembly of multi-person cooperative gesturecontrol on industrial parts. The virtual assembly method comprises the steps that firstly, on the basis of importing a built assembly part three-dimensional model, Leap Motion is used for detecting palm gestures, and related assembly input gestures are collected and recognized; pickup of an assembly part is achieved through light tracking and rigid body collision detection; and based on a local area network cooperative technology, cooperative splitting and assembling in a networked virtual scene are realized.

The invention discloses an electronic map tour guide method special for tourist attractions, and the method comprises the following steps: collecting basic data of the tourist attraction, and establishing a tourist attraction plane map and an associated AR scene; scanning the scenic spot plane map, and obtaining an associated AR scene for interface display; performing adaptive matching on the gesture operation and AR scene interface editing content; selecting a touring route and/or scenic spot calibrated in the AR scene through gesture operation, obtaining a real-time people stream monitoringvideo corresponding to the route and/or scenic spot, and planning the touring route; driving to a target scenic spot in the scenic spot according to the planned touring route; and selecting a calibration scenic spot corresponding to a target scenic spot in the AR scene through gesture operation, and obtaining introduction information of the corresponding target scenic spot for playing and displaying. The AR tour guide map brought by the live-action can be provided for tourists, so that the tourists can select routes and scenic spots after checking the live-action of the routes and the scenic spots, and scenic spot explanation with parallel characters, sounds and images is provided for the tourists.

The invention discloses a cerebral stroke upper limb rehabilitation training method and system. The method comprises the steps of establishing a virtual rehabilitation training scene; collecting dynamic data of coordinates of hands of a patient, processing the dynamic data and position information of a hand gesture object, recognizing gestures of the hands according to a processing result, and making the gestures of the hands interact with the scene to complete a designated gesture of rehabilitation training; displaying the gestures of the hands in the virtual reality rehabilitation training scene in real time through a virtual reality helmet. According to the cerebral stroke upper limb rehabilitation training method and system, the coordinates of the hands are collected through a somatosensory controller, not only is the price low, but also the precision is high, there is no need to conduct calibration in advance, the content of the scene is interesting, immersion of a virtual realitydevice is high, thus the patient obtain stimulation continuously during rehabilitation training, and accordingly the patient can persist rehabilitation training in the long term.

The invention provides a robot teleoperation system and method based on electromagnetic force feedback and augmented reality. The system comprises a natural control module and a natural feedback module. After fusing gesture text and voice text of an operator, the natural control module extracts a robot control instruction through an inference method to guide a virtual robot in moving, and a true remote robot copies movement of the virtual robot based on data sent by the internet. The natural feedback module comprises electromagnetic force feedback and vision feedback, through the electromagnetic force feedback, the operator can sense the force of the robot, and through the vision feedback, the operator can obverse the virtual robot in any direction. The system is adopted for remotely operating the robot, the stress condition and task execution process of the robot can be sensed in real time, the high immersion sense is achieved, the operation efficiency and accuracy are improved, and the system and method are suitable for non-professional operators and have universality, operability and a wide application range.

The invention relates to the field of the multimedia technology, and discloses a multi-frame fusion display method based on the 3D technology, and storage equipment. The multi-frame fusion display method comprises steps: presetting 3D display scenes, wherein the 3D display scenes include more than two display windows; obtaining more than two to-be-displayed data sources from an application of the same terminal, respectively rendering different data sources to different virtual screens, and displaying virtual screen display results obtained after rendering on different display windows in the 3D display scenes; or displaying the different data sources on the different display windows in the 3D display scenes through different coordinate systems. According to the multi-frame fusion display method based on the 3D technology, different display effects of the display windows can be realized through setting of different 3D display scenes, the display modes and effects of the data sources are no longer single, the to-be-displayed data sources are fused into the 3D scenes, the display of the data sources is more vivid, stronger immersion is achieved, the browse is more convenient, and the display is more diversified and vivid.

The present invention provides a story machine interactive play method. The problems are solved that a current story machine play mode is bad in user immersion, cannot generation interaction with the story machine and has no education meaning, etc. The method comprises the following steps: reading system initialization information, and playing story audio stored in the story machine; the story audio is about to play at a selection node or an interaction node, performing selection prompting or interaction prompting and performing detection; if it is detected there is a selection button operation or audio operation after the starting of the selection prompting, going on performing playing of the story audio according to the options of the button operation; if it is detected there is no a selection button operation or audio operation after the starting of the selection prompting, performing shutdown prompting, and detecting whether there is the selection button operation or not; if there is the selection button operation, going on playing the story audio; and if there is no the selection button operation, finishing all the motions and closing the system. The story machine interactive play method adds the interaction frequency of the story machine and users to allow the users to add the immersion, increase the story machine education meaning and allow the story machine to improve the practicality and to be suitable for popularization and application.

The invention discloses a method for carrying out crystal macromolecule three-dimensional visualization by adopting an augmented reality technology. The method comprises the following steps: 1) establishing a spatial structure database for crystal macromolecule according to the spatial structure data of the crystal macromolecule; 2) establishing a visualization model according to the obtained three-dimensional spatial structure data of the crystal macromolecule under the environment of open GL; 3) realizing the crystal macromolecule three-dimensional visualization on the basis of the augmented reality; and 4) further developing and realizing the functions of information inquiry and reconstruction of the crystal macromolecule under the condition of enhancing the display. According to the method for carrying out crystal macromolecule three dimensional visualization by adopting augmented reality technology, carrying out an interaction with the crystal macromolecule by researchers is allowed, and carrying out reconstruction to an original structure of the crystal macromolecule on the basis of research need has important significance to teaching experiment and scientific research, and is helpful to improve teaching experiment level and quality and efficiency of the scientific research.

Provided is an immersion-type self-adaptive pose virtual surgery training platform, comprising four parts of an upper display component, a middle console component, a lower support component and a side support component, and the like. The upper display component, which is designed according to ergonomics, fits a human facial structure and is adapted to human brains with different sizes by adjusting the size of the observation center space via a button, so that the human brains fit well with the platform and the sense of immersion in enhanced. The pose can be adjusted in the self-adaptive way, so that the surgery operation training can be conducted with the appropriate pose, thereby improving the degree of comfort and reducing the fatigue. The whole surgery training process is observed via an external 3D display of the upper display component, so as to evaluate the training effect. The platform of the invention may be used for simulating the operation process of various surgeries, such as brain surgeries, liver surgeries, kidney surgeries, breast surgeries and the like, enables intern doctors or medical college students to conduct the surgery training in the repeated, damage-free and convenient manner, and solves the problems of long training period, low efficiency, high cost, lack of training objects which may occur during traditional surgeon training.

The invention provides a spherical image processing method and device and a server. The spherical image processing method comprises the following steps: acquiring a spherical image, and determining the sphere center of the spherical image; determining a viewpoint when the user watches the spherical image, wherein the viewpoint is located at any point except the sphere center in a sphere space surrounded by the spherical image; determining a pixel expansion area and a pixel contraction area on the spherical image according to the sphere center and the viewpoint; and performing image processingon the spherical image, wherein the image processing comprises performing pixel expansion processing on the image in the pixel expansion region and performing pixel contraction processing on the imagein the pixel contraction region. According to the invention, local enlargement and local reduction are carried out according to the actual view of the viewpoint, so that the user can obtain the viewing experience similar to the near-to-far small-zoom change of the object actually viewed in the real world.