38results about How to "Immersive" patented technology

The invention discloses a VR (virtual reality) and AR (augmented reality) technology fused building exhibition system. The system comprises an intelligent terminal, a VR experience box, a building album and a background server. Sensing pictures are printed on the building album; the intelligent terminal is provided with image acquisition equipment for acquiring data information of the sensing pictures; basic information of building projects and building exhibition data are stored in the background server, and the building exhibition data include realistic scene panoramas, three-dimensional panoramas, realistic scene panorama videos, three-dimensional panorama videos and three-dimensional model mappings matched with the sensing pictures; the intelligent terminal is in bidirectional communication with the background server, transmits the data information of the sensing pictures to the background server and acquires the building exhibition data; the intelligent terminal is installed in the VR experience box and externally connected with a VR controller to form VR glasses, and a building exhibition APP is preinstalled in the intelligent terminal and includes a project introduction module, a VR experience module and an AR experience module. By integration of traditional building selling software, the VR technology and the AR technology, comprehensive building exhibition is realized.

The invention discloses a video communication system combining virtual reality glasses, and the video communication system can be beneficial to long-distance participants to obtain participating experiences of perceptibility, sense of immediacy and immersion. The video communication system comprises a video communication server which is interconnected to an IP (internal protocol) network, a field participating personification communication terminal and a long-distance participating portable communication terminal, wherein virtual reality glasses are connected or integrated on the long-distance participating portable communication terminal. By virtue of the virtual reality glasses, long-distance participants can obtain participating experiences of perceptibility, sense of immediacy and immersion.

The invention discloses a local area network cooperation-based fully mechanized mining working face virtual monitoring method. The method comprises the steps of in a local area network environment, establishing a mirror image of a real fully mechanized mining working face in a virtual reality engine Unity3d environment; then collecting an actual working face in real time by data monitoring hosts and storing data in a working face database SQL SERVER 2008 in real time; reading the corresponding data in the database in real time by multiple data analysis servers located in different positions; performing processing through a pose calculation module and a prediction module and driving corresponding virtual reality devices in real time; mutually synchronizing the data at any time in a local area network cooperation manner through a C / S architecture by the hosts; synthesizing a panoramic image of the whole working face; and performing three-dimensional visual virtual monitoring on the real working face and performing analysis and prediction on historical data online. According to the method, the running state of the working face can be displayed in a three-dimensional, panoramic and real-time manner; a fully mechanized running prediction and early warning model is embedded in a background; the intuitive and visual fault diagnosis and prediction can be realized; and the technical support is provided for efficient and safe running of the fully mechanized mining working face.

The invention discloses a memory cutting method of a virtual coal cutter. The memory cutting method comprises the following steps: firstly generating a virtual top and base plate environment in a virtual reality engine Unity3d environment, then paving a virtual scraper conveyor on a virtual base plate as a track for the virtual coal cutter to operate, clicking the button of a virtual control panel to operate the virtual coal cutter, carrying out storage, analysis, processing and reading on operational data by a virtual controller in real time, and thus realizing memory cutting simulation for the coal cutter. According to the method, a new cutting technology algorithm can be quickly tested in different geological environments, and single-machine training of a coal cutter driver and concurrent operation of double persons can be realized.

The invention discloses an interactive multimedia teaching system based on VR (virtual reality) technology, which comprises a teacher terminal, an interactive system and a student terminal. The teacher terminal comprises an operation module, an editing module, a review module and a computer. And an output end of the operation module, an output end of the editing module and an output end of the review module are respectively electrically connected with the first input terminal, the second input terminal and the third input terminal corresponding to the computer. The first output end of the computer is electrically connected with an input end of an evaluation module, and an output end of the evaluation module is electrically connected with an input end of a push module. The output end of the push module is electrically connected with the first input terminal of an evaluation problem memory. The interactive multimedia teaching system based on VR technology adopts the VR virtual environment helmet to teach the students so that the students can experience the real scene, which greatly enhances the interests of students in learning. And the learning effect and the learning degree of students can be easily understood by teachers.

The invention discloses a real time panoramic live broadcast system and method. The system comprises a panoramic camera lens module, an FPGA (Field Programmable Gate Array) chip, a microphone, a videoprocessing chip and a communication module, wherein the panoramic camera lens module is used for acquiring video data; the FPGA chip is connected with the panoramic camera lens module to receive thevideo data acquired by the panoramic camera lens module, and perform image splicing processing on the video data; the microphone is used for acquiring the audio data; the video processing chip is connected with the FPGA chip and the microphone respectively, and used for receiving audio data and the video data being subjected to the image splicing processing and performing compression coding on theaudio data and the video data respectively to encapsulate the audio data and the video data into a multimedia stream file including standard formats of video and audio; and the communication module is connected with the video processing chip, and used for pushing the multimedia streaming file to realize live broadcast. Through adoption of the real time panoramic live broadcast system and method,parameters of live broadcast image resolution, code rate and the like can be set adaptively according to a protocol of a live broadcast platform; secondary transcoding does not need to be performed through a panoramic live broadcast platform server; and time delay in a live broadcast process is reduced greatly.

The invention relates to a water conservancy industry display method based on a virtual reality (VR) technology. The method comprises the following steps: establishing a water conservancy VR model in a VR system; establishing connection between the VR system and a water conservancy system monitoring server, and obtaining real-time monitoring data of the water conservancy system monitoring server; the VR system, according to the obtained real-time monitoring data, scheduling corresponding parameters, and generating a virtual scene matching a real scene corresponding to the real-time monitoring data in the water conservancy system VR model; the VR system, according to a preset alarm trigger threshold, when the real-time monitoring data triggers an alarm, switching the virtual scene to a place where the real-time monitoring data is correspondingly generated, and sending a request to a short message cloud server for performing short message notification; and establishing connection between the VR system and a water conservancy system database, executing a command of data storage by use of an SQL database language, storing the real-time monitoring data of the water conservancy system monitoring server into the water conservancy system database, and opening and closing the connection according to needs.

The invention relates to an assembly guidance method and an assembly guidance system based on mixed reality equipment. The assembly guidance method comprises the steps of: constructing a virtual assembly scene; fusing the virtual assembly scene and a realistic assembly scene by means of the mixed reality equipment; identifying assembling stages and assembly bodies in the realistic assembly scene;acquiring assembly guidance information according to the identified assembling stags and the identified assembly bodies; and displaying the assembly guidance information by means of the mixed realityequipment, so as to guide the assembly process. The assembly guidance method and the assembly guidance system based on the mixed reality equipment realize the effects of performing assembly guidance for specific assembly steps and carrying out real-time matching with the realistic assembly scene, can identify the assembling stages flexibly in real time and give corresponding assembly guidance, displays the assembly guidance information by means of the mixed reality equipment, has the advantage of being intuitive, has a sense of immersion, improves the efficiency of assembly guidance, and reduces the error rate during the assembly process.

The invention relates to an intelligent education system. The system comprises an immersion type teaching system, an online simulation teaching system, a competency assessment system, an online examination system and an offline activity support system. The intelligent education system has the advantages that students can experience real scenes and has an immersion feeling, the learning interest ofthe students is enhanced greatly, and interaction is achieved; the students are taught through a virtual environment helmet, and teachers can also conveniently learn about the learning effect and learning degree of the students.

The invention provides a rehabilitation training system and method based on a motor imagery-brain-computer interface and virtual reality. An electroencephalogram signal of a subject in a rehabilitation process is collected in real time through an electroencephalogram signal collection device, and the electroencephalogram signal is preprocessed; feature extraction is performed on the preprocessed electroencephalogram signal, and a motor imagery intention recognition model is established based on extracted features; training exercise scenes in a first-person visual angle and a third-person visual angle are developed, and the training exercise scenes are rendered through a VR helmet; the subject selects two different visual angles for training in the VR environment, the subject performs motor imagery according to prompts, and when the subject imagery is recognized, corresponding limbs in a scene complete corresponding actions; rehabilitation training is scored according to quantitative indexes of the brain region activation degree related to the motor imagery of the subject obtained by performing brain network analysis on the electroencephalogram signals of the subject, and a rehabilitation report is generated. The rehabilitation training system can achieve a good rehabilitation training effect.

The invention discloses a riding speed control system of an intelligent live-action spinning bike. The riding speed control system comprises a main control module, wherein the main control module is electrically connected with a body condition monitoring module, a damping adjustment module, an identity information registration module, a music playing module, a riding time counting module, an encryption module, an audio output module and a live-action simulation module. The invention further provides a riding speed control method of the intelligent live-action spinning bike; the spinning bike is provided with the damping adjustment module controlled through a control unit; the method comprises the following step: S1, selecting a live-action map for riding by a user. According to the ridingspeed control system and method of the intelligent live-action spinning bike, the user can feel actual resistance of a current elevation and the user can be personally on the scene; the riding dampingis also continuously increased with the rising of the elevation and the user experiences the fatigue feeling of climbing slopes; otherwise, the damping is reduced and exercisers experience easiness and pleasure.

The invention discloses a virtual reality based preoperative auxiliary planning device which comprises a medical image visualization subsystem and a preoperative planning subsystem, wherein the medical image visualization subsystem comprises a medical data import unit, a brain structure segmentation unit, a vascular branch segmentation unit, a registration unit and a visualization model establishment unit; and the preoperative planning subsystem comprises a visual field adjustment unit, an operation planning unit, a result storage and export preview unit. By adopting the virtual reality basedpreoperative auxiliary planning device disclosed by the invention, the problems of different visual level and lack in stereoscopic impression of medical images can be solved; and a complete and clearvisualization model is established for each patient, so that preoperative planning has an immersion sense and a visual sense.

The invention relates to a multi-perception and interaction type oil depot safe operation training method. The method mainly solves the problems of the prior art that the sense of reality is poor, interactivity is poor and training quality is poor. Multi-perception and interaction type oil depot safe operation training is conducted on a training device with the multi-perception and interaction type oil depot safe operation training method. The training device comprises a movable LED display screen (1), a motion sensing camera (2), data gloves (3), a computer terminal (5) and sound equipment (4), wherein the movable LED display screen (1) is connected with the computer terminal (5), the motion sensing camera (2) comprises a field depth sensor used for acquiring the shape and position of a user and an RGB camera body and is connected with an information conversion unit, the information conversion unit is connected with a skeleton binding control unit, and the skeleton binding control unit is connected with the computer terminal (5). The method well solves the problem of the prior art and can be applied to oil depot safe operation training.

The invention discloses a novel 3D virtual reality glasses display system, which comprises wearable glasses, a Bluetooth remote controller and display location icons. The wearable glasses comprise a main housing, a mobile intelligent device and a fixed wear. An adjustable glasses holder is arranged inside the main housing. Eyeglasses are arranged on the adjustable glasses holder. The mobile intelligent device comprises a data processing unit, a camera module and a display module. The camera module is connected with a camera. The working process of the 3D virtual reality glasses display system comprises the following steps: (1) pre-setting location icons; (2) analyzing an image to search location icons; (3) establishing a coordinate system; (4) comparing and calculating location ions; (5) generating a 3D virtual model. Compared with the prior art, users feel personally on the scene based on the structural design of the novel 3D virtual reality glasses display system, so that users can experience dreamlike scenes based on the combination of the virtuality and the reality.

The invention relates to a game interaction method based on facial expression recognition, and the method comprises the steps: (1) extracting visual features through the learning of different types ofexpression static images through a convolutional neural network, determining the relation between the conversion of facial expressions in an image sequence and facial basic expressions, and obtaininga training model; (2) collecting video information of a player to be detected, and carrying out image interception on the video information according to frames; (3) preprocessing the video image to generate a preprocessed image; (4) performing facial expression analysis, matching the facial expression with the expression features in the training model, and analyzing the current expression of theplayer; (5) controlling the game role through the current facial expression. According to the method, the face of the player is shot only through the camera, the expression analysis and recognition are carried out in the computer, the result is converted into the control instruction of the game, role control in the game is achieved, the player can also be directly or assisted in talking with otherroles, and a conventional game interaction mode is expanded.

The invention discloses a riding speed control method of an intelligent real-scene spinning bicycle. The spinning bicycle is provided with a damping component controlled by a control unit; the method includes the following steps: the user selects a real-scene map to be ridden; The unit acquires the altitude of the real-scene map, and sets the initial resistance of the damping component; the control unit acquires the real-time uphill and downhill conditions of the user riding on the real-scene map, and changes the resistance of the damping component. The present invention automatically sets the initial resistance according to the altitude of the real-scene map selected by the user, so that the user can not only feel the real map but also the actual resistance at the current altitude when riding on the real-scene map The size allows users to truly be on the scene.

The invention discloses an emergency drilling system and a control method of the emergency drilling system, and the method comprises the steps that a server generates a scene resource file, and transmits the scene resource file and a preset script file to a client; the client loads the scene resource file to generate and display a virtual drilling scene, and executes the script file to control theprocess of emergency drilling; a virtual reality device collects state data of the drilling personnel and sends the state data to the client; and the client performs analog simulation of driving operation on an operation component of the virtual drill scene according to the state data, and performs analog simulation on the body movement of the virtual drill personnel to generate emergency drill data. According to the control method of the emergency drilling system, a nuclear emergency exercise mechanism is enhanced through virtual-real combined man-machine operation, the experience of emergency exercises can be accumulated, and weak links in the emergency system can be found out.

The invention discloses an immersive video playing method and system. The method is applied to an immersive video playing system comprising a three-dimensional camera device, an audio input device, adisplay device and an audio output device, and comprises the following steps: identifying a user initial image shot by the three-dimensional camera device, and creating a virtual user model accordingto initial feature data; loading corresponding virtual stage models and accompaniment audios according to the field effects and singing songs selected by the users, synthesizing the virtual stage models, the accompaniment audios, the virtual user models and the user audios collected by the audio input equipment to generate immersive video data, and playing the immersive video data in real time; and identifying a user real-time image shot by the three-dimensional camera device, and updating the virtual user model in the immersive video data in real time according to the real-time feature data.According to the method, singing entertainment experience with immersion, stronger interactivity and better sociality can be provided for the user.

The invention relates to a method and device for generating exterior video image of virtual space for viewpoint translation, belongs to multimedia virtual reality technology. The method comprises: firstly taking right ahead sight, and numbering video image; then continuously playing 1,2,3í¡ í¡n video images, and generating exterior video image with viewpoint translation speed of V; finally according to set viewpoint translation speed, generating virtual exterior video images at video image playing order corresponding to viewpoint translation speed. The device comprises: hard disk drive, speed sensor, general serial interface, video display device, audio player and control key, and connecting to digital media processor respectively. The method has no need of spicing collected images and using PC computer. The device uses generates virtual space image using flush bonding system, and having advantages of rapid response speed, true picture, small volume, low cost and high reliability etc..

The invention discloses a local area network cooperation-based fully mechanized mining working face virtual monitoring method. The method comprises the steps of in a local area network environment, establishing a mirror image of a real fully mechanized mining working face in a virtual reality engine Unity3d environment; then collecting an actual working face in real time by data monitoring hosts and storing data in a working face database SQL SERVER 2008 in real time; reading the corresponding data in the database in real time by multiple data analysis servers located in different positions; performing processing through a pose calculation module and a prediction module and driving corresponding virtual reality devices in real time; mutually synchronizing the data at any time in a local area network cooperation manner through a C / S architecture by the hosts; synthesizing a panoramic image of the whole working face; and performing three-dimensional visual virtual monitoring on the real working face and performing analysis and prediction on historical data online. According to the method, the running state of the working face can be displayed in a three-dimensional, panoramic and real-time manner; a fully mechanized running prediction and early warning model is embedded in a background; the intuitive and visual fault diagnosis and prediction can be realized; and the technical support is provided for efficient and safe running of the fully mechanized mining working face.

The invention relates to the technical field of computer virtual equipment, in particular to a VR-based safety tool training method, VR equipment and a server. The invention provides a VR-based safetytool training server, and the server comprises a processor which executes a computer implementation assembly stored in a storage unit; a user information management assembly which is configured to perform user basic information management, work type figure model management, tool, instrument and project data management, and operation task and 3D scene management; a virtual character model component which is configured to realize adding and deleting operations on a character model; a tool and data management assembly which is configured to include 3D models of various types of tools, inspectionand use methods of various types of tools, unqualified tool models and tool misoperation cases; and a task and operation assembly which is configured to include a 3D scene needing to use tools, a tool operation process, tool operation assessment and operation error point log recording.

The embodiment of the invention provides an audio processing method in a real scene space, an electronic terminal and a storage medium. In the embodiment of the invention, the virtual audio source and the roaming camera are loaded in the live-action space, and the position binding relationship between the roaming camera and the audio receiver is established, so that a user can receive the audio information output by the virtual audio at each roaming position in the live-action space, and furthermore, a target rotation vector required by the virtual audio source to face the roaming camera in the current pose can be calculated according to the pose variation of the roaming camera acquired by the gyroscope, and then the audio source is controlled to output the audio signal to the roaming camera according to the target rotation vector, therefore, the audio receiver can receive the audio signal directly facing the audio receiver at the current position of the roaming camera, the immersion of the user in the real scene space is improved, and the user can be personally on the scene in the auditory sense.

The invention discloses a memory cutting method of a virtual coal cutter. The memory cutting method comprises the following steps: firstly generating a virtual top and base plate environment in a virtual reality engine Unity3d environment, then paving a virtual scraper conveyor on a virtual base plate as a track for the virtual coal cutter to operate, clicking the button of a virtual control panel to operate the virtual coal cutter, carrying out storage, analysis, processing and reading on operational data by a virtual controller in real time, and thus realizing memory cutting simulation for the coal cutter. According to the method, a new cutting technology algorithm can be quickly tested in different geological environments, and single-machine training of a coal cutter driver and concurrent operation of double persons can be realized.

The invention discloses a method for the binding interaction constraint of a human body mapping posture body and a virtual rotating body. The method includes the following steps of S1, establishing avirtual reality world with a quaternion structure as the four-dimensional space; S2, establishing the human body mapping posture body of a real human body in a virtual environment; S3, representing the rotating axis of the virtual rotating body through a three-dimensional vector, and representing the rotating angle of the virtual rotating body through an angle vector; S4, setting the rotating axisas the A point and the hand as the B point, and setting the virtual rotating body to be kept on the straight line from A to B; S5, judging whether the hand keeps holding the virtual rotating body ornot, and if yes, always making the virtual rotating body move in the direction of the AB straight line to form the binding interaction constraint. Thus, the binding interaction constraint method is easy to implement, high in interaction precision, high in stability and higher in experience feeling in a virtual scene, more conforms to the virtual environment immersion characteristic, and solves thebinding interaction constraint problem of the human body mapping posture body and the virtual rotating body.

The invention relates to a skiing simulator. The skiing simulator comprises a mounting seat body and a control device; a sliding rail device, a handrail device, a pedal assembly and a driving device are arranged on the mounting seat body; the extension direction of a sliding rail of the sliding rail device is arranged along the transverse direction of the mounting seat body; the pedal assembly is in sliding fit with the sliding rail device; the driving end of the driving device acts on the pedal assembly to slide on the sliding rail device; the pedal assembly comprises a buffering device, a limiting device, a sliding base and a pedal device; the sliding base is in sliding fit with the sliding rail device; the pedal device is in rotating fit with the sliding base; the limiting device is used for limiting the rotating angle of the pedal device; the buffering device is arranged between the pedal device and the sliding base; and the control device is electrically connected with the driving device. Compared with a bent arc-shaped structure, the mechanical structure of the skiing simulator is simpler, better meets the movement habit of horizontal left-right sliding and brights more real experience.

The invention discloses a nuclear radiation environment scene construction and man-machine interaction method based on VR. The method comprises the following steps: calibrating a sensor; acquiring scene information in a nuclear radiation environment to generate a dense three-dimensional point cloud map; generating a three-dimensional scene model and a map through a three-dimensional curved surface reconstruction algorithm; fusing the nuclear radiation information to the three-dimensional scene map; modeling the robot in Unity 3D to obtain a virtual robot model; importing the three-dimensional scene model and the chartlet into Unity 3D, and optimizing the whole virtual scene in the Unity 3D; displaying the virtual scene and related parameters in unity 3D; and the robot entering the environment again to realize repositioning and real-time interaction. The VR-based nuclear radiation environment scene construction and man-machine interaction method provided by the invention has the characteristic of quickly and accurately modeling the nuclear radiation environment and a more immersive interaction mode, and can effectively deal with the tasks of emergency, maintenance, decommissioning and the like in the nuclear radiation environment.

The invention relates to the technical field of office supplies for daily use, especially relates to a conference table and particularly relates to a conference table facilitating a remotely-held video conference. The conference table comprises a platform body with a plurality of support legs, wherein the platform body connected with a power supply is divided into a front platform body and a rear platform body; a connecting body is arranged between the front platform body and the rear platform body and is arranged in an inclined plane form; one end of the rear platform body is capable of being connected with a display I provided with a camera; and a display II capable of facilitating view is arranged under the front platform body. The conference table provided by the invention has the advantages that the platform body is divided into the front platform body and the rear platform body which have a certain height difference, and by virtue of the video visual angles of the displays, a favorable stereoscopic effect can be realized, and the advantages of being personally on the scene and the like can be achieved.

The invention discloses an anger aggression intervening method based on a methamphetamine addict. The method comprises the following steps of establishing a virtual reality environment with competitive competitions; after multiple continuous competitive competitions, exciting anger emotion of a tested person; after excitation of anger, enabling the tested person to enter a first roll of anger aggression test phase; before each competition, enabling the tested person to preset the awarding and punishing class of each competition; according to the competition result, enabling a loser to receive the punishing preset by a winner, so as to complete all preset competitive competitions; setting the emotion intervening environment; after the tested person completes the competitive competitions, enabling the tested person to enter the emotion intervening environment to take a rest; after the emotion of the tested person is relaxed, enabling the tested person to walk out of the emotion intervening environment, and performing intervention evaluating on the anger aggression of the tested person. The method has the advantage that by bringing the tested person into the virtual reality environment, and to enter the emotion intervening environment after the anger aggression is tested, the tested person can quickly adjust the anger emotion, so as to reach the purposes of relaxing the emotion of the methamphetamine addict and reducing the anger aggression, and avoid the side effect caused by medicines.

The invention provides a 3D based hospital sensing control simulation training examination system, which comprises an application layer, a platform layer, a transmission layer and a sensing layer; the sensing layer uses various terminals to acquire data, the data are transmitted to different platforms for processing through the transmission layer, and the terminals comprise VR equipment, a sensor of a 3D human body model and a camera; the transmission layer is used for providing the data acquired by the sensing layer to the application layer and the platform layer for reliable transmission; the platform layer is used for performing big data analysis of training and assessment, personnel identity information management and system background evaluation management; and the application layer is used for calculating, processing and mining the data acquired by the sensing layer so as to realize real-time control and accurate management of the system. According to the invention, a more effective informatization technical means is utilized, so that the training mode is more flexible, the training effect is more ideal, and many difficulties of the previously proposed sense control training examination can be solved. The system enables hospitals to play a greater role under the current large prevalence background of new coronal pneumonia.