38results about How to "Immersive" patented technology

The invention discloses a hand posture estimation method and system based on visual and inertial information fusion. The method comprises the following steps: (1) constructing a hand posture data set; (2) extracting features: performing visual information feature extraction on a color image acquired by AR glasses through a Resnet50 residual network to finally obtain an image feature vector; performing inertial information feature extraction by constructing a convolutional neural network to obtain an inertial information feature vector; connecting the image feature vector and the inertial feature vector to obtain a fused feature vector; (3) carrying out hand 2D attitude estimation; (4) performing hand 3D posture estimation; (5) carrying out network training and testing; and (6) deploying the trained hand posture estimation network model to AR glasses, and performing real-time hand posture estimation by calling a color camera and a data glove.

The invention discloses a local area network cooperation-based fully mechanized mining working face virtual monitoring method. The method comprises the steps of in a local area network environment, establishing a mirror image of a real fully mechanized mining working face in a virtual reality engine Unity3d environment; then collecting an actual working face in real time by data monitoring hosts and storing data in a working face database SQL SERVER 2008 in real time; reading the corresponding data in the database in real time by multiple data analysis servers located in different positions; performing processing through a pose calculation module and a prediction module and driving corresponding virtual reality devices in real time; mutually synchronizing the data at any time in a local area network cooperation manner through a C / S architecture by the hosts; synthesizing a panoramic image of the whole working face; and performing three-dimensional visual virtual monitoring on the real working face and performing analysis and prediction on historical data online. According to the method, the running state of the working face can be displayed in a three-dimensional, panoramic and real-time manner; a fully mechanized running prediction and early warning model is embedded in a background; the intuitive and visual fault diagnosis and prediction can be realized; and the technical support is provided for efficient and safe running of the fully mechanized mining working face.

The invention discloses a memory cutting method of a virtual coal cutter. The memory cutting method comprises the following steps: firstly generating a virtual top and base plate environment in a virtual reality engine Unity3d environment, then paving a virtual scraper conveyor on a virtual base plate as a track for the virtual coal cutter to operate, clicking the button of a virtual control panel to operate the virtual coal cutter, carrying out storage, analysis, processing and reading on operational data by a virtual controller in real time, and thus realizing memory cutting simulation for the coal cutter. According to the method, a new cutting technology algorithm can be quickly tested in different geological environments, and single-machine training of a coal cutter driver and concurrent operation of double persons can be realized.