433results about How to "Improve immersion" patented technology

The invention provides a digital factory operation virtual simulation teaching method and system, and relates to the technical field of smart factories, and the method comprises the steps: collecting factory operation data, carrying out the standardization processing and correlation analysis, constructing a multi-dimensional data model, carrying out the feature extraction and semantic mining of the hierarchical data of each dimension, and constructing a multi-level digital twin factory model. Carrying out dynamic modeling, constructing a personalized knowledge graph, generating a learning demand list, matching the learning demand list with a digital twin factory model, and generating a multi-dimensional simulation environment; in the multi-dimensional simulation environment, performing analysis and intention recognition on an operation instruction of the learner, converting the operation instruction into a virtual operation, calculating a normative score of the virtual operation, generating corresponding feedback information based on the normative score and the personalized knowledge graph, updating model parameters based on a response of the learner to the feedback information, and performing simulation on the learner according to the updated model parameters. And completing iteration of the model.

The invention relates to the technical field of multimedia interaction, in particular to an intelligent interaction control method and system for digital exhibition hall multimedia equipment, and the method comprises the following steps: S1, carrying out the arrangement of a sensor, and carrying out the intelligent sensing and data collection; s2, generating an intelligent interaction strategy; s3, equipment cooperative control and execution; and S4, performing real-time feedback and system optimization. According to the method, user behaviors and environment data are collected in real time through the multi-modal sensor, user requirements are accurately speculated in combination with a deep learning algorithm, the optimal interaction strategy and task priority are generated, individuation and interaction efficiency of user experience are remarkably improved, multi-device cooperation is optimized through distributed task scheduling, and user experience is improved. According to the method, display content and environment parameters are dynamically adjusted, self-optimization of the system is realized by utilizing user feedback, real-time performance, smoothness and reliability of interactive experience of the exhibition hall are ensured, rapid fault response and accurate maintenance demand prediction are realized through anomaly detection and equipment log analysis, and the stability and sustainability of operation of the exhibition hall system are greatly improved.

The invention provides an image rendering method and device, electronic equipment and a storage medium, and the method comprises the steps: calculating a distance between a virtual image obtaining device and a to-be-rendered object through determining the to-be-rendered object in a to-be-rendered scene, and determining the distance as a first loading factor; determining a rendering picture pixel proportion of each to-be-rendered object based on preset view cone size information, determining the rendering picture pixel proportion as a second loading factor, generating a rendering loading priority sequence according to the first loading factor, and determining a model level resource file and a texture level resource file according to the second loading factor, loading the resources to a video memory for rendering according to the sequence; the priority is determined by calculating the distance between the camera and the to-be-rendered object, it is ensured that a high-quality model and texture of a close-range object are loaded preferentially, the instantaneity of the rendering loading process is improved, texture and model grade division is conducted through the pixel proportion of the to-be-rendered object in the picture, and the rendering efficiency is improved. The occupation of a video memory is reduced, and the overall rendering performance of the system is improved.

The invention relates to a light control method and system based on a holographic interactive projection technology, and the method comprises the steps: projection region recognition, user interaction detection, light parameter calculation and light real-time regulation and control, the projection region recognition, scanning of a target region through a holographic projection device and a depth induction sensor, and generation of a three-dimensional space model of an environment; a motion capture device and a deep learning algorithm are used for carrying out real-time recognition on gestures or motions of a user, interaction intentions and priority ranking are generated, a holographic projection device is used for generating a three-dimensional environment model, the motion capture device recognizes the intentions of the user, and an illumination optimization model is used for calculating regulation and control parameters; and the output of the light equipment is dynamically adjusted, so that high-precision and intelligent light control is realized, and the problems that a traditional light control method is insufficient in environment perception capability, lacks a user interaction mode, is limited in flexibility and adaptability of light regulation and control, and lacks a multi-module cooperative working mechanism are solved.

The invention discloses an immersive space virtual-real interaction method and system based on element universe, and relates to the technical field of brain-computer interfaces, and the method comprises the steps: capturing an electroencephalogram signal of a user, and obtaining brain wave data of the user in real time; transmitting the brain wave data to a neural feedback adaptive network for analysis, and generating a corresponding interaction intention; virtual environment elements in the meta universe are adjusted in real time according to the interaction intention; the physical environment of the user is monitored in real time, physical environment parameters are obtained, the physical environment parameters are compared with the virtual environment elements, and bidirectional synchronous adjustment is carried out; dynamically adjusting sensory elements in the virtual environment elements by utilizing electroencephalogram resonance based on the electroencephalogram signal of the user and the synchronized physical environment parameters; through bidirectional synchronous adjustment of the physical environment parameters and the virtual environment elements, high consistency between the virtual environment and the physical environment of the user is ensured, and the immersion and authenticity experience of the user are greatly improved.

A video perspective method based on virtual reality relates to the technical field of virtual reality, and comprises: at least two cameras for capturing video information in real time, the cameras being provided with spatial positions and angles; performing geometric correction on the video information; the eye movement tracking module monitors the gazing direction of the eyes of the user in real time and adjusts the display position; the eye movement tracking module tracks eyeball movement; reconstructing a three-dimensional model of the surrounding environment of the user; based on the three-dimensional model, determining a relative position relationship between the virtual object and the real object; the head posture sensor obtains head movement information of a user; performing semantic segmentation on the video frame through a deep learning algorithm; and synthesizing the video information and the virtual content on the head-mounted display device, and outputting the synthesized video information and virtual content. The technical problems of visual discomfort and dizziness caused by position mismatching can be solved, and natural fusion of a real scene and a virtual scene is realized.

The invention discloses a simulator control logic and filter adjustment combined vehicle simulation washout algorithm, which relates to the technical field of vehicle simulation washout algorithms, and comprises the following steps: S1, initialization: generating a time sequence, defining the size of a sliding window, and initializing input parameters and a state structure body; s2, initial data reading: firstly taking the acceleration of the vehicle from the driving simulation software, reading the angular velocity, the velocity and the rotating speed of an engine, then reading the attitude and position data, and storing the data; according to the invention, the motion of the platform can be controlled more quickly and accurately so as to improve the fidelity and response consistency of a motion signal, and meanwhile, the parameter adjustment process of the filter is optimized, so that the filter can be dynamically adjusted according to the stroke ranges of different motion platforms, the application range of a simulation system is expanded, and full application of the motion platforms is realized.

The invention relates to the technical field of intelligent teaching, in particular to an intelligent teaching system for traditional Chinese medicine clinical skill cultivation. The system comprises a virtual reality simulation module, an operation interaction module, an operation data analysis module, an adaptive learning feedback module and a teaching evaluation module. The virtual reality simulation module constructs a vivid traditional Chinese medicine skill training scene through three-dimensional modeling, ray tracing and physical simulation technologies, and the vivid traditional Chinese medicine skill training scene covers pulse feeling, acupuncture and moxibustion, massage and other operations. The operation interaction module collects user operation data and extracts features in combination with a variational auto-encoder. The operation data analysis module analyzes user operation deviation by using a graph neural network and a generative adversarial network, the adaptive learning feedback module generates a personalized learning strategy, and the teaching evaluation module evaluates a learning effect through fuzzy evaluation and analytic hierarchy process. According to the invention, intelligence, individuation and high efficiency of traditional Chinese medicine clinical skill cultivation are realized, the fidelity of teaching and the accuracy of feedback are improved, and the skill level and the training effect of learners are also improved.

The invention discloses an environment adaptive meta-universe scene perception system and method, and belongs to the technical field of data transmission, and the method specifically comprises the steps: collecting and preprocessing multi-dimensional environment and sensory data in a meta-universe scene in real time through a sensor array, and constructing a full sensory environment data set; radar scanning and depth camera technologies are utilized to accurately obtain three-dimensional information of a physical environment, and a super-reality three-dimensional model is established to simulate a complex ecological system and environment characteristics of the physical world; in combination with real-time full-sensory environment data, an intelligent algorithm is adopted to dynamically adjust meta-universe scene elements, a user behavior prediction technology is introduced, scene layout and an interaction mode are intelligently adjusted according to user history and current states, and user experience is improved; user feedback is collected through VR immersive interaction, a scene perception method is evaluated, and iterative optimization is implemented according to an evaluation result so as to continuously improve the sense of reality and interactivity of the meta-universe scene; and efficient construction and intelligent management of the meta universe scene are realized.

The invention discloses an emotional pressure relieving and monitoring method combined with a virtual reality technology, and the method comprises the following steps: S1, providing a virtual environment for a user through a virtual reality device, and enabling the user to interact with the environment through wearing a virtual reality head-mounted device and using a controller; s2, collecting physiological data of the user in real time through a biosensor, wherein the physiological data comprises heart rate, brain wave, electrodermal response and oxyhemoglobin saturation; s3, inputting the physiological data in the S2 into a long-short-term memory network model for processing, and predicting emotional changes; s4, adjusting the virtual reality environment in real time to adapt to the current emotional state of the user based on the emotional state analysis and prediction result of the long-short-term memory network model; and S5, repeating the steps S2 to S4 to monitor the emotion of the user. According to the method, solid technical support is provided for emotion pressure management and monitoring based on the virtual reality technology, and a traditional static emotion regulation method can be effectively replaced.

The invention discloses a mobile game scene interaction intelligent optimization method based on a generative adversarial network, and aims to improve the game experience of players. Comprising the following steps: S1, collecting behavior data and interaction information of a player in a mobile game, and generating a preliminary behavior feature model; s2, constructing a generative adversarial network model; s3, generating diversified game scene interaction examples according to the trained generator; s4, evaluating and optimizing the generated scene interaction example by using a discriminator; s5, real-time feedback of the player is received, and the behavior feature model of the player is updated; s6, dynamically adjusting a generation strategy based on the updated behavior feature model, and optimizing a scene interaction effect; s7, environment data are integrated, scene interaction is optimized in real time, and the immersion of players is enhanced; and S8, providing user-defined scene interaction options for the players, and allowing the players to adjust according to personal preferences. The interactive experience and game fun of players can be effectively improved.

The invention provides a digital human control method and device based on multiple modes and electronic equipment, and relates to the technical field of data processing. In the method, voice data, facial expression data and body movement data of a user are acquired, and the user interacts with a digital human; performing semantic analysis on the voice data by adopting a Transform model to obtain an emotional state and a language habit corresponding to the user; performing feature extraction on the facial expression data by adopting a convolutional neural network model to obtain a facial expression type corresponding to the user; performing action analysis on the limb action data by adopting a hidden Markov model to obtain effective action features corresponding to the user; generating a fusion result based on the emotional state, the language habit, the facial expression type and the effective action features; and adjusting the multi-modal output corresponding to the digital human according to the fusion result. By implementing the technical scheme provided by the invention, the interaction experience feeling of the user can be improved.

The invention discloses an intelligent digital human training method and system based on multi-modal interaction, and relates to the technical field of digital human training, and the method comprises the steps: designing a touch feedback strategy, and defining the output corresponding to a digital human according to different touch information; converting the voice input into a text; generating a natural language reply; converting into digital human voice output by using a voice synthesis technology; capturing dynamic characteristics of the motion and converting the dynamic characteristics into actions of a digital human; identifying and extracting facial feature points, and constructing a facial model of the digital human; analyzing relative positions and motions of the facial feature points, and mapping the relative positions and motions to a facial model of the digital human; aligning the time sequence of the audio with the lip movement track of the digital human; constructing a basic character model; analyzing intention and emotion input by the user in real time; a comprehensive corresponding strategy is generated, and actions, facial expressions, voices and appearance feedback which should be taken by the digital person in the current situation are determined.

The invention discloses a knowledge-guided visual simulation method for a railway bridge construction process, belongs to the field of railway bridge construction, and solves the problems that the railway bridge construction process in the prior art relates to many elements, is difficult in relation capture, is not clear in behavior state description, is continuously iterated and updated along with the promotion of the construction process, is complex in environment change, and is poor in reliability. And the incidence relation between the bridge main body model and the visual simulation environment is difficult to establish. The method comprises the following steps: acquiring railway bridge construction data including GIS data, field data and construction data; constructing an entity-process-behavior three-domain associated railroad bridge construction scene knowledge graph based on the obtained railroad bridge construction data; and performing knowledge-guided dynamic visual simulation of the railway bridge construction process based on the railway bridge construction scene knowledge graph. The method is used for visual simulation of the railway bridge construction process.

The invention discloses a display method and device based on a capacitive touch screen and electronic equipment, and relates to the field of data processing. The method comprises the following steps: acquiring user touch data and screen content; performing feature extraction on the screen content to obtain screen content features; determining a current working mode according to the user touch data and the screen content characteristics; matching a first display parameter corresponding to the current working mode in a preset display parameter database; predicting a future working mode according to the user touch data and the current working mode; matching a second display parameter corresponding to the future working mode in a preset display parameter database; and smoothly adjusting the first display parameter to a second display parameter through a gradual change mode, and determining to display second display content corresponding to the future working mode through the second display parameter. By implementing the technical scheme provided by the invention, automatic adjustment of the display parameters is realized by judging the current working mode and predicting the future working mode, and the experience feeling of a user is improved.

The invention discloses an intelligent directional and quantitative smell generation method in virtual reality olfaction interaction, and relates to the technical field of virtual reality. The invention provides an intelligent, directional and quantitative smell generation method in order to solve the technical problems that in smell generation work in virtual reality in the prior art, the variety and generation precision of smell are limited, an accurate smell concentration control mechanism is lacked, and interactive linkage with user actions and a virtual environment is lacked. In combination with an odor molecule dynamic combination technology, a deep learning prediction model, closed-loop concentration control and a spatial orientation transmission system, richer, personalized and immersive olfactory interaction experience is provided. Comprising a smell synthesis module, a digital smell control unit, an intelligent smell prediction model, a directional smell transmission system and a virtual wind field simulation module. The method is suitable for being applied to the work of intelligent directional and quantitative smell generation in virtual reality olfaction interaction.

The embodiment of the invention provides a sound effect control method and device and computing equipment. The sound effect control method comprises the steps that a scene picture to be controlled is divided into at least two scene areas; in response to a sound effect control event of a target scene region, determining region content information of the target scene region, and determining a target sound effect parameter of the target scene region according to the region content information, the target scene region being any one of the at least two scene regions; and controlling the sound effect of the target scene area according to the target sound effect parameter of the target scene area. Regional division is carried out on a scene picture to be controlled, sound effects of different scene regions are independently regulated and controlled, different sound effects are allowed to be played in different scene regions, the layering sense and dynamic expressive force of the sound effects are improved, dynamic sound effect control is achieved based on region content information of scene dynamic change, and the user experience is improved. The sound effect in a complex scene is prevented from being disjointed with an actual scene, and the control effect of the sound effect is improved.

The invention relates to the technical field of man-machine interaction and tactile rendering, in particular to a virtual friction tactile rendering method and device based on micro-current stimulation, and the method comprises the steps: obtaining friction tactile interaction information of a real object and hand action information of an interactor, and mapping the friction tactile interaction information and the hand action information to a virtual object and a virtual hand; defining friction interaction states of the virtual hand and the surface of the virtual object, and designing a tactile feedback array which provides corresponding stimulation modes for different friction interaction states; when the virtual hand starts to make contact with the surface of the virtual object, the stimulation mode is converted into the contact mode; when the virtual hand starts to slide on the surface of the virtual object, the stimulation mode is converted into a sliding mode; when the virtual hand leaves the surface of the virtual object, the stimulation mode is converted into a separation mode; an interactor perceives real surface information of various objects from three feedback channels of audio-visual touch through friction interaction processes of contact, sliding, separation and the like in a virtual scene, and immersive interaction experience is realized. The reality sense and immersion sense of the virtual friction touch sense are improved.

The invention discloses an ancient building protection display method and system based on virtual reality, and the method comprises the steps: obtaining user position coordinates and orientation angle data collected by a high-precision position tracking sensor in real time, mapping the data to a corresponding position of a virtual scene, dynamically updating a visual angle in the virtual scene according to the movement and steering of a user, and displaying the visual angle in the virtual scene. The immersive experience of being personally on the scene is realized; a physical rendering technology is adopted to carry out vivid simulation on illumination, materials, textures and the like of the virtual scene, and through technologies of pre-calculation of an illumination map, environment shielding and the like, the real-time rendering calculation amount is reduced, and the rendering efficiency and the visual quality of the virtual scene are improved; various displacement interaction modes including traditional rocker movement, gesture control, body inclination and the like are designed, operation habits of different users are met, user interaction behaviors are analyzed and modeled through a machine learning algorithm, interaction parameters and response modes are adjusted in a self-adaptive mode, and personalized displacement interaction experience is provided.

The invention discloses a virtual digital human interactive question and answer method, system and device and a storage medium, and relates to the field of virtual reality. The method comprises the following steps: carrying out first processing on dialogue content of a user, and carrying out second processing on a facial image of the user to obtain a first emotional state; performing third processing on the text after the first processing to obtain a second emotional state of the user, and determining a target emotional state in combination with the first emotional state and the second emotional state; performing fourth processing on the text after the first processing based on a deep learning model to generate a first answer, and adjusting an expression mode of the first answer according to the target emotional state and the dialogue context to generate a second answer; and constructing a virtual digital person by using a virtual reality technology, and determining the facial expression, the body movement and the voice intonation of the virtual digital person according to the emotional tendency in the second answer to display the second answer. By implementing the technical scheme provided by the invention, the emotional state of the user can be identified more accurately, and then the answer more conforming to the emotion of the user is generated.

The invention discloses a digital human personalized shaping method and device based on user psychology and a medium. The method comprises the following steps: acquiring multi-modal data when a user interacts with a digital human; based on the multi-modal data, according to the style preference of the user, establishing a psychological feature model through an adaptive learning mode; dialogue voice of the digital person is generated according to the psychological feature model, and matched facial expressions and limb actions of the digital person are generated according to the dialogue voice and the psychological features of the user. According to the digital human personalized shaping method and device based on the psychology of the user and the medium, the psychological feature model is established based on the style preference of the user, and the interaction content matched with the conversation voice, the facial expression and the body movement is generated, so that the digital human can show more real and natural personalized behaviors, and the user experience is improved. The problem that it is difficult to carry out personalized behavior shaping on the digital human according to psychological characteristics and interaction preferences of the user can be solved.

The invention provides a real-time rendering method for an augmented reality game, and relates to the field of three-dimensional reconstruction, and the method comprises the steps: obtaining the rendering scene description of a game object in a three-dimensional model; generating a rendering fusion feature of the game object according to the rendering scene description, and performing subdivision detection on the rendering fusion feature to obtain a texture element index of the game object in the virtual object model; determining a target scene rendering image of the game object in the rendering coloring model, and determining a rendering embedding identifier corresponding to the target rendering range according to the target scene rendering image; determining a rendering structure level of the game object in the target rendering area according to the reference pose information, and determining a rendering interaction attribute of the game object during rendering task distribution according to the rendering structure level and the texture element index; the game object is rendered in real time according to the rendering embedded identifier and the rendering interaction attribute, and the game scene is generated, and the real-time rendering performance of the augmented reality game can be improved under the influence of visual dislocation generated by the compatible rendering effect.

The invention relates to an intelligent glasses control method and system based on multi-modal privacy protection, and the method comprises the steps: collecting multi-modal sensory data of a user, carrying out the preprocessing of the multi-modal sensory data, and generating sensory sharing data; analyzing the sensory shared data by using a multi-modal privacy feature extraction algorithm to generate a privacy feature vector; classifying and identifying the privacy feature vectors based on a multi-layer privacy judgment rule to obtain a judgment result; performing data processing based on processing logic in the multi-layer privacy decision rule to generate shared data after privacy protection processing; storing the shared data subjected to privacy protection processing to a cloud end, retrieving the corresponding shared data subjected to privacy protection processing from the cloud end according to the sharing demand information of the target equipment, and encrypting the shared data to generate encrypted shared data; and decrypting and reconstructing the encrypted shared data in the target equipment to generate shared display data. The method has the effect of improving the accuracy of identifying the privacy data of the intelligent glasses.

The invention relates to the technical field of seawater desalination, in particular to a seawater desalination reverse osmosis membrane, a preparation method and application. The seawater desalination reverse osmosis membrane is prepared by the preparation method. The preparation method comprises the following steps: immersing the prepared support layer into a water phase solution, and then taking out the support layer adsorbing the water phase solution; immersing the support layer adsorbing the water phase solution into a first oil phase solution, and forming a primary reverse osmosis membrane through a first interfacial polymerization reaction; then, taking out the primary reverse osmosis membrane, and carrying out first drying treatment under a steam condition; and immersing the primary reverse osmosis membrane into a second oil phase solution, and carrying out a second interfacial polymerization reaction to form the seawater desalination reverse osmosis membrane. The application refers to the application of the reverse osmosis membrane for seawater desalination in the aspects of reclaimed water reuse, seawater desalination and brackish water desalination. According to the invention, the seawater desalination reverse osmosis membrane which simultaneously meets high desalination rate and high water flux can be prepared.

The invention relates to a digital human personalized emotion interaction method, which belongs to the technical field of emotion calculation, and comprises the following steps: S1, carrying out emotion quantification on interaction input of a user to obtain a pleasure-wake-dominate PAD emotion value in a continuous dimension space; s2, performing emotion state evaluation on the user interaction input emotion to obtain an interaction input emotion evaluation function; s3, calculating a digital human emotion transition probability matrix by using a Bayesian network; s4, calculating an emotional response calculation value of the digital human character corrected by the big five-factor model in the current emotional state; s5, the corrected emotion response passes through an emotion influence factor matrix, and a response with complex emotion features is output; and S6, performing PAD emotional space coordinate calibration on the emotional intensity of the digital person on the six basic emotions to obtain an emotional response of the digital person.

The invention provides a deep learning defect identification system and method based on simulation generation of a simulation data set. The system comprises a defect model generation module, a virtual three-dimensional CT module and a defect identification deep learning module. The defect model generation module is used for generating a defect-containing CAD model; the virtual three-dimensional CT module is used for performing CT scanning and reconstruction on the CAD model; the defect recognition deep learning module is used for marking CT sectional images and using marked data for network training, the problem that an X-ray image data set is insufficient is solved, and the method is safe, rapid and independent of equipment; the problem of inaccurate marking in deep learning defect identification is also solved, and the defect identification precision of the deep learning module obtained by training is improved.

The invention discloses an online fire-fighting training simulation training system and a training method thereof. The system comprises a sensing module, a virtual environment module, an interaction and feedback module and a learning recording and suggestion module. According to the invention, multiple sensory experiences such as smell, temperature, wind feeling and the like are comprehensively introduced into fire-fighting simulation training, the limitation that a traditional VR / AR system purely depends on vision and hearing is broken, the sense of reality and immersion of training are greatly improved, and the coping ability of students in a real fire scene is effectively improved; the state of a trainee is analyzed in real time through an AI algorithm, a self-adaptive threshold intervention mechanism is combined, a virtual AI coach can provide dynamic and personalized guidance in different training scenes, and intelligent intervention based on real-time data greatly improves the fire-fighting training effect; the system not only pays attention to the short-term training effect of the student, but also makes a personalized continuous learning plan through the learning recording and suggestion module, and promotes the long-term progress of the student.

The embodiment of the invention provides a digital human interaction video generation method and interaction equipment. According to the method, after a generation device obtains a target voice, a basic video and a mouth shape image set can be obtained from a pre-constructed material library, a target mouth shape image sequence matched with the phoneme change condition in the target voice is generated based on the target voice and the mouth shape image set, and then the target mouth shape image sequence is obtained. And fitting the target mouth shape image sequence to the mouth area of the digital human in the basic video, thereby obtaining a target video.

The invention relates to the field of safety monitoring, in particular to an intelligent safety system and method based on operation guiding and monitoring of double unmanned aerial vehicles. The system comprises a front guiding unmanned aerial vehicle which is used for guiding an operator to go to next to-be-operated equipment according to preset operation steps and guiding the operator to follow by using a visual or sound signal; and the rear monitoring unmanned aerial vehicle is used for keeping a certain distance behind the operator, monitoring the position and behavior of the operator in real time, and triggering an alarm mechanism when the operator exceeds a preset guide range. According to the invention, the operator is guided to go to the next to-be-operated device through the front guiding unmanned aerial vehicle, the operator is guided to follow, the time waste of the operator for searching the target device is effectively reduced, and the working efficiency is improved. In addition, the real-time monitoring function of the rear monitoring unmanned aerial vehicle ensures that the operator is always on a safe and correct path, and extra time and resource consumption caused by deviation from a predetermined path is reduced.