Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

931results about How to "Improve immersion" patented technology

Digital factory operation virtual simulation teaching method and system

The invention provides a digital factory operation virtual simulation teaching method and system, and relates to the technical field of smart factories, and the method comprises the steps: collecting factory operation data, carrying out the standardization processing and correlation analysis, constructing a multi-dimensional data model, carrying out the feature extraction and semantic mining of the hierarchical data of each dimension, and constructing a multi-level digital twin factory model. Carrying out dynamic modeling, constructing a personalized knowledge graph, generating a learning demand list, matching the learning demand list with a digital twin factory model, and generating a multi-dimensional simulation environment; in the multi-dimensional simulation environment, performing analysis and intention recognition on an operation instruction of the learner, converting the operation instruction into a virtual operation, calculating a normative score of the virtual operation, generating corresponding feedback information based on the normative score and the personalized knowledge graph, updating model parameters based on a response of the learner to the feedback information, and performing simulation on the learner according to the updated model parameters. And completing iteration of the model.
Owner:YIKE SHUREN (SUZHOU) EDUCATION TECHNOLOGY CO LTD

Intelligent emotional interaction method for service robot

The invention relates to the technical field of intelligent robots, in particular to a service robot intelligent emotion interaction method, which comprises the following steps: acquiring emotion related data of a user through a multi-modal sensor on a service robot, analyzing the acquired data based on a deep learning model, and extracting emotion features of the user; future emotion changes are predicted through a time sequence analysis algorithm, a service robot generates a personalized interaction strategy through an emotion decision-making system according to the current and predicted emotion states, and the system adopts a self-adaptive algorithm based on reinforcement learning, so that the interaction strategy can be continuously optimized along with the emotion changes of a user; the robot performs modeling and optimization on long-term interaction data by utilizing a self-learning mechanism in combination with emotional feedback of the user, so that the precision and interaction effect of emotional response are gradually improved; according to the method, the problems of inaccurate emotion recognition, inflexible interaction strategy and lack of adaptive optimization in the prior art are effectively solved, and the interaction experience of the service robot and the user is remarkably improved.
Owner:BEIJING HAIBAICHUAN TECH CO LTD

Digital exhibition hall multimedia equipment intelligent interaction control method and system

The invention relates to the technical field of multimedia interaction, in particular to an intelligent interaction control method and system for digital exhibition hall multimedia equipment, and the method comprises the following steps: S1, carrying out the arrangement of a sensor, and carrying out the intelligent sensing and data collection; s2, generating an intelligent interaction strategy; s3, equipment cooperative control and execution; and S4, performing real-time feedback and system optimization. According to the method, user behaviors and environment data are collected in real time through the multi-modal sensor, user requirements are accurately speculated in combination with a deep learning algorithm, the optimal interaction strategy and task priority are generated, individuation and interaction efficiency of user experience are remarkably improved, multi-device cooperation is optimized through distributed task scheduling, and user experience is improved. According to the method, display content and environment parameters are dynamically adjusted, self-optimization of the system is realized by utilizing user feedback, real-time performance, smoothness and reliability of interactive experience of the exhibition hall are ensured, rapid fault response and accurate maintenance demand prediction are realized through anomaly detection and equipment log analysis, and the stability and sustainability of operation of the exhibition hall system are greatly improved.
Owner:ZHEJIANG KUAIBU CULTURE TECH CO LTD

Mixed reality multi-person interaction large-space positioning, aligning and collaborating system and method

The invention relates to the technical field of mixed reality, in particular to a mixed reality multi-user interaction large-space positioning, aligning and collaborating system and method, and aims to solve the problems that in the prior art, the user interaction experience is improved only by collecting multi-aspect data for processing, efficient collaboration work of multiple users in a large space cannot be achieved, and the user experience is poor. Information sharing, task distribution and real-time interaction among users cannot be realized; information sharing, task distribution and real-time interaction among users are realized through the multi-user cooperation module, cross-device operation consistency is ensured through a multi-device sharing coordinate system, configuration is simplified, cooperation efficiency is improved, real-time data transmission is realized through multi-device network synchronization, delay is reduced, cooperation fluency is enhanced, and user experience is improved. The interaction reality sense is enhanced through physical interaction logic synchronization, the working process is optimized, and the cooperation experience is improved.
Owner:GUANGZHOU FIRECUBE DIGITAL TECH CO LTD

Wattle wound teaching and training system based on MR technology

The invention discloses a war wound teaching and training system based on an MR technology, and the system comprises a model library construction module which is used for constructing a wound model library and a medical knowledge base, and obtaining the incidence relation between wounds and treatment means based on the wound model library and the medical knowledge base; the training system construction module is used for designing a virtual reality training system online platform by adopting a micro-service architecture; the training module is used for training according to the online platform of the virtual reality training system and obtaining a comprehensive training score according to training data; the comprehensive evaluation module is used for obtaining student operation data, obtaining the level value of each key step of the student according to the student operation data, and updating a student training plan based on the level value and the training comprehensive score. The advanced MR technology and the artificial intelligence algorithm are applied to war wound teaching training, so that the learning efficiency and the operation skills of students are improved, the safety and the practicability of training are enhanced, and the method has important significance in improving the quality of war wound treatment training.
Owner:THE 980TH HOSPITAL OF THE CHINESE PEOPLES LIBERATION ARMY JOINT LOGISTICS SUPPORT FORCE

Image rendering method and device, electronic equipment and storage medium

The invention provides an image rendering method and device, electronic equipment and a storage medium, and the method comprises the steps: calculating a distance between a virtual image obtaining device and a to-be-rendered object through determining the to-be-rendered object in a to-be-rendered scene, and determining the distance as a first loading factor; determining a rendering picture pixel proportion of each to-be-rendered object based on preset view cone size information, determining the rendering picture pixel proportion as a second loading factor, generating a rendering loading priority sequence according to the first loading factor, and determining a model level resource file and a texture level resource file according to the second loading factor, loading the resources to a video memory for rendering according to the sequence; the priority is determined by calculating the distance between the camera and the to-be-rendered object, it is ensured that a high-quality model and texture of a close-range object are loaded preferentially, the instantaneity of the rendering loading process is improved, texture and model grade division is conducted through the pixel proportion of the to-be-rendered object in the picture, and the rendering efficiency is improved. The occupation of a video memory is reduced, and the overall rendering performance of the system is improved.
Owner:CISDI ENGINEERING CO LTD +1

Live broadcast method and device for free matching combined type e-commerce operation

The invention discloses a live broadcast method and device for free matching combined e-commerce operation, and the method comprises the steps: S1, collecting and analyzing user data, and building a user portrait; s2, based on the user portrait and the real-time behavior data, generating and dynamically updating a personalized commodity recommendation list; s3, in the live broadcast process, the anchor displays a commodity combination effect and provides a real-time interaction function; s4, virtual reality and augmented reality technologies are adopted to realize virtual commodity display and trial; s5, analyzing the real-time behavior data of the user by using an improved collaborative filtering algorithm, and recommending related commodities; s6, analyzing the emotional tendency of the user in interaction by adopting a multi-modal fusion emotion analysis algorithm, and providing personalized interaction suggestions for the anchor; and S7, providing an integrated online shopping function, and supporting the user to seamlessly complete the purchase operation. Through the technical steps, the personalized shopping experience of the user is improved, the live broadcast interactivity is enhanced, and the method has the beneficial effects of high recommendation accuracy, strong participation sense of the user and the like.
Owner:BAOXIAN INFORMATION TECHNOLOGY (SHANGHAI) CO LTD

Light control method and system based on holographic interactive projection technology

The invention relates to a light control method and system based on a holographic interactive projection technology, and the method comprises the steps: projection region recognition, user interaction detection, light parameter calculation and light real-time regulation and control, the projection region recognition, scanning of a target region through a holographic projection device and a depth induction sensor, and generation of a three-dimensional space model of an environment; a motion capture device and a deep learning algorithm are used for carrying out real-time recognition on gestures or motions of a user, interaction intentions and priority ranking are generated, a holographic projection device is used for generating a three-dimensional environment model, the motion capture device recognizes the intentions of the user, and an illumination optimization model is used for calculating regulation and control parameters; and the output of the light equipment is dynamically adjusted, so that high-precision and intelligent light control is realized, and the problems that a traditional light control method is insufficient in environment perception capability, lacks a user interaction mode, is limited in flexibility and adaptability of light regulation and control, and lacks a multi-module cooperative working mechanism are solved.
Owner:WUXI LIGHTING

Immersive space virtual-real interaction method and system based on meta universe

The invention discloses an immersive space virtual-real interaction method and system based on element universe, and relates to the technical field of brain-computer interfaces, and the method comprises the steps: capturing an electroencephalogram signal of a user, and obtaining brain wave data of the user in real time; transmitting the brain wave data to a neural feedback adaptive network for analysis, and generating a corresponding interaction intention; virtual environment elements in the meta universe are adjusted in real time according to the interaction intention; the physical environment of the user is monitored in real time, physical environment parameters are obtained, the physical environment parameters are compared with the virtual environment elements, and bidirectional synchronous adjustment is carried out; dynamically adjusting sensory elements in the virtual environment elements by utilizing electroencephalogram resonance based on the electroencephalogram signal of the user and the synchronized physical environment parameters; through bidirectional synchronous adjustment of the physical environment parameters and the virtual environment elements, high consistency between the virtual environment and the physical environment of the user is ensured, and the immersion and authenticity experience of the user are greatly improved.
Owner:ZHONGYI INSTECH TECH CO LTD

Video perspective method based on virtual reality

A video perspective method based on virtual reality relates to the technical field of virtual reality, and comprises: at least two cameras for capturing video information in real time, the cameras being provided with spatial positions and angles; performing geometric correction on the video information; the eye movement tracking module monitors the gazing direction of the eyes of the user in real time and adjusts the display position; the eye movement tracking module tracks eyeball movement; reconstructing a three-dimensional model of the surrounding environment of the user; based on the three-dimensional model, determining a relative position relationship between the virtual object and the real object; the head posture sensor obtains head movement information of a user; performing semantic segmentation on the video frame through a deep learning algorithm; and synthesizing the video information and the virtual content on the head-mounted display device, and outputting the synthesized video information and virtual content. The technical problems of visual discomfort and dizziness caused by position mismatching can be solved, and natural fusion of a real scene and a virtual scene is realized.
Owner:QINGDAO VIRTUAL REALITY RES INST CO LTD

Interactive projection optimization method for exhibition hall

The invention relates to an interactive projection optimization method for an exhibition hall, and the method comprises the following steps: before projection is started, sensing the change of ambient light in the exhibition hall through a sensor, and evaluating the illumination conditions of different regions; acquiring a spatial layout in the exhibition hall by using a spatial modeling technology, and identifying wall surface and object shielding information of a projection area; gestures, actions and watching directions of audiences are captured in real time through a camera or infrared induction equipment; dynamically adjusting the projection content according to the action and position of the audience; comprising the following steps: when an audience approaches a certain exhibit, amplifying related projection content or switching to a detailed display mode; collecting behavior data of each audience including stopping time and interaction times of the audience in front of an exhibit; interest points of audiences are predicted through a machine learning model, and projection content related to audience interests is recommended; and adjusting the brightness and color parameters of each projector according to the actual projection area and content of each projection device.
Owner:北京三月雨文化传播有限责任公司

Vehicle simulation washout algorithm combining simulator control logic with filter adjustment

The invention discloses a simulator control logic and filter adjustment combined vehicle simulation washout algorithm, which relates to the technical field of vehicle simulation washout algorithms, and comprises the following steps: S1, initialization: generating a time sequence, defining the size of a sliding window, and initializing input parameters and a state structure body; s2, initial data reading: firstly taking the acceleration of the vehicle from the driving simulation software, reading the angular velocity, the velocity and the rotating speed of an engine, then reading the attitude and position data, and storing the data; according to the invention, the motion of the platform can be controlled more quickly and accurately so as to improve the fidelity and response consistency of a motion signal, and meanwhile, the parameter adjustment process of the filter is optimized, so that the filter can be dynamically adjusted according to the stroke ranges of different motion platforms, the application range of a simulation system is expanded, and full application of the motion platforms is realized.
Owner:HUKE INTELLIGENT TECH (SHANGHAI) CO LTD

Intelligent teaching system for traditional Chinese medicine clinical skill cultivation

The invention relates to the technical field of intelligent teaching, in particular to an intelligent teaching system for traditional Chinese medicine clinical skill cultivation. The system comprises a virtual reality simulation module, an operation interaction module, an operation data analysis module, an adaptive learning feedback module and a teaching evaluation module. The virtual reality simulation module constructs a vivid traditional Chinese medicine skill training scene through three-dimensional modeling, ray tracing and physical simulation technologies, and the vivid traditional Chinese medicine skill training scene covers pulse feeling, acupuncture and moxibustion, massage and other operations. The operation interaction module collects user operation data and extracts features in combination with a variational auto-encoder. The operation data analysis module analyzes user operation deviation by using a graph neural network and a generative adversarial network, the adaptive learning feedback module generates a personalized learning strategy, and the teaching evaluation module evaluates a learning effect through fuzzy evaluation and analytic hierarchy process. According to the invention, intelligence, individuation and high efficiency of traditional Chinese medicine clinical skill cultivation are realized, the fidelity of teaching and the accuracy of feedback are improved, and the skill level and the training effect of learners are also improved.
Owner:SOUTHWEST MEDICAL UNIV

Environment self-adaptive meta-universe scene sensing system and method

The invention discloses an environment adaptive meta-universe scene perception system and method, and belongs to the technical field of data transmission, and the method specifically comprises the steps: collecting and preprocessing multi-dimensional environment and sensory data in a meta-universe scene in real time through a sensor array, and constructing a full sensory environment data set; radar scanning and depth camera technologies are utilized to accurately obtain three-dimensional information of a physical environment, and a super-reality three-dimensional model is established to simulate a complex ecological system and environment characteristics of the physical world; in combination with real-time full-sensory environment data, an intelligent algorithm is adopted to dynamically adjust meta-universe scene elements, a user behavior prediction technology is introduced, scene layout and an interaction mode are intelligently adjusted according to user history and current states, and user experience is improved; user feedback is collected through VR immersive interaction, a scene perception method is evaluated, and iterative optimization is implemented according to an evaluation result so as to continuously improve the sense of reality and interactivity of the meta-universe scene; and efficient construction and intelligent management of the meta universe scene are realized.
Owner:JIANGXI ZHOUYUYUAN INFORMATION TECHNOLOGY CO LTD

Emotional pressure relieving and monitoring method combined with virtual reality technology

InactiveCN119523482ARealize real-time linkageGood mood regulation effectBiological modelsSensorsSimulationNetwork model
The invention discloses an emotional pressure relieving and monitoring method combined with a virtual reality technology, and the method comprises the following steps: S1, providing a virtual environment for a user through a virtual reality device, and enabling the user to interact with the environment through wearing a virtual reality head-mounted device and using a controller; s2, collecting physiological data of the user in real time through a biosensor, wherein the physiological data comprises heart rate, brain wave, electrodermal response and oxyhemoglobin saturation; s3, inputting the physiological data in the S2 into a long-short-term memory network model for processing, and predicting emotional changes; s4, adjusting the virtual reality environment in real time to adapt to the current emotional state of the user based on the emotional state analysis and prediction result of the long-short-term memory network model; and S5, repeating the steps S2 to S4 to monitor the emotion of the user. According to the method, solid technical support is provided for emotion pressure management and monitoring based on the virtual reality technology, and a traditional static emotion regulation method can be effectively replaced.
Owner:HUNAN VOCATIONAL COLLEGE OF LABOR & PERSONNEL

Mobile game scene interaction intelligent optimization method based on generative adversarial network

The invention discloses a mobile game scene interaction intelligent optimization method based on a generative adversarial network, and aims to improve the game experience of players. Comprising the following steps: S1, collecting behavior data and interaction information of a player in a mobile game, and generating a preliminary behavior feature model; s2, constructing a generative adversarial network model; s3, generating diversified game scene interaction examples according to the trained generator; s4, evaluating and optimizing the generated scene interaction example by using a discriminator; s5, real-time feedback of the player is received, and the behavior feature model of the player is updated; s6, dynamically adjusting a generation strategy based on the updated behavior feature model, and optimizing a scene interaction effect; s7, environment data are integrated, scene interaction is optimized in real time, and the immersion of players is enhanced; and S8, providing user-defined scene interaction options for the players, and allowing the players to adjust according to personal preferences. The interactive experience and game fun of players can be effectively improved.
Owner:BEIJING AIPULEI TECHNOLOGY CO LTD

Virtual tourism experience method based on large model

The invention provides a virtual tourism experience method based on a large model, and aims to provide personalized and immersive tourism experience by integrating advanced artificial intelligence and virtual / augmented reality technologies. The method comprises the following steps: firstly, collecting interest and preference information of a user, such as historical travel records, scenic spot preferences, travel time preferences, social media activities and the like, so as to capture detailed demands of the user; thirdly, generating personalized tourist routes and suggestions according to the information by utilizing a large-scale artificial intelligence model and combining deep learning and natural language processing technologies; in addition, the system renders scenic spots in a tour route in real time through a virtual reality or augmented reality technology, and the reality sense of vision and hearing is improved by applying advanced graphic and physical simulation technologies. And finally, an interactive interface is designed, so that the user can interact with the virtual tour guide through voice, text or gestures, more scenic spot information is obtained, a tour route is adjusted in real time, and the individuation and participation sense of user experience are greatly enhanced.
Owner:CHONGQING TECH & BUSINESS UNIV

AIGC-based aisle deduction system and use method thereof

The invention provides an AIGC-based (advanced integrated gasification control-based) aisle deduction system and a use method thereof, and belongs to the technical field of non-abandoned inheritance, and the AIGC-based aisle deduction system and the use method thereof are characterized in that the AIGC-based aisle deduction system and the use method thereof are provided; comprising a creativity input and planning module, a music and sound effect generation module, a visual design and rendering module, a performance synthesis and director module, an interactive experience and user feedback module and an education and culture transmission module, and the whole system comprises creativity excitation, content generation, user interaction and culture transmission. According to the method, a closed loop is formed, creation efficiency and viewing experience of the aisle art are improved, content is continuously iterated and optimized through intelligent analysis and an instant feedback mechanism, tight fit between works and audience requirements is ensured, the problems of low efficiency and market competitiveness in a traditional supply chain are effectively solved, and the method is suitable for popularization and application. And the live inheritance and development of the traditional cultural form of the aisle in the modern society are promoted.
Owner:任静仪

Digital human control method and device based on multiple modes and electronic equipment

The invention provides a digital human control method and device based on multiple modes and electronic equipment, and relates to the technical field of data processing. In the method, voice data, facial expression data and body movement data of a user are acquired, and the user interacts with a digital human; performing semantic analysis on the voice data by adopting a Transform model to obtain an emotional state and a language habit corresponding to the user; performing feature extraction on the facial expression data by adopting a convolutional neural network model to obtain a facial expression type corresponding to the user; performing action analysis on the limb action data by adopting a hidden Markov model to obtain effective action features corresponding to the user; generating a fusion result based on the emotional state, the language habit, the facial expression type and the effective action features; and adjusting the multi-modal output corresponding to the digital human according to the fusion result. By implementing the technical scheme provided by the invention, the interaction experience feeling of the user can be improved.
Owner:UNION MOBILE PAY

Three-dimensional animation production method based on AI deduction real-time rendering output

The invention relates to the technical field of three-dimensional animation production, and discloses a three-dimensional animation production method based on AI deduction real-time rendering output, which comprises the following steps: S1, motion capture: in a motion capture stage, in combination with an AI technology, carrying out real-time analysis and optimization on original motion capture data by using a deep learning algorithm, and through a human body posture estimation technology, carrying out real-time analysis and optimization on the original motion capture data; the motion of the human body can be more accurately captured, and facial expressions and emotion changes are captured in real time in combination with an emotion recognition algorithm, so that more real and vivid animation role performance is provided; by optimizing and simplifying the three-dimensional animation production method, the production difficulty is remarkably reduced, the time is shortened, the cost is reduced, and children 'animations generally require high-frequency animation updating and high-quality visual effect to attract and maintain the interest of small audiences. The AI technology is integrated for action capture and emotion recognition, so that expressions and actions of roles can be captured and optimized in real time, and the roles can be expressed more naturally and vividly.
Owner:LEKING NETWORK TECH (SHANGHAI) CO LTD

Intelligent digital human training method and system based on multi-modal interaction

The invention discloses an intelligent digital human training method and system based on multi-modal interaction, and relates to the technical field of digital human training, and the method comprises the steps: designing a touch feedback strategy, and defining the output corresponding to a digital human according to different touch information; converting the voice input into a text; generating a natural language reply; converting into digital human voice output by using a voice synthesis technology; capturing dynamic characteristics of the motion and converting the dynamic characteristics into actions of a digital human; identifying and extracting facial feature points, and constructing a facial model of the digital human; analyzing relative positions and motions of the facial feature points, and mapping the relative positions and motions to a facial model of the digital human; aligning the time sequence of the audio with the lip movement track of the digital human; constructing a basic character model; analyzing intention and emotion input by the user in real time; a comprehensive corresponding strategy is generated, and actions, facial expressions, voices and appearance feedback which should be taken by the digital person in the current situation are determined.
Owner:CHANGZHOU XIAOWEN INTELLIGENT TECH CO LTD

Flood routing simulation method and device based on digital twinborn scene and medium

The invention discloses a flood routing simulation method and device based on a digital twinborn scene and a medium, and aims at solving the problems that an existing flood simulation method depends on a complex physical model and a large number of computing resources, and when original DEM and DOM data are processed, the data size is huge, and the processing efficiency is low. The method comprises the following steps: constructing a digital twinborn scene based on digital elevation model data and digital orthophoto map data in an original flood data point set; adjusting data points in the original flood data point set through a data thinning technology to remove redundant data to obtain a target flood data point set; mapping coordinates in the target flood data point set into a digital twinborn scene, and generating a triangular mesh based on a polygon ear cutting method to obtain corresponding mesh data; and creating a flood material corresponding to the to-be-simulated flood routing area according to the grid data, and controlling a water surface effect corresponding to the to-be-simulated flood routing area in combination with the animation texture and the Fresnel node to realize flood routing simulation.
Owner:山东浪潮智水数字科技有限公司

Knowledge-guided visual simulation method for railway bridge construction process

The invention discloses a knowledge-guided visual simulation method for a railway bridge construction process, belongs to the field of railway bridge construction, and solves the problems that the railway bridge construction process in the prior art relates to many elements, is difficult in relation capture, is not clear in behavior state description, is continuously iterated and updated along with the promotion of the construction process, is complex in environment change, and is poor in reliability. And the incidence relation between the bridge main body model and the visual simulation environment is difficult to establish. The method comprises the following steps: acquiring railway bridge construction data including GIS data, field data and construction data; constructing an entity-process-behavior three-domain associated railroad bridge construction scene knowledge graph based on the obtained railroad bridge construction data; and performing knowledge-guided dynamic visual simulation of the railway bridge construction process based on the railway bridge construction scene knowledge graph. The method is used for visual simulation of the railway bridge construction process.
Owner:CHINA STATE RAILWAY GRP CO LTD +2

Display method and device based on capacitive touch screen and electronic equipment

The invention discloses a display method and device based on a capacitive touch screen and electronic equipment, and relates to the field of data processing. The method comprises the following steps: acquiring user touch data and screen content; performing feature extraction on the screen content to obtain screen content features; determining a current working mode according to the user touch data and the screen content characteristics; matching a first display parameter corresponding to the current working mode in a preset display parameter database; predicting a future working mode according to the user touch data and the current working mode; matching a second display parameter corresponding to the future working mode in a preset display parameter database; and smoothly adjusting the first display parameter to a second display parameter through a gradual change mode, and determining to display second display content corresponding to the future working mode through the second display parameter. By implementing the technical scheme provided by the invention, automatic adjustment of the display parameters is realized by judging the current working mode and predicting the future working mode, and the experience feeling of a user is improved.
Owner:SHENZHEN ZHENGTONG RENHE TECH CO LTD

Intelligent directional and quantitative smell generation method in virtual reality olfaction interaction

The invention discloses an intelligent directional and quantitative smell generation method in virtual reality olfaction interaction, and relates to the technical field of virtual reality. The invention provides an intelligent, directional and quantitative smell generation method in order to solve the technical problems that in smell generation work in virtual reality in the prior art, the variety and generation precision of smell are limited, an accurate smell concentration control mechanism is lacked, and interactive linkage with user actions and a virtual environment is lacked. In combination with an odor molecule dynamic combination technology, a deep learning prediction model, closed-loop concentration control and a spatial orientation transmission system, richer, personalized and immersive olfactory interaction experience is provided. Comprising a smell synthesis module, a digital smell control unit, an intelligent smell prediction model, a directional smell transmission system and a virtual wind field simulation module. The method is suitable for being applied to the work of intelligent directional and quantitative smell generation in virtual reality olfaction interaction.
Owner:HEILONGJIANG HUAZHONG TECH CO LTD

Sound effect control method and device and computing equipment

The embodiment of the invention provides a sound effect control method and device and computing equipment. The sound effect control method comprises the steps that a scene picture to be controlled is divided into at least two scene areas; in response to a sound effect control event of a target scene region, determining region content information of the target scene region, and determining a target sound effect parameter of the target scene region according to the region content information, the target scene region being any one of the at least two scene regions; and controlling the sound effect of the target scene area according to the target sound effect parameter of the target scene area. Regional division is carried out on a scene picture to be controlled, sound effects of different scene regions are independently regulated and controlled, different sound effects are allowed to be played in different scene regions, the layering sense and dynamic expressive force of the sound effects are improved, dynamic sound effect control is achieved based on region content information of scene dynamic change, and the user experience is improved. The sound effect in a complex scene is prevented from being disjointed with an actual scene, and the control effect of the sound effect is improved.
Owner:ZHUHAI KINGSOFT ONLINE GAME TECH CO LTD

Humanoid robot multi-modal interaction method and device based on large language model

The invention relates to a humanoid robot multi-mode interaction method and device based on a large language model, and the method comprises the steps: obtaining the voice of a user, and converting the voice into an original input text in response to a received user output voice command which is matched with a preset wake-up instruction of a humanoid robot; based on the original input text, generating a text matched with the current situation by utilizing a large language model, and for an output text corresponding to the text matched with the current situation, converting the output text into voice and outputting the voice; the method comprises the following steps: analyzing interaction contents of a large language model, and selecting a continuous human shape action sequence with the highest matching degree from a plurality of preset candidate human shape action sequences; on the premise of considering the size difference between the virtual human body and the actual robot and the joint angle error, the generated humanoid action sequence is mapped to the humanoid robot, and multi-modal interaction is achieved. The method has the advantages of high-precision low-delay real-time voice recognition, high voice action matching degree and the like.
Owner:NINGBO DIGITAL TWIN (EASTERN UNIV OF TECH) RES INST +1

Virtual reality video adjustment system and method, storage medium and electronic equipment

The invention discloses a virtual reality video adjustment system and method, a storage medium and electronic equipment, and the method comprises the steps: carrying out the extraction and classification of feature information, which may cause the change of the response and active degree of a user, in a virtual reality video in advance through a machine learning algorithm; in the video playing process, physiological parameters and limb actions of a user are read in real time to evaluate the active degree of the user in the watching process, pre-stored video feature information is compared through a machine learning algorithm, then an updated playing scheme is output, and the playing content and effect of the virtual reality video are adjusted in real time. According to the invention, the user can switch three playing modes, namely a low immersion mode, a high immersion mode and a medical mode, the video playing parameters, contents and the like can be adjusted in real time by utilizing the physiological parameter change of the user, the more immersion film watching experience can be provided in the fields of education, entertainment, health management and the like, and the individual requirements and preferences of the user are met.
Owner:SHANGHAI CHENGRONG NETWORK TECHNOLOGY CO LTD

Virtual friction tactile rendering method and device based on micro-current stimulation

The invention relates to the technical field of man-machine interaction and tactile rendering, in particular to a virtual friction tactile rendering method and device based on micro-current stimulation, and the method comprises the steps: obtaining friction tactile interaction information of a real object and hand action information of an interactor, and mapping the friction tactile interaction information and the hand action information to a virtual object and a virtual hand; defining friction interaction states of the virtual hand and the surface of the virtual object, and designing a tactile feedback array which provides corresponding stimulation modes for different friction interaction states; when the virtual hand starts to make contact with the surface of the virtual object, the stimulation mode is converted into the contact mode; when the virtual hand starts to slide on the surface of the virtual object, the stimulation mode is converted into a sliding mode; when the virtual hand leaves the surface of the virtual object, the stimulation mode is converted into a separation mode; an interactor perceives real surface information of various objects from three feedback channels of audio-visual touch through friction interaction processes of contact, sliding, separation and the like in a virtual scene, and immersive interaction experience is realized. The reality sense and immersion sense of the virtual friction touch sense are improved.
Owner:SOUTH CHINA UNIV OF TECH

Historic building protection display method and system based on virtual reality

The invention discloses an ancient building protection display method and system based on virtual reality, and the method comprises the steps: obtaining user position coordinates and orientation angle data collected by a high-precision position tracking sensor in real time, mapping the data to a corresponding position of a virtual scene, dynamically updating a visual angle in the virtual scene according to the movement and steering of a user, and displaying the visual angle in the virtual scene. The immersive experience of being personally on the scene is realized; a physical rendering technology is adopted to carry out vivid simulation on illumination, materials, textures and the like of the virtual scene, and through technologies of pre-calculation of an illumination map, environment shielding and the like, the real-time rendering calculation amount is reduced, and the rendering efficiency and the visual quality of the virtual scene are improved; various displacement interaction modes including traditional rocker movement, gesture control, body inclination and the like are designed, operation habits of different users are met, user interaction behaviors are analyzed and modeled through a machine learning algorithm, interaction parameters and response modes are adjusted in a self-adaptive mode, and personalized displacement interaction experience is provided.
Owner:WUHAN INST OF TECH