484results about How to "Improve interactive experience" patented technology

The invention discloses an intelligent visualization and text association method for a multi-modal knowledge graph, and relates to the technical field of information processing. According to the intelligent visualization and text association method for the multi-modal knowledge graph, multi-modal data in an internal database of an enterprise is obtained, and a multi-modal feature vector is generated by using a data preprocessing and feature extraction technology; the feature vectors are mapped to a unified vector space through a cross-modal embedding algorithm, semantic alignment, association and fusion among multi-modal data are realized, and a complete multi-modal knowledge graph is constructed. Through bidirectional association and multi-modal joint query, the information acquisition efficiency is improved, and visual display of the knowledge graph is realized by using the graph neural network. Meanwhile, the knowledge graph is dynamically updated through a graph reasoning algorithm, and the timeliness and accuracy of the knowledge graph are ensured. A more efficient solution is provided for an enterprise in the aspects of management and application of multi-modal data, and the intelligent process of knowledge management is promoted.

The invention relates to an aviation standard question and answer optimization method and system based on atlas and document data, and belongs to the field of natural language processing in the aviation field, and the method comprises the steps: S1, recognizing the intention of a user question based on a BERT model; s2, constructing an aviation enterprise standard attribute knowledge graph; s3, constructing an aviation enterprise standard text knowledge base; s4, recalling aviation enterprise standard attribute question knowledge; s5, recalling aviation enterprise standard content question knowledge; and S6, performing big model intelligent question answering based on RAG, and inputting a recall result and an original question of the user into the pre-trained big model through a retrieval enhancement generation technology to serve as knowledge reference to assist in generating answers. According to the method, the knowledge graph of the aviation enterprise standard is constructed, the large model RAG technology based on the knowledge graph is researched, the problem that entities and relations in user questions cannot be intelligently understood in the existing standard attribute information retrieval process is solved, and the accuracy and efficiency of standard attribute information question answering can be improved.

The invention discloses an intelligent building design generation system based on multi-source heterogeneous data and an AI large model, and the system comprises a multi-source heterogeneous data collection and processing module which is responsible for automatically collecting the multi-source heterogeneous data related to a project, and carrying out the data processing; the knowledge graph module is used for carrying out structured storage and association on multi-source heterogeneous data by constructing a knowledge network covering upper planning, historical culture, architectural design standards and law and regulation contents; the AI large model fine tuning module is used for performing fine tuning on the AI large model by using data in the special architectural design field; the scheme design module is responsible for generating various design schemes, providing choices of different design styles and function layouts and optimizing the schemes; and the visual interaction and feedback module is used for providing an interaction interface with a user. The method is remarkably superior to the prior art in the aspects of design substantial content processing, multi-source heterogeneous data integration, design generation and optimization, user interaction experience and the like, and a more comprehensive, intelligent and efficient solution is provided for building design.

The invention discloses a method for correcting dialogue intention information of old people based on a deep neural network, and particularly relates to the technical field of dialogue optimization, and the method comprises the steps: collecting and cleaning multi-topic multi-round dialogue data, marking multi-round dialogue corpora, and unifying the format; performing feature extraction on the labeled corpus by using the multi-intention recognition sub-model to generate a multi-intention representation vector capable of representing each intention; screening context content related to the target intention in combination with a hierarchical attention mechanism of user context dynamic weight adjustment; processing context content related to the target intention through gating operation based on multiple rounds of interaction history, and reserving semantic fragments with reference value; performing parallel analysis on the reference semantic fragments based on a multi-task learning structure of a deep neural network, performing classification processing on different intentions, and calculating scores; and executing multi-intention fusion correction operation according to classification and scoring results, and outputting intention information capable of distinguishing each intention.

The invention discloses a mechanical arm operation method based on a multi-mode large visual language model, which comprises the following steps of: firstly, acquiring image data of a mechanical arm operation scene through a visual sensor, and acquiring a user instruction in combination with a voice recognition module or a text input module; and inputting the natural language instruction and the visual scene data into a multi-modal large visual language model for multi-modal task analysis. The model identifies the category, position and attribute of a target object in a scene, and generates a specific operation sequence in combination with an input instruction. And then, according to the operation sequence generated through analysis, the system directly drives the mechanical arm to execute corresponding tasks including specific actions such as grabbing, moving and placing of the target object, and in the task execution process, the mechanical arm sequentially completes the actions according to the operation sequence generated in advance. The problems that in the prior art, a mechanical arm is inaccurate in complex task instruction analysis, poor in operation flexibility and adaptability and poor in real-time response capacity in a dynamic environment are effectively solved.

The invention relates to the technical field of artificial intelligence, and discloses a man-machine dialogue history and semantic retrieval-based prompt automatic construction method, which comprises the following steps of S1, performing text preprocessing on historical dialogue data and user input, including dynamically generating query keywords, verifying and analyzing a file uploaded by a user, and extracting core contents; s2, utilizing a pre-training language model to map the historical dialogue and the user request into semantic vectors, matching in combination with the keyword weight, and constructing a historical vector set and a user request vector; and S3, extracting a context fragment most relevant to the user request from the historical dialogue vector based on a convex optimization method. The context information highly related to the user request is accurately extracted through the sparse optimization technology, and the background information, the user request and the generation instruction are organically integrated in combination with the dynamic Prompt template design, so that the semantic correlation and context coherence of the generated reply are improved, and the interference of redundancy and irrelevant information is avoided.

The invention provides an image rendering method and device, electronic equipment and a storage medium, and the method comprises the steps: calculating a distance between a virtual image obtaining device and a to-be-rendered object through determining the to-be-rendered object in a to-be-rendered scene, and determining the distance as a first loading factor; determining a rendering picture pixel proportion of each to-be-rendered object based on preset view cone size information, determining the rendering picture pixel proportion as a second loading factor, generating a rendering loading priority sequence according to the first loading factor, and determining a model level resource file and a texture level resource file according to the second loading factor, loading the resources to a video memory for rendering according to the sequence; the priority is determined by calculating the distance between the camera and the to-be-rendered object, it is ensured that a high-quality model and texture of a close-range object are loaded preferentially, the instantaneity of the rendering loading process is improved, texture and model grade division is conducted through the pixel proportion of the to-be-rendered object in the picture, and the rendering efficiency is improved. The occupation of a video memory is reduced, and the overall rendering performance of the system is improved.

The invention relates to a light control method and system based on a holographic interactive projection technology, and the method comprises the steps: projection region recognition, user interaction detection, light parameter calculation and light real-time regulation and control, the projection region recognition, scanning of a target region through a holographic projection device and a depth induction sensor, and generation of a three-dimensional space model of an environment; a motion capture device and a deep learning algorithm are used for carrying out real-time recognition on gestures or motions of a user, interaction intentions and priority ranking are generated, a holographic projection device is used for generating a three-dimensional environment model, the motion capture device recognizes the intentions of the user, and an illumination optimization model is used for calculating regulation and control parameters; and the output of the light equipment is dynamically adjusted, so that high-precision and intelligent light control is realized, and the problems that a traditional light control method is insufficient in environment perception capability, lacks a user interaction mode, is limited in flexibility and adaptability of light regulation and control, and lacks a multi-module cooperative working mechanism are solved.

The invention discloses a touch control method based on a pressure sensor, which relates to the technical field of sensor equipment, and comprises the following steps: designing a touch control panel; distributing and calibrating a sensitivity area; designing a multi-layer touch pressure sensing fusion algorithm; designing a dynamic pressure feedback mechanism; designing a nonlinear pressure interval classification mechanism; and performing pressure sensing and dynamic gesture recognition. According to the touch control method based on the pressure sensor, through multi-level design and innovative model optimization, innovative technologies such as differential sensitivity design, a dynamic sensitivity adjusting mechanism, pressure sensing and gesture recognition are introduced into the touch control technology of the pressure sensor, so that the precision and efficiency of complex gesture analysis can be remarkably improved; and the false touch rate is effectively reduced. The design can adapt to various environment changes, the service life of equipment is prolonged, the user interaction experience is improved, and the defects in the prior art are overcome.

The invention discloses an implementation method for intelligent agent data analysis based on a large language model, and the method specifically comprises the following steps: S1, constructing an intelligent agent model which comprises a business index system module, a task planning module and an execution module; s2, a user inputs a real-time query demand to the constructed agent model, and the agent model performs semantic analysis on the input query demand based on a large language model to obtain a query target; s3, inputting the obtained query target into a task planning module, and performing task planning by the task planning module according to the query target and generating a task query result; s4, the execution module visualizes the generated task query result and displays the visualized query result on a display screen, and data analysis and display are completed. According to the method, semantic analysis is carried out on the natural language text by means of the large model agent, the real-time query requirement of the user is quickly and accurately understood, and the interaction experience is improved.

The invention discloses a chronic disease follow-up visit and management platform driven by a large model, and relates to the technical field of medical information technology platforms. The system is applied to managing and tracking the follow-up visit process of chronic disease patients and providing health consultation and answers, and comprises a user interface module, a logic control module, a database module, a large model module and an auxiliary function module, and the user interface module is used for providing an interactive interface between a patient and a doctor. An intelligent and efficient system platform is constructed by integrating a large model technology, a voice recognition technology and a digital human technology, the system platform adopts a privatized large model, data security and privacy protection are ensured, medical institutions are allowed to autonomously optimize and control the application of the model, and on the whole, through an advanced technical means, the intelligent and efficient system platform has the advantages of being high in practicability and easy to popularize. Refining, individuation and high efficiency of chronic disease management are remarkably improved, and the purpose is to improve the health outcome and life quality of patients.

The invention provides a medical AI question and answer method based on retrieval enhancement, which comprises the following steps: acquiring a medical professional knowledge base, and constructing an entity recognition model and a medical knowledge graph; the method comprises the following steps: splitting a medical professional knowledge base, and creating a vector index and a full-text retrieval reverse index; intention classification is carried out, and initial processing is completed; performing multi-path mixed retrieval on the medical professional knowledge base to obtain a user question related text block; a filtering rule is preset, and the user question related text blocks are filtered; answering the user question according to a preset second prompt word, and answering the user question according to a preset third prompt word when the user question exceeds the range of the medical professional knowledge base or the multi-path mixed retrieval has no result. According to the method, related context information can be accurately searched, reliable reference information is provided for a generative large model to answer professional questions, the interactive experience of a medical question answering system is improved, and the accuracy and specialty of answer generation of the system are remarkably improved.

The invention discloses a network topology and equipment resource information display method and device, equipment, a medium and a product, and relates to the field of network topology monitoring, and the method comprises the steps: employing a data collection module to collect network data; the network data comprises network topology information and resource information; carrying out optimization processing on the network data by utilizing a data processing module, and determining optimized network data; dynamically generating a network topology view according to the optimized network data by using a generation module of a display screen interface on the basis of the equipment operation state and the site connection relationship; based on a user interaction module, the link information of each link, the basic information of each network node and the resource state information in the network topology are displayed in a graded mode according to the network topology view, the information display effect in a large-scale network environment is optimized, and the resource state can be displayed in real time.

The invention discloses an intelligent interactive Agent system based on Langchain and an implementation method, and relates to the technical field of natural language processing and artificial intelligence. Comprising the steps of 1, establishing an intelligent interactive Agent system by using an interface and an integrated tool provided by a Langchain framework, 2, managing calling of various tool modules and services through a central scheduling module, and dynamically registering and unbinding the tool modules by using the interface provided by the Langchain framework, and 3, processing user input by using a large language model through a process management module, and establishing an intelligent interactive Agent system. 4, a series of tool modules are integrated through the integrated tool management module, the tool modules comprise a text search tool, a weather query tool and a video information acquisition tool, each tool module works independently or is in linkage with other tool modules, and the tool modules are connected with the integrated tool management module. And 5, managing a user interaction interface through a front-end management module, supporting a user to query and control in a natural language, displaying a processing progress and a processing result in real time, and providing feedback and help information.

The invention relates to a vehicle-mounted user intention recognition and task generation system based on a large model, and relates to the technical field of automobile interaction. The user intention analysis module is used for obtaining voice input of a user in a vehicle and analyzing the voice input to obtain a plurality of user intentions; the situation awareness module is used for collecting current environment data of the vehicle and obtaining a current situation based on the current environment data through a large model; the task generation module is used for searching a task capability interface of a vehicle according to the user intention and the current situation to generate a task combination; the task combination is to call different agents; the reflection module is used for evaluating whether the generated task combination is consistent with the user intention and the current situation and adjusting the inconsistent task combination; and the task sequence arrangement module is used for confirming the control sequence of different series-parallel tasks according to the task combination and calling the corresponding agents.

The invention discloses a vehicle-mounted intelligent scene generation method and device based on a large model, equipment and a storage medium. The method comprises the following steps: receiving user expression information input by a user, and outputting user intention information according to the user expression information by utilizing a preset large language model; a new vehicle scene card is determined to be generated according to the user intention information, or a target vehicle scene card matched with the user intention information is determined by using a knowledge graph, and the knowledge graph comprises historical vehicle scene cards; and controlling the current vehicle according to the execution action in the new vehicle scene card or the target vehicle scene card. According to the technical scheme of the embodiment of the invention, the new scene card is generated or the matched historical scene card is found, so that the problem that the scene card lacks flexibility and individuation is solved.

The invention provides a digital human control method and device based on multiple modes and electronic equipment, and relates to the technical field of data processing. In the method, voice data, facial expression data and body movement data of a user are acquired, and the user interacts with a digital human; performing semantic analysis on the voice data by adopting a Transform model to obtain an emotional state and a language habit corresponding to the user; performing feature extraction on the facial expression data by adopting a convolutional neural network model to obtain a facial expression type corresponding to the user; performing action analysis on the limb action data by adopting a hidden Markov model to obtain effective action features corresponding to the user; generating a fusion result based on the emotional state, the language habit, the facial expression type and the effective action features; and adjusting the multi-modal output corresponding to the digital human according to the fusion result. By implementing the technical scheme provided by the invention, the interaction experience feeling of the user can be improved.

The invention provides a virtual digital population type synchronization method, system and device, a medium and a program product, and the method comprises the following steps: analyzing an input voice signal, and obtaining a voice feature; taking the voice features as input of a lip movement prediction model, and predicting corresponding lip movement parameters; driving a face model of the virtual digital human to perform real-time rendering according to the lip movement parameters, and realizing fine movement control of lips; and obtaining user feedback data, and continuously optimizing and adjusting the lip movement prediction model based on the user feedback data. Through advanced technologies such as deep learning, voice analysis and lip movement prediction, accurate synchronization of the virtual digital population type and the voice content is realized, and the expression ability of the virtual character and the user interaction experience are improved.

The invention discloses a user question answering method and device, equipment and a medium, and relates to the field of artificial intelligence, and the method comprises the steps: obtaining the input information of a user; performing application scene analysis on the input information and semantic intention understanding on the input information by using a multi-level associated scene analysis model, and determining an actual application scene of the input information; calling a core element template preset for the actual business scene, and extracting core element information in the input information according to the core element template; and acquiring scene data, inputting the reference knowledge, the cue word and the scene data into the trained large language model as input data, and obtaining a reasoning result output by the large language model. According to the method, the data correlation problem that knowledge quoted by an existing LLM is inaccurate and incomplete is solved, association matching between the problem and business scene data is perfected, and therefore the reply effect of the LLM on scene related problems of all industries and fields is improved.

The invention relates to the field of modern man-machine interaction, in particular to an LUI and GUI method and system based on an emotion module. According to the technical scheme, the LUI and GUI method and system based on the emotion module comprise a dynamic GUI generation and adaptation module; compared with a traditional GUI system which generally depends on a preset interface design and a fixed interaction mode when interacting with a user and lacks active perception and active response ability to the emotion of the user, due to the defect, the user experience is not personalized enough, dynamic adjustment cannot be carried out according to the instant emotion state of the user, and the user experience is poor. According to the LUI and GUI system based on the emotion module, the language user interface is introduced to interact with the user, so that the defects in the prior art are overcome, the LUI can have a dialogue with the user through a natural language processing technology, and the system can call a dialogue management function by analyzing the emotion of the user, so that a response and interaction page conforming to the current emotion of the user is generated.

The invention provides an intelligent data analysis and knowledge question and answer method and system based on a multi-modal large model. The method comprises the following steps: receiving a multi-modal query request, performing semantic analysis and intention recognition technologies, determining a question core and a required knowledge field, and generating a personalized question understanding framework; performing manifold embedding processing by applying a manifold learning enhancement algorithm, revealing an internal geometric structure, constructing a shared representation space by adopting a multi-task learning technology, training a plurality of sub-tasks at the same time, and generating cross-modal unified representation; performing recurrent processing by using a recurrent neural network algorithm, recursively updating an internal state, constructing an organized information structure by using a hierarchical clustering method, and generating an ordered information structure chart; a context awareness feedback mechanism is introduced, instant response and environment change are monitored in real time, an answer strategy is dynamically adjusted, instant feedback is recorded, and an intelligent data analysis and knowledge question and answer scheme is generated. According to the technical scheme provided by the invention, the accuracy of intelligent data analysis and knowledge questions and answers and the user experience are improved.

The invention discloses a meta universe-based conference interaction method, and relates to the technical field of virtual conferences, and the method comprises the steps: extracting the facial features of participants, comparing the facial features with a pre-established facial feature library, obtaining the unique identity of each participant, and recognizing the identities of the participants; after the identities of the participants are determined, position changes of key body joint points of the participants are detected in real time, and specific actions of the participants are judged by analyzing relative positions and movement tracks between the joint points; the method comprises the following steps: receiving the acoustic characteristics of the participant language, converting the voice signal of the participant into a text, and analyzing the semantics and emotion of the text in combination with natural language processing to obtain the language expression intention of the participant. According to the method and the device, the optimal interaction mode can be dynamically selected from the preset library according to different interaction intentions, and the audio and video parameters and the interface layout are adjusted in real time, so that intelligent interaction in a multi-user scene is realized, the interaction experience of a conference is optimized, and the interaction effect can also be improved.

The invention discloses a data processing system and method for three-dimensional real estate surveying and mapping, and relates to the technical field of intelligent surveying and mapping, and the system comprises a multi-source data fusion module, a model generation module, a spatial relationship analysis module, an efficient rendering module and a data security module. The multi-source data fusion module converts the original surveying and mapping data in different formats into a unified three-dimensional point cloud data set; the model generation module generates a parameterized three-dimensional building model based on the point cloud data; the spatial relation analysis module constructs a relation graph of the building model and generates a surveying and mapping index report; the efficient rendering module processes large-scale three-dimensional data and generates an interactive three-dimensional scene; and the data security module controls the data access authority and generates an operation log. According to the method, the processing efficiency and precision of the three-dimensional real estate surveying and mapping data are improved, efficient analysis and visualization of large-scale three-dimensional data are realized, the security of sensitive data is ensured, and advanced technical support is provided for modern city planning, real estate management and real estate development.

The invention discloses an intelligent directional and quantitative smell generation method in virtual reality olfaction interaction, and relates to the technical field of virtual reality. The invention provides an intelligent, directional and quantitative smell generation method in order to solve the technical problems that in smell generation work in virtual reality in the prior art, the variety and generation precision of smell are limited, an accurate smell concentration control mechanism is lacked, and interactive linkage with user actions and a virtual environment is lacked. In combination with an odor molecule dynamic combination technology, a deep learning prediction model, closed-loop concentration control and a spatial orientation transmission system, richer, personalized and immersive olfactory interaction experience is provided. Comprising a smell synthesis module, a digital smell control unit, an intelligent smell prediction model, a directional smell transmission system and a virtual wind field simulation module. The method is suitable for being applied to the work of intelligent directional and quantitative smell generation in virtual reality olfaction interaction.

The invention provides a method and a device for simulating a video medium by a multi-mode medium in dubbing and a readable storage medium thereof. In the dubbing field, a traditional video medium has the problems of high cost, poor flexibility and the like. According to the method, multi-mode media such as audios, pictures and texts are dynamically loaded during program running, and the video effect is simulated through specific steps. The method comprises the following steps of: initializing an item, configuring resources, requesting and analyzing data, loading a UI (User Interface) control, synchronizing the data and the control, adding an interactive operation and an extended function, and finally releasing the resources. The technology effectively reduces the cost, realizes resource sharing, improves the operation efficiency and flexibility, has cross-platform compatibility, has important practical value in dubbing and other multimedia application scenes, and can bring more efficient and convenient experience to users.

The invention discloses a spoken English man-machine conversation interaction training method and system, and relates to the technical field of spoken English training, spoken English audio signals of a user are monitored in real time through a microphone, and the frequency spectrum information of the audio signals is refined into each frame of spectrogram and cepstrum coefficient feature vectors by using Fourier transform and feature extraction technologies; therefore, the voice signal characteristics of the user can be completely captured; three core dimensions of semantic similarity, grammatical structure similarity and fluency are incorporated into an evaluation model, a comprehensive oral English training evaluation system is formed, a text sequence is generated by analyzing a time sequence dependency relationship through a convolutional neural network, and the oral English training evaluation model of a deep learning technology is combined, so that the oral English training evaluation accuracy is improved. According to the method, the expressions of the user in the aspects of semantics, grammar and fluency can be accurately measured, the oral training level of the user can be comprehensively judged by the system by comparing the comprehensive evaluation coefficient with the preset qualified threshold value, and a personalized learning guide is provided according to a result.

A content interaction method and apparatus, a readable medium, an electronic device and a program product, the content interaction method comprising: obtaining target content input by a target user in an intelligent object page, the intelligent object page being used for interaction between the user and an intelligent object; first reply content is generated at least based on the target content and a virtual human cue word through a first machine learning model associated with the intelligent object, and the virtual human cue word is used for enabling the first machine learning model to generate anthropomorphic reply content; and performing knowledge content recall based on the target content through a second machine learning model associated with the intelligent object to obtain target knowledge content, and generating second reply content based on the target knowledge content, the second reply content being used for answering a question corresponding to the target content. The time delay of receiving reply content by a user can be reduced, the flexibility of the reply content is improved, and the interaction experience of the user is improved.

The invention relates to an interactive music intelligent generation method and system adaptive to a scene space, and the method comprises the steps: building a conditional diffusion model frame through sensing the behavior, emotional state and space environment change of a user, generating music matched with a current scene in real time, achieving the deep fusion of the music and user experience, and improving the user experience. And the generated music is dynamically adjusted to ensure that the generated music not only can flexibly cope with scene changes, but also can meet personalized requirements of the user, so that the interaction experience of the user with the music generation system in the scene is improved, and the diversity and intelligence of scene scheme generation are improved.

The invention relates to the technical field of organic electroluminescence adjustment, and provides a power equipment abnormity early warning system for a mobile terminal, which integrates a real-time monitoring module, an early warning identification module and a data detection module. By monitoring operation data of the power equipment in real time, combining with a random forest model to carry out abnormity early warning, sending early warning information to a mobile terminal in real time and receiving user feedback to optimize an early warning strategy, a data detection module carries out grouping processing on the power equipment based on a time period, so that the data processing efficiency is improved; the system achieves the comprehensive monitoring of the operation state of the power equipment, remarkably improves the early warning accuracy, response speed and user interaction experience, effectively guarantees the safe and stable operation of a power system, promotes the scientific maintenance and management of the power equipment, is suitable for various types of power equipment, and improves the safety and reliability of the power equipment. The method has a wide application prospect and an important practical value, and provides powerful support for intelligent and safe operation of an electric power system.

The invention provides an athletic contest explanation generation method based on a big language model, and the method carries out the athletic contest explanation by using an athletic contest explanation generation system based on the big language model. The specific process comprises the following steps: step 1) inputting a sports event video into a video analysis module, and identifying action information in the sports event video by using the video analysis module; 2) transmitting the action information identified by the video analysis module to a large language model explanation module and an explanation generation system development module; (3) the big language model explanation module processes the received action information through a big language model to generate explanation; and 4) combining the action information identified by the video analysis module with the explanation generated by the large language model explanation module by using an explanation generation system development module to form an interactive explanation generation system.According to the interactive explanation generation system disclosed by the invention, the automatic explanation generation technology of the sports competition is innovated, and more accurate and professional intelligent explanation can be generated.