99 results about "Interactive technology" patented technology

The present disclosure provides a voice instruction processing method and device, electronic equipment and a storage medium, relates to the technical field of artificial intelligence, in particular to the technical field of voice interaction. The specific implementation scheme of the voice instruction processing method is as follows: performing multiple path recognitions on a to-be-processed voice instruction to obtain multiple recognition results, wherein the multiple path recognitions include first operation intention recognition of performing an operation on a graphical interface element of a voice interaction device and second operation intention recognition of performing an operation on the voice interaction device; obtaining a target recognition result from the multiple recognition results; and performing the to-be-processed voice instruction according to the target recognition result.

The present application relates to the technical field of intelligent interaction, in particular to an interactive behavior guidance control method and system based on execution feedback data, the present application constructs a personalized baseline model containing spatial pressure distribution, fluctuation characteristics and action timing characteristics by collecting pressure distribution data of a user contact interface; on this basis, the spatial feature deviation degree and the time feature consistency of the current pressure distribution relative to the baseline model are calculated, the current state of the user is determined and the ergonomic constraint violation degree is evaluated; the feasible target point closest to the current state in the feasible region satisfying the constraint condition is searched, the corresponding guidance vector is generated, and the directional haptic guidance signal is output according to the user personalized parameters; at the same time, based on the execution feedback of the user to the guidance signal, the response characteristics of the user are modeled online and the response state of the user is inferred, and then the guidance parameters are adaptively adjusted, so as to realize accurate, comfortable and learning-capable interactive behavior guidance control.

The application provides a virtual environment perception model self-evolution method, device, equipment, medium and product, and belongs to the intelligent interaction technical field of meta universe. The method comprises the following steps: acquiring perception flow generated by processing perception data of a virtual environment by a first perception model; acquiring a reference true value flow of the virtual environment from a bottom layer of the virtual environment; determining a perception difference between the perception flow and the reference true value flow; in the case that the perception difference satisfies a model update triggering condition, automatically labeling perception data corresponding to the perception difference in the perception flow by using the reference true value flow to generate incremental training data; and updating the first perception model based on the incremental training data to obtain a second perception model. The application realizes closed-loop self-evolution of the perception model by constructing a visual-semantic double-flow checking architecture, so that the recognition ability of an intelligent agent can continuously evolve with running time.

The application discloses a multi-dimensional demonstration method and device based on time domain technology and a storage medium, and relates to the technical field of data interaction. The application first acquires a time domain file containing multiple perspectives and / or multiple time points, and encapsulates multi-dimensional index information containing a space index and a time index. Then, a demonstration narrative stream including a key frame sequence of the demonstration and a camera motion path of the key frame is constructed based on the multi-dimensional index information. In the process of playing and rendering, the current camera state is acquired in real time, the prediction information of the camera motion path is combined, and the target display area in the current view cone is calculated. Finally, the corresponding target pyramid tile data is called from the multi-dimensional index information, and progressive decoding and rendering are performed in the order from low to high resolution, so as to realize the non-susceptible loading of the demonstration scene from the overall overview to the local micro details. In this way, the loading efficiency of the multi-dimensional demonstration scene is improved, and the resource consumption is reduced.

This invention discloses a multimodal perception-based immersive digital interaction system and method, relating to the field of digital interaction technology. The system includes generating user state representations; constructing a dynamic contextual framework; and optimizing interaction strategies through a multi-channel feedback mechanism. This invention achieves deep fusion and dynamic understanding of the user's multidimensional human state and environmental context, significantly improving the system's accuracy in recognizing user intentions and its real-time response; enhancing the naturalness and immersion of the interaction; and enabling the system to continuously adapt and optimize, generating highly personalized, smooth, and context-consistent immersive interactive experiences. This comprehensively solves the key problems of mechanical interaction, delayed feedback, and insufficient immersion in existing technologies.

The application provides a display control method and device, equipment and a storage medium, and relates to the technical field of human-computer interaction. The method comprises the following steps: displaying a three-dimensional virtual scene and a two-dimensional interactive picture on a graphical user interface; in response to a movement triggering event of a virtual camera, determining a target display level of the two-dimensional interactive picture according to a real-time position of the virtual camera and a position of a target three-dimensional virtual object in the three-dimensional virtual scene; wherein the target display level is used to indicate a display level of the two-dimensional interactive picture relative to the target three-dimensional virtual object on the graphical user interface; and controlling the two-dimensional interactive picture to update and display on the target display level. The embodiment of the application can realize a three-dimensional perspective effect of the two-dimensional interactive picture in the three-dimensional virtual scene, and enrich the interactive experience of a user for a three-dimensional interactive application.

This invention discloses an automatic acquisition and storage method and system for bronchial imaging data based on voice interaction, belonging to the field of intelligent voice interaction technology. The method involves acquiring the operator's voice signal, inputting the voice signal into a pre-trained speech recognition model to generate a text sequence; segmenting and extracting keywords from the text sequence to obtain instruction keywords; matching the instruction keywords with a preset instruction template library to determine control instructions, including image acquisition type instructions and image annotation instructions; processing the real-time video stream according to the control instructions; and storing the processing results in a bronchial imaging database. By introducing voice interaction, the method achieves automated control of image acquisition, annotation, and storage, reducing reliance on manual operation and personnel collaboration. Operators can directly issue instructions during operation to complete image management, effectively saving labor costs and improving image acquisition efficiency.

The application provides a digital human interaction method and system based on gesture and body action recognition, and relates to the technical field of digital human interaction. The application collects user images and depth information, extracts skeletal key points of hands, whole bodies and heads and converts them into key point sequences containing time motion tracks. Then, a space-time graph structure is constructed based on the sequences, time-space features are extracted by a time sequence graph convolution network to identify gesture and body action categories. Subsequently, user intentions are inferred by combining interactive scene contexts and historical data, and interactive instructions are generated. Finally, voice, expression and action data are generated according to the instructions, action data is optimized, and driving signals are generated by synchronizing the three types of data, so that the digital human completes the interactive response, and precise and natural gesture and body interaction between the digital human and the user can be realized.

The application provides a personalized model construction method and system applied to intelligent interaction, relates to the technical field of intelligent interaction, and first generates a scene intention linkage basic logic based on the linkage relationship between scene elements (including interactive environment elements, user operation elements and interactive target elements) of an intelligent interaction scene and user interaction demands (including information acquisition demands, function use demands, opinion expression demands and emotional communication demands); then constructs a feedback collection nested link, collects related feedback information to generate a scene feedback linkage set; then constructs a dynamic adaptation iteration link with the scene feedback linkage set as a driving source, generates a dynamic adaptation optimization link; then constructs a collaborative operation process of a personalized model architecture and the dynamic adaptation optimization link, generates a complete personalized model architecture; and finally outputs a scene adaptation type intelligent interaction response instruction through the complete personalized model architecture, so as to realize personalized adaptation of intelligent interaction.

This invention relates to the field of multimodal interaction technology and discloses a multimodal perception-based intelligent interactive feedback system. The system includes generating a multimodal data slice sequence with precisely aligned timestamps by synchronously recording and time-stamping speech, facial images, and vital signs; extracting text, facial expressions, gaze patterns, and physiological feature sequences through parsing, and jointly analyzing these sequences using an inference engine to obtain state results; and querying a knowledge graph to generate a composite feedback strategy containing content identifiers, rhythm parameters, and channel instructions. This method improves the reliability of state inference through precise temporal alignment of multimodal data; and through the collaborative generation of the composite strategy, it achieves adaptive and unified control of feedback content, rhythm, and channels, thereby enhancing the naturalness of the interaction and the overall system response performance.

The application discloses a kind of unmanned plane ground station control system and method based on speech recognition and AI task decision, it is related to unmanned plane control and artificial intelligence interaction technical field, the system includes: voice instruction recognition and task understanding module, the natural voice instruction of operator is collected and is converted into machine understandable structured task description;Task planning and path generation module, structured task description is converted into the safe and feasible flight waypoint sequence and flight trajectory that unmanned plane can actually fly;Real-time AI visual analysis module, real-time video stream is collected in real time, and then visual analysis result is converted into flight control action request;Flight communication and safety execution module is used to receive all control instructions, and issue flight control instruction after protocol conversion;The application can be in real time perception and flight control executive's closed-loop control, rely on edge computing to guarantee low delay high reliability, adapt VTOL unmanned plane in various scenes Intelligent operation needs.

This invention relates to the field of speech recognition interaction technology. Specifically, it relates to an intelligent will-making system for the elderly based on multi-turn speech recognition interaction. It includes a historical will data processing module, an elderly speech recognition and element extraction module, a will sentence reconstruction and element matching module, a confidence calculation and question generation module, and a multi-turn interaction and dynamic update module. Through text segmentation, semantic role labeling, and hierarchical clustering algorithms, a standard will-making framework is extracted, ensuring the legality of the will structure from the source. Simultaneously, through will sentence reconstruction, precise element matching, and a confidence calculation mechanism based on the distance between related sentences, it can automatically sort out the fragmented expressions of the elderly, accurately identify core elements such as the recipient, received items, and receipt details, and automatically detect content contradictions and uncertainties. Through multi-turn speech interaction, it provides targeted supplementation and confirmation, ensuring the will content is complete, logically clear, and the expression of intent is genuine.

The application discloses a naked-eye 3D immersive interaction method and system applied to a giant ball building, and relates to the technical field of naked-eye 3D interaction; the naked-eye 3D immersive interaction method and system are characterized in that the geometric parameters of the giant ball building and the display screen array distribution parameters are collected, a regular icosahedron is used to construct a spherical surface partition and a viewing area mapping, multi-source collaborative positioning is realized in combination with an ultra-wideband and an inertial measurement unit, and errors are compensated, a parallax adaptation image is generated based on the user position, the line of sight and the virtual object depth, motion prediction and pre-rendering are used to optimize the interaction response, the positioning accuracy and the delay evaluation are synchronously completed, the problems of inaccurate naked-eye 3D interaction positioning, poor parallax adaptation and high response delay in the giant ball building are effectively solved, and the positioning accuracy, the parallax adaptation accuracy, the interaction response speed and the user immersive experience are significantly improved.

The application discloses a spoken dialogue dynamic generation method and system based on voice emotion feedback and belongs to the technical field of voice interaction. The application obtains emotion change trend parameters, current task load indexes and interactive load acceleration parameters by performing data processing on the obtained data, and then calculates the comprehensive intervention tendency value by taking the emotion change trend parameters and the interactive load acceleration parameters as input. If the comprehensive intervention tendency value reaches the early warning trigger threshold value and does not reach the intervention trigger threshold value, preventive protection state data is output. If the comprehensive intervention tendency value reaches the intervention trigger threshold value, real-time intervention state data is output. According to the data output by the judgment, dialogue generation parameters are dynamically adjusted to output target dialogue reply data. The application improves the synergy of user emotion fluctuation and interactive load state in the spoken dialogue generation process and solves the problem that the existing dialogue system lacks the function of synergistically adjusting user emotion fluctuation and interactive load state.

The application provides a digital person-based video data generation method, device and equipment, and relates to the technical field of computer vision and multi-modal interaction. The method comprises the following steps: based on a preset audio-driven digital person generation model, audio semantic features in acquired audio data are extracted; according to the audio semantic features, a dynamic feature grid in the audio-driven digital person generation model is updated; the dynamic feature grid is generated according to static features of a digital person in a preset static standard space. According to the audio semantic features and the static features of the updated dynamic feature grid, a dynamic feature manifold of each frame is generated. According to the dynamic feature manifold and the audio semantic features, a dynamic deformation field residual of each frame relative to the preset static standard space is obtained; the dynamic deformation field residual represents the changes of the digital person in different frames. According to the dynamic deformation field residual, video data containing the digital person is output. The method is used to improve the rendering fidelity of the digital person image.

The application discloses a kind of based on vehicle scene emotional interaction method, device and vehicle, it is related to emotional interaction technical field.The method thereof includes: in response to the emotional interaction trigger event generated in the vehicle cabin, the object model associated with target real object is acquired;Object model is constructed based on the multimedia data representing target real object;Based on emotional interaction trigger event, determine the emotional interaction action and emotional interaction expression of object model corresponding to be triggered;In the vehicle cabin, the emotional interaction content corresponding to object model is presented;In emotional interaction content, object model shows emotional interaction expression and executes emotional interaction action.In this way, the emotional interaction of user and exclusive object can be realized.

The application relates to the technical field of structural simulation interaction, in particular to a building structure simulation result visual interaction system, which comprises the following modules: a data analysis module, which is used for acquiring a geometric model and a finite element analysis result file in parallel and extracting a coordinate sequence; a grid mapping module, which is used for calling a shape function interpolation algorithm based on physical field data flow to calculate local coordinate weights and projecting data to rendering grid vertices; an interactive detection module, which is used for capturing virtual probe tip world coordinates in real time and logically searching for surrounding elements based on voxel indexes; and a dynamic rendering module, which is used for rendering an over-limit area in a highlighted flickering mode in an enhanced three-dimensional rendering model in response to a judgment signal. In the application, local grid subdivision is performed on a high stress area according to a stress gradient change rate, an enhanced three-dimensional rendering model is constructed, a Boolean operation cutting is performed along a principal stress direction, and a dynamic section view and a local contour map are generated.

This invention provides an age-friendly AI interaction and minimalist intelligent companionship system and method, belonging to the field of AI behavior understanding and safe interaction technology for elderly users. The system includes: an age-friendly interface engine module; an AI intent understanding module; a companion-style voice interaction module supporting dialect recognition, emotional soothing, and unlimited repeated responses; a risk prediction and blocking module, pre-setting 12 high-risk scenarios, implementing graded blocking at low, medium, and high levels with an anti-bypass mechanism; and a family ecosystem linkage module supporting one-click help, remote screen sharing, electronic fences, and emergency medical linkage. The method includes: initializing a minimalist interface, collecting operational behavior and identifying intent, implementing graded blocking or companionship guidance based on intent, linking family and community systems, and continuously self-learning and optimizing. This invention achieves a triple closed loop of "ease of use + safety + companionship," increasing the operation success rate to over 90%, effectively blocking accidental touches and fraud risks, and providing a warm and age-friendly interactive experience.

This invention discloses an interactive TR robot and its interaction method, relating to the field of robot interaction technology. It includes a workbench and a voice acquisition device. A lower microphone is located at the top of the outer wall of the workbench, and the lower microphone has a wider bottom and narrower top structure. A voice acquisition device is located at the top of the outer wall of the lower microphone, and eight upward-tilted acquisition holes are located on the side of the outer wall of the voice acquisition device. An upper microphone is located at the top of the outer wall of the voice acquisition device, and the upper microphone has a wider top and narrower bottom structure. This invention, by incorporating the upper microphone, lower microphone, voice acquisition device, eight sets of tilted acquisition holes, and a directional microphone, achieves converged sound wave acquisition and directional noise reduction from eight groups, suppressing noise from non-target directions, significantly improving the strength and accuracy of voice signal acquisition, and clearly capturing operator voice even in noisy environments.

The application relates to a residual breathing lamp method for new energy charging, and relates to the technical field of man-machine interaction of new energy vehicles, and comprises the following steps: S1, current power information and current charging mode information of a power battery are acquired in real time; and S2, target color parameters and reference brightness parameters are calculated based on the current power information through a preset color mapping model. According to the application, the power of 0%-100% is continuously and steplessly mapped into color gradation from red to green through a high-precision color mapping model, and 65536-order smooth color transition is realized by means of 16-bit PWM control technology, so that subtle power changes can also bring delicate and soft visual feedback. Meanwhile, the method integrates an adaptive intelligent adjustment function: the rhythm of the breathing effect dynamically changes according to different modes such as fast charging and slow charging, and the charging speed is vividly reflected; and the display brightness is automatically adjusted according to ambient light, so that the display is not dazzling in dark light and is clearly visible in strong light.

The application belongs to the technical field of extended reality interaction, and particularly relates to a data-real fusion interaction platform and method based on XR technology, wherein the data acquisition module comprises a camera for collecting video frames of the real world; the modeling module is used for calculating the depth information of object objects by multi-view stereo technology and generating 3D point clouds; the 3D point cloud environment is constructed by establishing a camera coordinate system and utilizing perspective projection technology; the controller is used for interactive operation in the 3D point cloud environment and specifying the end point of the path; the display module is used for displaying the 3D point cloud environment based on perspective projection and real-time interactive display; the computer device utilizes the PRM algorithm to randomly sample and construct a probability road network in the working space of the machine, and combines a graph search algorithm to find an optimal path trajectory. The method can automatically find a feasible path in a high-dimensional and complex environment, and can balance global planning and local optimization through a sampling mode, so that the success rate and efficiency of path planning are improved.

The application discloses a health monitoring system and method based on voice interaction, equipment, medium and product, relates to the technical field of medical health monitoring and artificial intelligence interaction. The system comprises: a voice intelligent terminal device for collecting environmental sound, automatically extracting effective human voice segments in the recording mode, temporarily storing locally when the network is interrupted, automatically supplementing transmission after recovery; in the dialogue mode, echo cancellation is carried out to support voice interruption, and voice feedback information issued by the cloud is played, and device state information and device identification information when not bound are displayed. The user terminal is used for obtaining device identification information and associating the device with a patient account. The cloud server is used for receiving voice segments and extracting structured medical data, and converting the results into voice feedback and issuing. The application realizes passive collection and active consultation of health data through double-mode voice interaction, and realizes real-time early warning of the health monitoring process.

This invention discloses an intelligent interaction method and system for virtual mental health scenarios for adolescents, specifically relating to the field of intelligent interaction technology. It involves collecting multimodal interaction data generated in virtual mental health interaction scenarios, extracting cooperative interaction patterns to form a cooperative interaction benchmark feature library; forming an adversarial interaction feature set based on the deviation of the multimodal interaction data sequence from the cooperative interaction benchmark feature library; evaluating time series consistency and cross-modal consistency based on the cooperative interaction benchmark feature library and the adversarial interaction feature set, calculating the multimodal interaction credibility weight distribution, and generating psychological risk assessment features by combining the multimodal interaction data sequence to obtain adolescent psychological risk assessment results; and improving the effectiveness of adolescent mental health intervention by constructing an adaptive virtual dialogue strategy decision-making model and outputting virtual mental health interaction feedback information oriented towards the real psychological needs of adolescents.

This application discloses a method, device, equipment, and storage medium for controlling vehicle-exterior interactive projection, relating to the field of intelligent vehicle-exterior interaction technology. The method includes: acquiring the movement trajectory data of the target authorized user, environmental perception data of the side and rear area of ​​the target vehicle, and the current state data of the target vehicle; determining the target interactive scene from candidate interactive scenes based on preset scene priority rules; determining the target projection content based on the mapping relationship between the candidate interactive scenes and projection content templates; generating projection driving instructions based on the target projection content, and sending the projection driving instructions to the B-pillar matrix projection lights of the target vehicle via the vehicle controller local area network bus, causing the B-pillar matrix projection lights to execute the projection driving instructions. This solution, through the fusion of multi-source perception data, determines the target interactive scene and ultimately generates personalized projection content matching the scene, improving the accuracy of vehicle interactive scene recognition and user experience.

This application provides a load balancing control method, system, device, and storage medium for edge computing, belonging to the field of data interaction technology. The method includes: acquiring network request information sent by a user device and determining the request time; acquiring the status information of multiple communication devices at the current request time, and constructing a temporal knowledge graph using the user device and multiple communication devices as nodes, and the request time and status information as attributes corresponding to each node; inputting the temporal knowledge graph into a pre-trained graph neural network model for processing, predicting the evaluation values ​​of the connections between the user device and each communication device in multiple future time periods; based on the evaluation values, determining the target device that meets the network connection requirements in each future time period from the multiple communication devices, and sending a connection command to the user device, so that the user device can communicate and connect with the corresponding target device in each future time period.

The application discloses a driver fatigue awakening device and method, and relates to the technical field of voice interaction. The device comprises a vehicle terminal and a Web voice chat room module. In the vehicle terminal, an intelligent voice dialogue module is used to output dialogue text by using a large language model after receiving a voice interaction instruction of a receiving instruction issuing module. The large language model records the historical dialogue of the driver and selects a question or topic more targeted to the cognitive level of the driver as the dialogue text according to the historical dialogue. A voice synthesis module is used to convert the dialogue text into output voice. An automatic speech recognition module is used to recognize the answering voice of the driver to obtain answering text when the driver answers the output voice, and feed back the answering text to the intelligent voice dialogue module. In the case that the intelligent voice dialogue module fails to affect the driver, the Web voice chat room module is automatically switched to everyone interaction to awaken the driver. The application can relieve the fatigue state of the driver and improve the driving safety.

The utility model discloses a non - wearing type many human body feeling entertainment device under the use of big space, whole device includes frame body, camera, display equipment, processor host computer, additional equipment composition. Among them, camera is linked with processor host computer, and display equipment is linked with processor host computer. Camera, display equipment, processor host computer, accessory equipment all use structural member and fix on frame body. The utility model can combine MR body feeling interactive technology, can directly deploy use under the commercial scene, big space scene, can support many people simultaneously use.

The application discloses a kind of wisdom display terminal multimodal interaction method and system, it is related to wisdom display terminal interaction technical field, including the sensor array of touch sensor, voice collector, image sensor and eye movement tracker composition, real-time acquisition touch position data, voice instruction signal, continuous hand action video sequence and user line of sight coordinate sequence;Each kind of data is converted and extracted processing with pertinence;With terminal current application state and scene classification model determine interaction scene category and corresponding modal priority rule;With the data after processing and modal priority rule synchronous input multimodal fusion intent recognition model, generate final interaction intent instruction;Control terminal execution operation and update application state.The method improves the accuracy of interaction intent recognition and interaction continuity, applicable to wisdom display terminal interaction scene.

The application provides a cloud application system based on WEB communication interaction technology and a method thereof. The cloud application system based on WEB communication interaction technology comprises a webpage front end, a scheduling server and a cloud virtual machine. The webpage front end is used for receiving user operation instructions, providing interfaces and interactive components for users. The cloud virtual machine is used for running application instances and receiving instructions for execution. The scheduling server is used for information transfer, helping the front end and the cloud virtual machine to establish a handshake connection, and monitoring the running state of the webpage front end. The technical scheme of the application relies on remote desktop technology, has a simple overall structure, does not change the application program logic, and has low development cost. Meanwhile, the system adopts an efficient data transmission format, optimizes network delay, and has good network adaptability. Moreover, the technology itself supports a non-GPU running mode, effectively reducing the cost.