1823 results about "Interaction device" patented technology

The invention discloses a soothing lamp intelligent control method and system based on voice interaction, and relates to the technical field of data encryption, and the method comprises the steps: receiving a voice command inputted by a user through a voice interaction device, awakening a control system, and starting a voice emotion recognition unit; the voice emotion recognition unit is used for performing emotion analysis on the voice command, extracting emotion characteristics and judging real-time emotion of the user; on the basis of continuous voice input of a user, voice signals are collected regularly, the emotional state is updated dynamically, and light setting is optimized in combination with environmental data; by recording historical voice interaction data and environment data of a user, an emotion mode and light preference of the user are learned, and light setting is continuously optimized. Light setting is continuously optimized through a self-learning mechanism, it is ensured that the system can conduct self-adaptive adjustment along with changes of user requirements, and light control is more intelligent and personalized.

The invention discloses absolute pointing equipment, an absolute pointing method and interactive equipment. In order to solve the problems of high power consumption, low real-time performance and high cost in the existing scheme, a DVS is arranged in a pointing device and is used for sensing a flicker light source arranged on a pointed device; the pointed device is provided with three or more flickering light sources, and at least three flickering light sources are not collinear. Filtering the event stream output by the DVS, extracting pixel coordinates associated with the flicker light sources, and identifying the identifier of each flicker light source; obtaining a pose parameter of the camera according to the pixel coordinates associated with the flicker light source, and obtaining optical axis information of the camera according to the pose parameter of the camera; according to the optical axis information of the camera, obtaining coordinate information of an intersection point of the optical axis of the camera and the coplanar where the at least three flickering light sources are located; and the pointed device executes a corresponding response according to the coordinate information of the intersection point. The method has the advantages of low cost, low power consumption and high real-time performance.

The invention discloses a relative pointing device and method and an interaction device. In order to solve the problems of high power consumption, low real-time performance and high cost in an existing scheme, the relative pointing method comprises the steps that a DVS is arranged in pointing equipment and used for sensing flickering light sources arranged on pointed equipment, the pointed equipment is provided with at least two flickering light sources, and corresponding imaging points are formed in the DVS; and according to the geometric center of the imaging point, the DVS resolution and the resolution of the pointed device, mapping the geometric center to the pointed device to obtain a mapping point. The invention has the advantages of low cost, low power consumption and high real-time performance, and can realize the relative pointing of the user to the pointed equipment.

An interactive device is described that is configured to: display an output of a remote device, wherein an output delay exists between the output being generated by the remote device and the output being displayed on the interactive device, generate an interaction data in dependence on an interaction with the interactive device at a location, transmit the interaction data to the remote device, display an updated output of the remote device, the updated output being generated by the remote device subsequent to receiving the interaction data, wherein the interactive device being further configured to: generate an interaction image of an area of the updated output of the remote device corresponding to the location of the interaction, determine an interaction indication in dependence on the interaction image, displaying an interaction indication on the interactive device at a location of one or more further interactions with the interactive device.

The invention discloses a highway intelligent emergency management method and system, and relates to the technical field of intelligent traffic, and the key points of the technical scheme are that multi-source heterogeneous data are fused to construct a three-dimensional situation awareness library, and accurate positioning and prediction of traffic congestion are realized; constructing a virtual emergency scene on a simulation platform based on a Bayesian network, evaluating traffic management efficiency indexes of different management and control plans, and analyzing accident influence and rescue path feasibility; an optimization objective function is established to solve an optimal resource scheduling scheme, and the optimal resource scheduling scheme is issued to the intelligent interaction device in real time; the Bayesian network and the deep reinforcement learning model are dynamically optimized through equipment feedback data, and scheme self-adaptive adjustment is achieved; according to the scheme, factors such as traffic flow dynamic change, road topology and environment are comprehensively considered, quick response is facilitated when an emergency occurs, rescue time and traffic jam loss are reduced, and the overall level of highway emergency management is improved.

The invention provides a customer service interaction method, an interaction device, equipment, a storage medium and a program product, and relates to the technical field of computers. The customer service interaction method based on the large language model comprises the following steps: performing intention scene recognition on a received user question; identifying that the user question belongs to a specified intention scene, and determining a corresponding domain knowledge base matched with the user question; performing enhanced retrieval on the knowledge base in the corresponding field based on the user question to obtain a business knowledge fragment for enhancing the user question; and inputting the business knowledge fragments into a large language model, so that the large language model performs filtering type question reply processing based on the business knowledge fragments, and outputs reply information of the user question based on a processing result. According to the technical scheme, the real intention of the user in continuous interaction can be deeply analyzed, the content which the user wants to consult can be more accurately grasped, and the consulting requirement of the user is better met.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: running a business application in a virtual machine, and obtaining a business application instruction set; the instruction type of the business application instruction set is an instruction type supported by a processor of the host machine; writing a service application instruction set in a virtual memory of the virtual machine into a shared physical memory in a virtual interaction device corresponding to the virtual machine, and generating writing notification information used for representing a writing completion state of the service application instruction set; the shared physical memory is a physical memory used for being jointly read and written by the virtual machine and the management program in the host machine; and in the management program, obtaining write-in notification information, obtaining the business application instruction set in the shared physical memory through the write-in notification information, and executing the business application instruction set through a processor of the host machine to obtain instruction execution data corresponding to the business application instruction set. By adopting the method and the device, the performance of running the business application by the virtual machine in the host machine can be improved.

The invention relates to the technical field of medical rehabilitation, and discloses a vestibular function and cognitive function rehabilitation training system and method based on virtual reality, and the rehabilitation training system comprises a hardware platform, a software platform and a server. The hardware platform comprises VR interaction equipment, a head motion tracking sensor and calculation and display equipment; the software platform is integrated with a user management module, a visual stimulation module, a vestibular rehabilitation training module, a cognitive evaluation and training module, a dynamic visual acuity evaluation module and a data management and analysis module. By combining black and white chess grid visual stimulation, standardized vestibular rehabilitation tasks, spatial cognitive testing and DVA objective monitoring, synchronous evaluation and personalized collaborative intervention of vestibular functions and cognitive functions of dizzy patients are realized. According to the method, the problems of boring traditional rehabilitation means, subjective evaluation and lack of quantitative feedback are solved, and the scientificity, interestingness and curative effect testability of rehabilitation training are remarkably improved.

The invention relates to the technical field related to intelligent production control, in particular to a coal mine production equipment control method and system based on remote body interaction, and the method comprises the steps: coal mine production equipment uploads parameters, analyzes the state, configures a twin architecture, and carries out local decision abnormity early warning. A remote end is communicated with an interaction device, biological characteristics are reflected as a pose instruction, time delay compensation and track deviation prediction are embedded, a multi-mode feedback unit triggers smooth control according to the pose instruction, and tactile feedback is enhanced in combination with a vibration spectrum. The technical problems that the network condition of the underground coal mine environment is poor, obvious communication delay exists in remote control, operation instruction lagging exists, and the response speed and operation safety of equipment are affected are solved, dynamic time delay is predicted through the LSTM network, track deviation is compensated, the real-time performance and stability of remote control are improved, accurate execution of instructions is ensured, and the service life of the equipment is prolonged. And the remote operation efficiency and reliability of the coal mine equipment are improved through high-precision pose control and real-time compensation.

The invention discloses an immersive travel experience system based on the meta-universe technology, which relates to the field of the meta-universe technology and comprises a scene construction module, an interaction equipment module, a data analysis module and a multi-mode interaction module. According to the immersive text travel experience system, virtual reality, augmented reality and 3D rendering technologies are integrated to construct a virtual text travel scene, special equipment is configured to enable a user to feel the virtual text travel scene personally on the scene, meanwhile, the system can further analyze user behavior data in real time, and the user experience is improved. The virtual scene is adjusted according to the interactive behavior of the user in the virtual travel scene, personalized touring experience is provided, the naturalness and depth of interaction are further enhanced by fusing gestures, voice interaction, eye movement tracking and electroencephalogram signal recognition technologies, the user can obtain richer and more real travel experience, and the user experience is improved. The immersion and individuation degree of cultural tourism are improved, and interesting tourism experience is brought.

The invention provides an AI role interaction method, interaction device and interaction equipment in a game platform, and relates to the technical field of game interaction.The method comprises the steps that a current game scene, game task information and game character information are obtained, and a first behavior parameter set of AI roles is generated; collecting current operation behavior data and voice interaction data of a user; performing intention recognition processing on the operation behavior data and the voice interaction data to generate a user behavior feature vector, and determining a relation link between the user behavior feature vector and at least one of game scene information, task information and character information to generate a dynamic interaction strategy; a second behavior parameter set is generated according to the dynamic interaction strategy, and multi-modal interaction content matched with the second behavior parameter set is rendered and generated; and displaying the multi-modal interaction content to the user terminal. According to the method, the interaction of the AI role can be more real and natural, and the game immersion and satisfaction of the user can be remarkably improved.

The invention provides a networked vehicle safety interaction test and evaluation system based on digital twinning. The system comprises a central control unit module; the digital twin modeling module is used for carrying out modeling on the mapped network connection vehicle, and the digital twin modeling module is in communication signal connection with the central control unit module; the network attack and defense simulation module is in communication connection with the central control unit module and is used for executing vehicle networking attack and defense scenes; and the virtual-real interaction device module is in communication signal connection with the central control unit module and is used for simulating the physical movement of the networked vehicle. According to the invention, the technical problem that part of network connection vehicle safety assessment methods need destructive influence on vehicle hardware on the physical level, so that subsequent continuous assessment is difficult can be solved.

The embodiments of the present invention disclose a scene interaction method, device, storage medium and electronic device. The method includes: obtaining first interaction information sent by any interactive device, wherein the first interaction information includes a user identifier; matching in a user database based on the user identifier to determine the user information corresponding to the user identifier; matching in a script database based on the first interaction information and the user information to determine the second interaction information corresponding to the first interaction information; sending the second interaction information to the interactive device, wherein the interactive device is used to output the second interaction information and collect the user's next first interaction information. The technical solution of the above-mentioned embodiment of the invention realizes personalized recommendation of scripts by matching the user database and the script database with the first interaction information, so that users can get personalized plot guidance, thereby improving the user's immersive experience.

The invention provides a fuel gas recovery system and method based on an intelligent fuel gas supervision internet of things. The system comprises a government supervision management platform, a government supervision sensing network platform, a government supervision object platform, a fuel gas company sensing network platform and a fuel gas equipment object platform, and the government supervision object platform comprises a fuel gas company management platform; the method comprises the following steps: acquiring target detection data and target flow data of a to-be-recycled pipeline from a gas equipment object platform; determining a gas pollution value based on the target detection data and the target flow data; based on the gas pollution value and the target flow data, purification parameters of the purification equipment are determined; determining a recovery instruction, and sending the recovery instruction to at least one user interaction device through the gas device object platform; and in response to the obtained recovery completion instruction, the purification parameters are sent to the fuel gas equipment object platform. The condition that the fuel gas passes through the pipeline is measured through the fuel gas pollution value, then the purification parameters are determined, and the safety of fuel gas recovery can be ensured.

The invention relates to the technical field of environment-friendly production equipment control, and discloses a multi-equipment cooperative dust removal control system for an environment-friendly production line. The system comprises a dust data acquisition module for acquiring and dividing operation data flow of production line equipment; the dust state reconstruction module is used for generating a dust and airflow distribution situation map; the dedusting efficiency evaluation module is associated with the situation map to determine a dedusting level; the regulation and control strategy generation module is used for matching control strategies; and the cooperative control unit performs bidirectional verification to generate a cooperative dust removal instruction. The system is also provided with an industrial communication gateway for realizing protocol interaction, an equipment linkage module for optimizing a dust removal process, an instruction issuing module for controlling equipment operation, and a data archiving module for storing data and generating a record chain. The system can comprehensively collect dust data, accurately evaluate the dust removal efficiency, efficiently cooperate with multi-equipment dust removal, improve the dust removal effect and management level of an environment-friendly production line and reduce energy consumption, and has a good application prospect.

The invention relates to the technical field of intelligent robots, and discloses an automobile cabin intelligent robot arm device which comprises a multi-axis robot arm, a controller, an in-automobile space sensing device and an intelligent interaction device, and the multi-axis robot arm, the controller, the in-automobile space sensing device and the intelligent interaction device are all installed in an automobile cabin. The robot arm comprises a base rotating motor, an arm motor, a palm motor, a capacitance sensor, a pressure sensor, a USB / Type-C interface, a wireless charging interface, a magnetic attraction interface and the like. The in-vehicle space sensing device comprises a camera, a millimeter wave radar and the like. According to the intelligent robot arm device of the automobile cabin, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete object taking operation at a long distance or a view blind area position; distraction caused by the fact that a driver takes objects towards the back row can be avoided, and driving safety is improved. Meanwhile, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete service operations such as article storage, article fixing, games and caring; and the intelligent experience of the cabin is improved.

The invention relates to the technical field of teleoperation, in particular to a teleoperation robot auxiliary control method based on a safety margin theory. The method comprises the following steps: establishing a three-dimensional digital twinborn model according to an image acquisition device, and obtaining a target object distance, a communication time delay size and a motion tracking error; based on the three factors, a fuzzy control theory is adopted to calculate a teleoperation safety margin value, and the safety of the current teleoperation is quantitatively evaluated. And calculating a master-slave motion mapping ratio and an end view display ratio according to the safety margin value. And constructing virtual force guidance according to the safety margin value, feeding back the virtual force guidance to an operator through force feedback equipment, and guiding the operator to complete a teleoperation task in combination with visual interaction equipment. Compared with a traditional teleoperation method, the method can effectively improve teleoperation efficiency and safety, and can better adapt to a complex long-distance working environment.

The invention relates to the technical field of man-machine interaction data, in particular to man-machine interaction equipment and a control method thereof. The method comprises the following steps: acquiring equipment screen operation data, performing time window segmentation, generating a discrete touch event sequence and a dynamic touch feature sequence, clustering and processing the features by utilizing interaction features, forming user operation behavior grouped data, and combining equipment historical interaction data to form a user operation behavior group. Frequent item set mining is carried out to identify a high-frequency operation mode, a user operation preference model is constructed, user operation habits are identified, redundant actions are eliminated, main interaction action data are extracted, interaction intention prediction is carried out on main interaction actions based on historical data of equipment, and dynamic response is carried out on the man-machine interaction equipment according to a prediction result. And effective control is realized. According to the invention, a more personalized and smoother man-machine interaction equipment control method is realized.

The present disclosure provides a method and an apparatus of processing an image, an interactive device, an electronic device, a storage medium, and a computer program product, which relate to a field of image processing technology. The method of processing the image includes: constructing an initial three-dimensional face template by using a plurality of sample face images; performing an iterative optimization on the initial three-dimensional face template by using a face image of a target object, so as to obtain a target three-dimensional face template; and determining a current face pose of the target object according to a corresponding relationship between a current face image of the target object and the target three-dimensional face template.

An electronic interactive device includes an interaction surface for use with a user borne device. The interaction surface includes a contact detection surface for detecting a device contact event with the interaction surface; a plurality of magnetometers defining a reference coordinate system and a sensing volume proximate to the interaction surface, with each of the magnetometers having a rigid spatial relationship to the other magnetometers; and processing circuitry communicably coupled to at least the contact detection surface and the plurality of magnetometers. The plurality of magnetometers perform magnetic field measurements and provide measurement data to the processing circuitry. The processing circuitry determines at least one of position and / or magnet orientation relative to a longitudinal axis of the user borne device and a distance separating the magnet and / or magnet orientation relative to a longitudinal axis of the user borne device from the interaction surface when the contact event occurs.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention discloses a hand function evaluation method, device and equipment and a computer readable storage medium. The method comprises the steps that at least one frame of hand motion image of an evaluated person is acquired through a first image acquisition module; processing the hand motion image through a posture estimation algorithm model carried by the motion analysis model to obtain a hand key point coordinate, and recognizing a gesture in the hand motion image based on the hand key point coordinate through a classification model to obtain a first evaluation result; acquiring a hand grip image of the evaluated person under the counter-acting force of the gesture interaction equipment through a second image acquisition module; detecting the hand grip strength image of the evaluated person through a target detection algorithm model carried by the motion analysis model so as to judge whether the evaluated person can resist the counter-acting force of the interaction equipment or not, and obtaining a second evaluation result; the hand function of the evaluated person is evaluated based on the first evaluation result and the second evaluation result, and the motion function of the evaluated person can be scientifically evaluated.

An integrated well construction system for constructing a well includes equipment controllers which control drilling equipment, and a process controller operatively connected to the equipment controllers. The process controller includes a drilling control module which defines an operational drilling scheme and a task manager module. The operational drilling scheme has a first part to control the drilling equipment, a second part with manual tasks and / or automated tasks to be performed, and a relation between an execution of control of the drilling equipment via the first plan and of manual tasks and / or the automated tasks via the second plan. The task manager module has a user interface, a task refinement component which updates the second part, and a user interaction device which provides a manual addition of new manual tasks and / or new automated tasks, and a removal or amendment of at least one of the manual tasks and / or the automated tasks.

The invention relates to the field of image processing, and discloses an infrared light shadow interaction system and method. The system comprises an image input device, an interaction main platform, an infrared interaction device and a video output device, wherein the image input device is used for acquiring a contour image drawn by a user; the interaction main platform is used for preprocessing the contour image to obtain a mask combination image, and then performing layer synthesis on the mask combination image and a preset static ancient painting material to obtain a multi-layer image; the infrared interaction equipment is used for capturing a laser point track of a user operation point; and the video output equipment is used for displaying the multi-layer image and binding the coordinate information of the laser points with the coordinate position of the mask combination image so as to control the position of the mask combination image in the multi-layer image based on the coordinate information of the laser points. According to the application, an interaction system with user input, intelligent processing and dynamic display feedback is constructed, and a whole-process closed loop from user creation, image processing and immersive interaction is realized.

A method for compensating for dynamic changes in a body of a patient during a controlled interaction with the body includes acquiring data from at least one sensing device disposed on the body and detecting a change along at least one optical fiber of the sensing device caused by dynamic changes associated with the body during the controlled interaction. A respiratory gating signal is generated based on the change along the at least one optical fiber of the sensing device measured over time. The method further comprises controlling relative movement between the body and an interactive device in response to the respiratory gating signal to compensate for the dynamic changes associated with the body during the controlled interaction.

The invention provides a screen interaction method and device, a display device and a storage medium, and the method comprises the steps: obtaining a hand key point of a master control person controlling a target screen, and carrying out the user positioning and skeleton tracking of a target image containing the master control person to determine the hand key point; according to the three-dimensional position information of each hand key point, target pose information of a hand limb of the master control person is determined, and the target pose information comprises at least one of the curvature, the pointing direction and the movement trend; determining a target gesture of the master control person according to the target pose information of the hand limb and standard pose information of the hand limb in the preset gestures; and performing interaction control on the target screen in response to an operation event corresponding to the target gesture. According to the technical scheme, additional interaction equipment such as a mouse does not need to be configured, the equipment configuration cost is reduced, hand pointing analysis is performed based on the three-dimensional space to determine the target interaction position, the interaction accuracy is ensured, and then the interaction performance is improved.

The invention discloses an underground space layout scheme VR visual interaction device and interaction method. The interaction device comprises a three-dimensional graphic processing unit, a virtual reality interaction terminal, a design software synchronization interface and a collaborative design communication module, wherein the virtual reality interaction terminal, the design software synchronization interface and the collaborative design communication module interact with the three-dimensional graphic processing unit. The three-dimensional graphic processing unit adopts a high-performance graphic processor and a special graphic acceleration chip, converts two-dimensional plane layout data into a three-dimensional space model and performs real-time rendering; the virtual reality interaction terminal serves as a direct interface for user experience and is integrated with the three-dimensional graphic processing unit through a low-delay wireless transmission module. The design software synchronization interface realizes data exchange with external design software and synchronizes modification to the three-dimensional graphic processing unit; and the collaborative design communication module is used for supporting real-time collaboration and communication of multiple users in the virtual environment. According to the method, high-performance hardware and special software are combined, so that rapid visualization and real-time interaction of underground space layout are realized.

A method for compensating for dynamic changes in a body of a patient during a controlled interaction with the body includes acquiring data from at least one sensing device disposed on the body and detecting a change along at least one optical fiber of the sensing device caused by dynamic changes associated with the body during the controlled interaction. A respiratory gating signal is generated based on the change along the at least one optical fiber of the sensing device measured over time. The method further comprises controlling relative movement between the body and an interactive device in response to the respiratory gating signal to compensate for the dynamic changes associated with the body during the controlled interaction.

The invention discloses a micro-grid off-grid operation distributed control method based on consistency cooperation, belongs to the field of new energy micro-grid control, and aims to solve the problems of high single-point fault risk and single control target of existing centralized control. The method is operated in a three-layer architecture formed by a distribution network master station control layer, a micro-grid coordination control layer and an equipment distributed coordination control layer, a distributed communication network is constructed through edge agents, and weight coefficients and security constraints are configured; the edge agent receives a master station total power target, collects and interacts equipment data, calculates and limits amplitude to obtain a final power instruction based on a consistency updating law fusing global power difference distribution, energy storage SOC balance and system loss minimization, and then decomposes the final power instruction into equipment-level instructions to be issued and executed. According to the method, a single-point fault is eliminated, multi-target collaborative optimization is realized, control is simplified, expansibility is high, and power balance and stable and efficient operation when the micro-grid is off-grid are effectively guaranteed.

The invention relates to a full-automatic slit lamp and an intelligent diagnosis method thereof, and aims to improve the ophthalmic examination efficiency and accuracy. The slit lamp is composed of a slit lamp device, an automatic adjusting device and a man-machine interaction device. The automatic adjusting device comprises a calculation module and an adjusting module, and the adjusting module accurately drives the slit lamp device through gear transmission and automatically adjusts operation parameters according to a preset mode. The display module of the man-machine interaction device can display the working mode, the eye image data and the interaction information, and the prompt module guides the examinee to cooperate with the examination. The camera element of the slit lamp device converts the light into image data, and the communication device transmits the data to the cloud. And during fault diagnosis, the calculation element monitors image data in real time, marks abnormities through a visual algorithm, and enters a diagnosis mode. After different modes are operated for multiple times, the calculation unit analyzes imaging result abnormity, accurately locates and displays fault components, realizes automatic fault diagnosis, and reduces maintenance cost.