978 results about "Interaction device" patented technology

The invention discloses a highway intelligent emergency management method and system, and relates to the technical field of intelligent traffic, and the key points of the technical scheme are that multi-source heterogeneous data are fused to construct a three-dimensional situation awareness library, and accurate positioning and prediction of traffic congestion are realized; constructing a virtual emergency scene on a simulation platform based on a Bayesian network, evaluating traffic management efficiency indexes of different management and control plans, and analyzing accident influence and rescue path feasibility; an optimization objective function is established to solve an optimal resource scheduling scheme, and the optimal resource scheduling scheme is issued to the intelligent interaction device in real time; the Bayesian network and the deep reinforcement learning model are dynamically optimized through equipment feedback data, and scheme self-adaptive adjustment is achieved; according to the scheme, factors such as traffic flow dynamic change, road topology and environment are comprehensively considered, quick response is facilitated when an emergency occurs, rescue time and traffic jam loss are reduced, and the overall level of highway emergency management is improved.

The invention relates to the technical field of medical rehabilitation, and discloses a vestibular function and cognitive function rehabilitation training system and method based on virtual reality, and the rehabilitation training system comprises a hardware platform, a software platform and a server. The hardware platform comprises VR interaction equipment, a head motion tracking sensor and calculation and display equipment; the software platform is integrated with a user management module, a visual stimulation module, a vestibular rehabilitation training module, a cognitive evaluation and training module, a dynamic visual acuity evaluation module and a data management and analysis module. By combining black and white chess grid visual stimulation, standardized vestibular rehabilitation tasks, spatial cognitive testing and DVA objective monitoring, synchronous evaluation and personalized collaborative intervention of vestibular functions and cognitive functions of dizzy patients are realized. According to the method, the problems of boring traditional rehabilitation means, subjective evaluation and lack of quantitative feedback are solved, and the scientificity, interestingness and curative effect testability of rehabilitation training are remarkably improved.

The invention relates to the technical field of intelligent robots, and discloses an automobile cabin intelligent robot arm device which comprises a multi-axis robot arm, a controller, an in-automobile space sensing device and an intelligent interaction device, and the multi-axis robot arm, the controller, the in-automobile space sensing device and the intelligent interaction device are all installed in an automobile cabin. The robot arm comprises a base rotating motor, an arm motor, a palm motor, a capacitance sensor, a pressure sensor, a USB / Type-C interface, a wireless charging interface, a magnetic attraction interface and the like. The in-vehicle space sensing device comprises a camera, a millimeter wave radar and the like. According to the intelligent robot arm device of the automobile cabin, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete object taking operation at a long distance or a view blind area position; distraction caused by the fact that a driver takes objects towards the back row can be avoided, and driving safety is improved. Meanwhile, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete service operations such as article storage, article fixing, games and caring; and the intelligent experience of the cabin is improved.

An electronic interactive device includes an interaction surface for use with a user borne device. The interaction surface includes a contact detection surface for detecting a device contact event with the interaction surface; a plurality of magnetometers defining a reference coordinate system and a sensing volume proximate to the interaction surface, with each of the magnetometers having a rigid spatial relationship to the other magnetometers; and processing circuitry communicably coupled to at least the contact detection surface and the plurality of magnetometers. The plurality of magnetometers perform magnetic field measurements and provide measurement data to the processing circuitry. The processing circuitry determines at least one of position and / or magnet orientation relative to a longitudinal axis of the user borne device and a distance separating the magnet and / or magnet orientation relative to a longitudinal axis of the user borne device from the interaction surface when the contact event occurs.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention relates to the field of image processing, and discloses an infrared light shadow interaction system and method. The system comprises an image input device, an interaction main platform, an infrared interaction device and a video output device, wherein the image input device is used for acquiring a contour image drawn by a user; the interaction main platform is used for preprocessing the contour image to obtain a mask combination image, and then performing layer synthesis on the mask combination image and a preset static ancient painting material to obtain a multi-layer image; the infrared interaction equipment is used for capturing a laser point track of a user operation point; and the video output equipment is used for displaying the multi-layer image and binding the coordinate information of the laser points with the coordinate position of the mask combination image so as to control the position of the mask combination image in the multi-layer image based on the coordinate information of the laser points. According to the application, an interaction system with user input, intelligent processing and dynamic display feedback is constructed, and a whole-process closed loop from user creation, image processing and immersive interaction is realized.

The invention provides a screen interaction method and device, a display device and a storage medium, and the method comprises the steps: obtaining a hand key point of a master control person controlling a target screen, and carrying out the user positioning and skeleton tracking of a target image containing the master control person to determine the hand key point; according to the three-dimensional position information of each hand key point, target pose information of a hand limb of the master control person is determined, and the target pose information comprises at least one of the curvature, the pointing direction and the movement trend; determining a target gesture of the master control person according to the target pose information of the hand limb and standard pose information of the hand limb in the preset gestures; and performing interaction control on the target screen in response to an operation event corresponding to the target gesture. According to the technical scheme, additional interaction equipment such as a mouse does not need to be configured, the equipment configuration cost is reduced, hand pointing analysis is performed based on the three-dimensional space to determine the target interaction position, the interaction accuracy is ensured, and then the interaction performance is improved.

The invention discloses a micro-grid off-grid operation distributed control method based on consistency cooperation, belongs to the field of new energy micro-grid control, and aims to solve the problems of high single-point fault risk and single control target of existing centralized control. The method is operated in a three-layer architecture formed by a distribution network master station control layer, a micro-grid coordination control layer and an equipment distributed coordination control layer, a distributed communication network is constructed through edge agents, and weight coefficients and security constraints are configured; the edge agent receives a master station total power target, collects and interacts equipment data, calculates and limits amplitude to obtain a final power instruction based on a consistency updating law fusing global power difference distribution, energy storage SOC balance and system loss minimization, and then decomposes the final power instruction into equipment-level instructions to be issued and executed. According to the method, a single-point fault is eliminated, multi-target collaborative optimization is realized, control is simplified, expansibility is high, and power balance and stable and efficient operation when the micro-grid is off-grid are effectively guaranteed.

Systems and methods for intelligent Human Interface Devices (HIDs) interactions. In some embodiments, an HID may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the HID to: process raw user input via an Artificial Intelligence (AI) model to produce processed user input; and transmit the processed user input to an Information Handling System (IHS) coupled to the HID.

The invention discloses a dynamic risk management and control method and system for an operation process and field interaction equipment, and relates to the technical field of industrial internet, machine vision and intrinsic safety control. The invention aims to solve the technical problems that the physical state and the digital approval in the existing job management are disjointed, the existing job management is easily attacked by multimedia data fraud (such as screen copying and historical photo forgery), and the control instruction is lagged in a dynamic environment. The method comprises the following steps: a system and a field controller establish bidirectional heartbeat monitoring based on a hardware watchdog, and equipment is set in a physical locking state by default; responding to the operation request, and acquiring multimedia evidence containing a bottom hardware level tamper-proof space-time fingerprint by utilizing a hardware security unit (SE) of the field interaction equipment; the authenticity and the space-time legality of hardware fingerprints are verified at first, and then moire detection, reflection analysis and semantic comparison are conducted through an AI algorithm; and only when the anti-counterfeiting and the content verification are both passed, generating an encryption driving signal to unlock. During operation, a state competition processing mechanism is introduced, if the environment is suddenly changed, the system preferentially suspends the authority through high-priority hardware interruption, and fault-oriented security (Fail-Safe) is achieved. According to the invention, through deep fusion of software and hardware, active defense and millisecond-level dynamic fusing of operation risks are realized.

The invention provides a display screen dynamic control method and system, and relates to the technical field of data processing, the method comprises the following steps: constructing a space coordinate system comprising a plurality of entity nodes, the entity nodes comprising a display screen preset angular point, a user binocular vision center and a handheld interaction device; analyzing a relative pose relationship among the nodes by calculating a projection dot product of a space vector corresponding to each node; constructing a dynamic topology network based on the relative pose relationship, and synchronously collecting environment illumination intensity, user fixation point coordinates and user pose data; performing time sequence synchronization and Kalman filtering preprocessing on the acquired multi-modal data to obtain an initial feature set; and generating a spatial calibration coefficient according to the distribution characteristics of the dynamic topology network, and performing normalization compensation on the initial feature set through the calibration coefficient to obtain a calibrated multi-modal sensing feature vector. According to the invention, accurate and intelligent dynamic control is realized.

Provided is a self-leveling rotary handling-type multi-autonomous underwater vehicle (AUV) docking and transfer device and its method. The device includes a docking module, a vertical handling module, and a rotary handling module; the docking module includes a rotary platform with a guide frame, and a top surface of the rotary platform is provided with a first clamping device; the vertical handling module is mounted on a side of the docking module; the vertical handling module includes a liftable handling platform, and the handling platform is provided with a locking device and a second clamping device; the rotary handling module is mounted below the docking module; the rotary handling module includes a multi-branch rotating shaft and a horizontal plate mounted on each branch rotating shaft; and the horizontal plate is arranged with an AUV charging and information interaction device and a third clamping device.

The invention relates to an autism spectrum disorder screening application system which comprises a front-end user interaction device and a background data processing server. The front-end user interaction device comprises a child information management module; the scale screening module is used for providing at least one autism screening scale for the user to select and fill, and generating a scale screening score after receiving a scale answer filled by the user; the photo screening module is used for receiving at least one child front face image uploaded by the user, preprocessing the face image and then calling a photo analysis model to generate a photo screening score; the screening process of the front-end user interaction device comprises the steps that after a user selects a target child through the child information management module, operation of the scale screening module and the photo screening module is completed in sequence, and the background data processing server generates a comprehensive score and a risk level for scale screening scores and photo screening scores through a weighted voting mechanism. Through the application system, accurate ASD pre-diagnosis classification can be quickly provided.

The invention discloses a data annotation method, which comprises the following steps of: acquiring a natural language instruction input by a user and interactive operation data triggered by the user through interactive equipment, acquiring interactive interface data when an application runs, and then extracting task description of at least one task according to the natural language instruction, according to the timestamp of the natural language instruction, the timestamp of the interaction operation data and the timestamp of the interaction interface data, associating task description of a target task in the at least one task with a target interaction operation in the at least one interaction operation and a target interaction interface in the interaction interface data, and obtaining annotation data; the annotation data is used for training or testing an artificial intelligence (AI) agent. According to the method, the natural language instruction, the interaction operation data and the interaction interface data are automatically collected, and different types of data are automatically aligned based on the timestamps, so that automatic data labeling of the interaction task is realized, high-quality labeling data is provided for intelligent agents of training or testing applications, and the cost is reduced.

The embodiment of the invention provides a voice wake-up method and device for a camera unit, electronic equipment and a storage medium, first user voice sent by interaction equipment is received, corresponding voice feature data is obtained according to the first user voice, and the voice feature data represents the voice content of the first user voice; the voice feature data are processed through a large language model, a first execution instruction is generated, and the instruction content of the first execution instruction is matched with the user intention corresponding to the voice content; and sending the first execution instruction to the interaction device to call a camera unit of the interaction device to shoot a target image. The first user voice is processed through the large voice model, the first execution instruction matched with the user intention corresponding to the voice content is generated, then the first execution instruction is sent to the interaction device to call the camera shooting unit to shoot the target image, the camera shooting unit does not need to be triggered to shoot by using a fixed voice wake-up word, the false wake-up rate is reduced, and the user experience is improved. And the man-machine interaction experience is improved.

The invention relates to the technical field of intelligent warehousing, and particularly discloses a vertical lifting type sorting warehouse and a control method thereof. The sorting warehouse comprises a frame structure, a lifting device, a tray bearing mechanism, a goods allocation forming unit, an access channel assembly, a central control module and a man-machine interaction device, and high-density storage and rapid access of multiple trays in a three-dimensional space are achieved through modular arrangement. The control method comprises the steps of task analysis, sorting scheduling, path conflict detection, performance feedback optimization and the like, a scheduling sequence is constructed based on task vectors, trays are driven to ascend and descend in sequence, goods allocation interaction is conducted, and the control method has the advantages of being clear in task structure, stable in path execution, high in scheduling adaptability and the like. The method is suitable for various three-dimensional storage application scenes such as e-commerce logistics, industrial manufacturing and medicine distribution.

Provided are a method and a system for cooperative airborne meteorological perception with multiple aircraft. The method includes: determining a training set based on a spatial position, motion data, weather, an observation image, and static information of each of multiple aircraft; determining a fusion performance function based on an objective of a cooperative perception network; generating a fusion model based on the training set and the fusion performance function; generating a perception result image based on the fusion model; determining flight risk information based on the perception result image; determining a route alarm command and sending the route alarm command to a management user interface and an interactive device of a target aircraft; after receiving the route alarm command, generating, by the management user interface, a route adjustment parameter; in response to obtaining the route adjustment parameter, performing at least one of the following operations: adjusting an engine velocity, adjusting an aileron pressure, adjusting an elevator deflection, and adjusting a rudder deflection.

The invention discloses an interaction method, an interaction device and an interaction system of refrigeration equipment and the refrigeration equipment, and belongs to the technical field of refrigeration equipment. The interaction method of the refrigeration equipment comprises the steps that interaction data of a user and the refrigeration equipment are obtained, the interaction data at least comprise image interaction data and voice interaction data, and food material storing and taking position information of the refrigeration equipment is obtained; extracting image feature information of the image interaction data, and inputting the image feature information and the food material access position information into the visual large model to obtain a first interaction result output by the visual large model; extracting first voice feature information of the voice interaction data, and inputting the first voice feature information into the large voice model to obtain a second interaction result output by the large voice model; and outputting target interaction information based on the first interaction result and the second interaction result. The intention and the demand of the user can be more comprehensively understood, so that the interaction accuracy is improved.

The embodiment of the invention belongs to the technical field of artificial intelligence, and relates to a training data acquisition system based on teleoperation, which is characterized in that a master end interaction device, a slave end image sensor, a slave end robot and a force / touch sensor are respectively in communication connection with a controller; the controller is used for sending operation text prompt information to an operator; acquiring action data in the target operation executed by the operator, wherein the action data is acquired through the main end interaction device; generating a motion instruction based on the motion data; after the slave-end robot completes the target following operation, the grabbing posture of the slave-end robot is obtained; and / or acquiring a first target image acquired by a slave end image sensor; and / or acquiring a force parameter acquired by a force / touch sensor; and taking the operation text prompt information and the corresponding grabbing posture, and / or the first target image, and / or the force parameter as operation training data. The invention further provides a related method, device and the like. According to the technical scheme, more comprehensive and accurate training data samples can be acquired.

A device may capture real-time images of a product. Capturing may include using an outward-facing sensor on a device. A device may identify the product by using an identification machine learning model. A device may obtain user interaction data corresponding to previous images displayed on the device. A device may identify available offers. A device may identify a set of offers from the available offers using an offer selection machine learning model trained to automatically select offers presentable to users through devices. The offer selection machine learning model may be trained using a dataset of historical interaction data and corresponding offers. A device may present the set of offers through the device. A device may monitor in real-time user interaction with the set of offers. A device may update the offer selection machine learning model according to the real-time user interaction with the set of offers.

A dialogue-based artificial intelligence system for interaction management in digital commerce, consisting of: a housing that encloses an arrangement of interconnected printed circuit boards; a conversation processing unit arranged on a first circuit board, comprising a syntactic parsing processor for generating hierarchical parse structures from user input texts, a semantic embedding processor for generating high-dimensional semantic vectors from the parsed structures, and a dialogue state calculation circuit for managing a multi-level conversation memory using clocked recurrent memory buffers; a retrieval augmentation unit arranged on a second circuit board, comprising a vector indexing processor for storing and retrieving domain-specific embedding vectors, a similarity calculation processor for calculating cosine-based semantic distances between the semantic vectors and vectors stored in a knowledge store, and a document reconstruction structure for merging retrieved text segments into a unified context representation; a generative response unit arranged on a third circuit board, comprising a transformer execution processor for executing a quantized transformer architecture for natural language generation, a context fusion circuit for merging the unified context representation with the semantic vectors to generate response conditioning data, and a hallucination suppression circuit for comparing the generated text with retrieved text segments and attenuating content divergence beyond a predetermined semantic threshold; a domain integrity check unit that is communicatively connected to the generative response unit, wherein the domain integrity check unit includes a regulatory restriction store that stores domain-driven rules, and a conformance assessment processor configured to check generated responses for conformance with the domain-driven rules, blocking non-conforming segments or replacing them using verified text content from the retrieval extension unit; a knowledge storage array comprising at least one static domain repository for storing commercial specifications, regulatory guidelines, product descriptions, and domain documents, a dynamic interaction buffer for storing anonymized conversation state data, and a vector storage partition for storing embedding vectors that can be retrieved by the vector indexing processor; and a multi-interaction device consisting of a touchscreen panel, an array microphone, a speaker structure and a contactless communication interface, each configured to receive multimodal user inputs or generate multimodal system outputs.

The invention discloses an intelligent pickup and speech recognition system based on multi-modal fusion, and relates to the technical field of artificial intelligence and speech recognition crossing. The system comprises a main control module, a plurality of syllable points and a multi-modal fusion engine, wherein the multi-modal fusion engine comprises four core components, namely a sound source localization and separation component, an environment adaptive noise reduction component, a cross-modal feature fusion component and a dynamic context understanding component. Multi-modal data are acquired through an array microphone and an auxiliary sensor group, and the system realizes sound source localization and separation, dynamic environment noise suppression, multi-modal feature deep fusion and context semantic correction. According to the method, the robustness, the accuracy and the intelligent interaction capability of voice recognition are effectively improved, the voice interaction experience is improved in complex scenes such as a noise environment and accent change, and a more reliable voice processing solution is provided for intelligent voice interaction equipment.

The invention relates to the technical field of voice semantics, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a voice interaction control method, device, equipment and medium, and the method comprises the steps: obtaining multi-mode perception data, and constructing a dynamic scene model; session feature parameters are extracted and input into a decision model to generate a strategy parameter set; a dialogue process and expected voice output are generated according to the strategy parameter set and voice characteristics of the voice interaction device; controlling the voice interaction device to execute voice output and collect actual voice output; monitoring an error between the actual voice output and the expected voice output, and performing compensation adjustment; and collecting feedback data after the voice interaction session is ended, and optimizing the model and the control parameters according to the feedback data. According to the method, closed-loop control of perception, decision, output and feedback is established, so that the voice interaction equipment can dynamically adjust voice output according to a real-time environment and user characteristics and continuously perform self-learning optimization, and the accuracy and naturalness of voice interaction are improved.

The invention provides an AR-based thermoelectric unit fault visual diagnosis method and system, and the method comprises the steps: obtaining a thermoelectric unit operation data set, constructing an AR three-dimensional scene model containing a virtual part model and a spatial position association relation, carrying out the fault feature extraction of the thermoelectric unit operation data set, and carrying out the fault feature extraction of the AR three-dimensional scene model; the method comprises the steps of obtaining a fault feature set reflecting equipment operation state abnormity, performing space mapping on the fault feature set and an AR three-dimensional scene model, and generating fault visualization information which is superposed on the surface of a virtual component model and comprises abnormity type identification, influence range and development trend description; according to the method, the AR interaction device performs interaction diagnosis operation on the fault visualization information, including checking of abnormal parameters, simulation of fault isolation and generation of processing suggestions, so that visual and accurate diagnosis of the faults of the thermoelectric unit is realized, and the fault processing efficiency and convenience are improved.

The invention provides an interaction method and an interaction device based on a large model and a vehicle, the method relates to the field of vehicles, the method is applied to a vehicle enterprise platform, the vehicle enterprise platform carries the large model, the method comprises the following steps: obtaining input content of a user, and analyzing the input content to obtain N tasks, N being an integer greater than 0; determining a target task chain from a plurality of task chains associated with the large model according to the N tasks; and processing the N tasks based on the target task chain to generate target output content corresponding to the input content. According to the method, the intelligent degree of large model interaction in a car business scene can be improved.

The invention relates to the technical field of robot control, and discloses a control system for an industrial robot, and the system comprises a front-end interaction device which is used for providing a human-computer interaction interface; the programmable controller is respectively connected with the plurality of industrial robots and is used for motion control and algorithm processing of the plurality of industrial robots; the programmable controller comprises a back-end service unit and a programmable control program unit; wherein the rear-end service unit is configured to communicate with the front-end interaction equipment and process an instruction received by the front-end interaction equipment so as to control the programmable control program unit to execute a control program; and the programmable control program unit communicates with the back-end service unit and is configured to execute a control program so as to control each industrial robot. The system not only effectively reduces the hardware cost, but also ensures the operation reliability of the system. The invention further discloses a control method for the industrial robot and the programmable controller.

The utility model discloses a man-machine interaction device and a vehicle, and relates to the technical field of electronic equipment, and the man-machine interaction device comprises a piezoelectric assembly and a control module. The piezoelectric assembly is configured to generate a first electric signal in response to external vibration; the control module comprises a control unit and a signal analysis assembly, the signal analysis assembly is connected with the piezoelectric assembly through a first transmission circuit, and the signal analysis assembly is connected with the control unit through a first communication circuit. Wherein the signal analysis assembly receives and analyzes the first electric signal through the first transmission circuit and transmits an analysis result to the control unit through the first communication circuit, and the control unit at least controls the working state of the signal analysis assembly based on the analysis result.

The invention relates to the technical field of intelligent learning planning, and discloses an intelligent learning planning system based on multi-dimensional learning data driving. Comprising a main control module, a multi-modal data acquisition module, a data quality enhancement module, a multi-modal feature fusion module, a dynamic strategy planning module, a man-machine intention alignment module, a knowledge topology management module, an evaluation and federal optimization module and an auxiliary visualization module, and the main control module is used for coordinating operation of each module and data scheduling; the multi-modal data acquisition module acquires HRV, EDA and other physiological signals through a wearable device, records a fixation track and an alpha wave proportion through an eye tracker / electroencephalograph, and receives a user instruction in real time through a voice interaction device. According to the method, the dynamic adaptability is higher, full-process dynamic adjustment of stage division-parameter fine adjustment-load balance is achieved through hierarchical reinforcement learning and NSGA-III optimization, and a learning path can be flexibly adapted according to the real-time state (such as sudden fatigue and rapid knowledge point mastering) of a user.

Methods and apparatus for dynamic video recording alignment are provided. A video alignment system receives a first signal indicating that an interaction device comprising a screen is in use. Responsive to the first signal, the system instructs the interaction device to record a series of images displayed on the screen. The system detects flicker in a video recording generated by a camera and depicting the screen, where the video recording comprises one or more defective frames contributing to the flicker. Upon detecting the flicker, the system retrieves one or more images, from the series of images, where the one or more images are recorded by the interaction device at moments of corresponding to the flicker. The system superimposes the one or more images onto the one or more defective frames in the video recording.

A dedicated interactive device designed for children comprises an embedded electronic module uniquely paired to a single child via a secure identifier. The device enables conversational and educational interactions, applying a multi-layer artificial intelligence filtering system to block sensitive content. Interaction data are encrypted and stored locally when offline, with secure synchronization to the cloud upon reconnection. A cloud-based parental dashboard allows management of one or multiple child profiles, language and voice preferences, review of time-stamped interaction logs, and configuration of usage controls. The system features privacy-by-design principles, including data minimization, strong encryption, authentication, and regulatory compliance. Optional components, such as cameras or displays, are integrated under the same safety and privacy framework. The platform unifies secure device-child pairing, robust AI filtering, comprehensive parental control, and enhanced protection of children's data in a single system.