1400 results about "Interaction device" patented technology

The invention discloses a highway intelligent emergency management method and system, and relates to the technical field of intelligent traffic, and the key points of the technical scheme are that multi-source heterogeneous data are fused to construct a three-dimensional situation awareness library, and accurate positioning and prediction of traffic congestion are realized; constructing a virtual emergency scene on a simulation platform based on a Bayesian network, evaluating traffic management efficiency indexes of different management and control plans, and analyzing accident influence and rescue path feasibility; an optimization objective function is established to solve an optimal resource scheduling scheme, and the optimal resource scheduling scheme is issued to the intelligent interaction device in real time; the Bayesian network and the deep reinforcement learning model are dynamically optimized through equipment feedback data, and scheme self-adaptive adjustment is achieved; according to the scheme, factors such as traffic flow dynamic change, road topology and environment are comprehensively considered, quick response is facilitated when an emergency occurs, rescue time and traffic jam loss are reduced, and the overall level of highway emergency management is improved.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: running a business application in a virtual machine, and obtaining a business application instruction set; the instruction type of the business application instruction set is an instruction type supported by a processor of the host machine; writing a service application instruction set in a virtual memory of the virtual machine into a shared physical memory in a virtual interaction device corresponding to the virtual machine, and generating writing notification information used for representing a writing completion state of the service application instruction set; the shared physical memory is a physical memory used for being jointly read and written by the virtual machine and the management program in the host machine; and in the management program, obtaining write-in notification information, obtaining the business application instruction set in the shared physical memory through the write-in notification information, and executing the business application instruction set through a processor of the host machine to obtain instruction execution data corresponding to the business application instruction set. By adopting the method and the device, the performance of running the business application by the virtual machine in the host machine can be improved.

The invention relates to the technical field of medical rehabilitation, and discloses a vestibular function and cognitive function rehabilitation training system and method based on virtual reality, and the rehabilitation training system comprises a hardware platform, a software platform and a server. The hardware platform comprises VR interaction equipment, a head motion tracking sensor and calculation and display equipment; the software platform is integrated with a user management module, a visual stimulation module, a vestibular rehabilitation training module, a cognitive evaluation and training module, a dynamic visual acuity evaluation module and a data management and analysis module. By combining black and white chess grid visual stimulation, standardized vestibular rehabilitation tasks, spatial cognitive testing and DVA objective monitoring, synchronous evaluation and personalized collaborative intervention of vestibular functions and cognitive functions of dizzy patients are realized. According to the method, the problems of boring traditional rehabilitation means, subjective evaluation and lack of quantitative feedback are solved, and the scientificity, interestingness and curative effect testability of rehabilitation training are remarkably improved.

The invention relates to the technical field related to intelligent production control, in particular to a coal mine production equipment control method and system based on remote body interaction, and the method comprises the steps: coal mine production equipment uploads parameters, analyzes the state, configures a twin architecture, and carries out local decision abnormity early warning. A remote end is communicated with an interaction device, biological characteristics are reflected as a pose instruction, time delay compensation and track deviation prediction are embedded, a multi-mode feedback unit triggers smooth control according to the pose instruction, and tactile feedback is enhanced in combination with a vibration spectrum. The technical problems that the network condition of the underground coal mine environment is poor, obvious communication delay exists in remote control, operation instruction lagging exists, and the response speed and operation safety of equipment are affected are solved, dynamic time delay is predicted through the LSTM network, track deviation is compensated, the real-time performance and stability of remote control are improved, accurate execution of instructions is ensured, and the service life of the equipment is prolonged. And the remote operation efficiency and reliability of the coal mine equipment are improved through high-precision pose control and real-time compensation.

The invention provides an AI role interaction method, interaction device and interaction equipment in a game platform, and relates to the technical field of game interaction.The method comprises the steps that a current game scene, game task information and game character information are obtained, and a first behavior parameter set of AI roles is generated; collecting current operation behavior data and voice interaction data of a user; performing intention recognition processing on the operation behavior data and the voice interaction data to generate a user behavior feature vector, and determining a relation link between the user behavior feature vector and at least one of game scene information, task information and character information to generate a dynamic interaction strategy; a second behavior parameter set is generated according to the dynamic interaction strategy, and multi-modal interaction content matched with the second behavior parameter set is rendered and generated; and displaying the multi-modal interaction content to the user terminal. According to the method, the interaction of the AI role can be more real and natural, and the game immersion and satisfaction of the user can be remarkably improved.

The invention relates to the technical field of environment-friendly production equipment control, and discloses a multi-equipment cooperative dust removal control system for an environment-friendly production line. The system comprises a dust data acquisition module for acquiring and dividing operation data flow of production line equipment; the dust state reconstruction module is used for generating a dust and airflow distribution situation map; the dedusting efficiency evaluation module is associated with the situation map to determine a dedusting level; the regulation and control strategy generation module is used for matching control strategies; and the cooperative control unit performs bidirectional verification to generate a cooperative dust removal instruction. The system is also provided with an industrial communication gateway for realizing protocol interaction, an equipment linkage module for optimizing a dust removal process, an instruction issuing module for controlling equipment operation, and a data archiving module for storing data and generating a record chain. The system can comprehensively collect dust data, accurately evaluate the dust removal efficiency, efficiently cooperate with multi-equipment dust removal, improve the dust removal effect and management level of an environment-friendly production line and reduce energy consumption, and has a good application prospect.

The invention relates to the technical field of intelligent robots, and discloses an automobile cabin intelligent robot arm device which comprises a multi-axis robot arm, a controller, an in-automobile space sensing device and an intelligent interaction device, and the multi-axis robot arm, the controller, the in-automobile space sensing device and the intelligent interaction device are all installed in an automobile cabin. The robot arm comprises a base rotating motor, an arm motor, a palm motor, a capacitance sensor, a pressure sensor, a USB / Type-C interface, a wireless charging interface, a magnetic attraction interface and the like. The in-vehicle space sensing device comprises a camera, a millimeter wave radar and the like. According to the intelligent robot arm device of the automobile cabin, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete object taking operation at a long distance or a view blind area position; distraction caused by the fact that a driver takes objects towards the back row can be avoided, and driving safety is improved. Meanwhile, the intelligent robot arm is controlled through voice or keys and the like, and the robot arm replaces personnel to complete service operations such as article storage, article fixing, games and caring; and the intelligent experience of the cabin is improved.

An electronic interactive device includes an interaction surface for use with a user borne device. The interaction surface includes a contact detection surface for detecting a device contact event with the interaction surface; a plurality of magnetometers defining a reference coordinate system and a sensing volume proximate to the interaction surface, with each of the magnetometers having a rigid spatial relationship to the other magnetometers; and processing circuitry communicably coupled to at least the contact detection surface and the plurality of magnetometers. The plurality of magnetometers perform magnetic field measurements and provide measurement data to the processing circuitry. The processing circuitry determines at least one of position and / or magnet orientation relative to a longitudinal axis of the user borne device and a distance separating the magnet and / or magnet orientation relative to a longitudinal axis of the user borne device from the interaction surface when the contact event occurs.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

An integrated well construction system for constructing a well includes equipment controllers which control drilling equipment, and a process controller operatively connected to the equipment controllers. The process controller includes a drilling control module which defines an operational drilling scheme and a task manager module. The operational drilling scheme has a first part to control the drilling equipment, a second part with manual tasks and / or automated tasks to be performed, and a relation between an execution of control of the drilling equipment via the first plan and of manual tasks and / or the automated tasks via the second plan. The task manager module has a user interface, a task refinement component which updates the second part, and a user interaction device which provides a manual addition of new manual tasks and / or new automated tasks, and a removal or amendment of at least one of the manual tasks and / or the automated tasks.

The invention relates to the field of image processing, and discloses an infrared light shadow interaction system and method. The system comprises an image input device, an interaction main platform, an infrared interaction device and a video output device, wherein the image input device is used for acquiring a contour image drawn by a user; the interaction main platform is used for preprocessing the contour image to obtain a mask combination image, and then performing layer synthesis on the mask combination image and a preset static ancient painting material to obtain a multi-layer image; the infrared interaction equipment is used for capturing a laser point track of a user operation point; and the video output equipment is used for displaying the multi-layer image and binding the coordinate information of the laser points with the coordinate position of the mask combination image so as to control the position of the mask combination image in the multi-layer image based on the coordinate information of the laser points. According to the application, an interaction system with user input, intelligent processing and dynamic display feedback is constructed, and a whole-process closed loop from user creation, image processing and immersive interaction is realized.

The invention provides a screen interaction method and device, a display device and a storage medium, and the method comprises the steps: obtaining a hand key point of a master control person controlling a target screen, and carrying out the user positioning and skeleton tracking of a target image containing the master control person to determine the hand key point; according to the three-dimensional position information of each hand key point, target pose information of a hand limb of the master control person is determined, and the target pose information comprises at least one of the curvature, the pointing direction and the movement trend; determining a target gesture of the master control person according to the target pose information of the hand limb and standard pose information of the hand limb in the preset gestures; and performing interaction control on the target screen in response to an operation event corresponding to the target gesture. According to the technical scheme, additional interaction equipment such as a mouse does not need to be configured, the equipment configuration cost is reduced, hand pointing analysis is performed based on the three-dimensional space to determine the target interaction position, the interaction accuracy is ensured, and then the interaction performance is improved.

The invention discloses a micro-grid off-grid operation distributed control method based on consistency cooperation, belongs to the field of new energy micro-grid control, and aims to solve the problems of high single-point fault risk and single control target of existing centralized control. The method is operated in a three-layer architecture formed by a distribution network master station control layer, a micro-grid coordination control layer and an equipment distributed coordination control layer, a distributed communication network is constructed through edge agents, and weight coefficients and security constraints are configured; the edge agent receives a master station total power target, collects and interacts equipment data, calculates and limits amplitude to obtain a final power instruction based on a consistency updating law fusing global power difference distribution, energy storage SOC balance and system loss minimization, and then decomposes the final power instruction into equipment-level instructions to be issued and executed. According to the method, a single-point fault is eliminated, multi-target collaborative optimization is realized, control is simplified, expansibility is high, and power balance and stable and efficient operation when the micro-grid is off-grid are effectively guaranteed.

The invention relates to a full-automatic slit lamp and an intelligent diagnosis method thereof, and aims to improve the ophthalmic examination efficiency and accuracy. The slit lamp is composed of a slit lamp device, an automatic adjusting device and a man-machine interaction device. The automatic adjusting device comprises a calculation module and an adjusting module, and the adjusting module accurately drives the slit lamp device through gear transmission and automatically adjusts operation parameters according to a preset mode. The display module of the man-machine interaction device can display the working mode, the eye image data and the interaction information, and the prompt module guides the examinee to cooperate with the examination. The camera element of the slit lamp device converts the light into image data, and the communication device transmits the data to the cloud. And during fault diagnosis, the calculation element monitors image data in real time, marks abnormities through a visual algorithm, and enters a diagnosis mode. After different modes are operated for multiple times, the calculation unit analyzes imaging result abnormity, accurately locates and displays fault components, realizes automatic fault diagnosis, and reduces maintenance cost.

The invention discloses an interactive nursing teaching system for nurses and patients, relates to the technical field of nursing teaching, and aims to solve the problems that the traditional teaching is difficult to create a highly tense and complex emergency room atmosphere, students cannot deeply experience the pressure caused by time urgency, and serious consequences possibly caused by slightly poor information transmission. The nursing teaching system comprises a scene simulation module, an interaction module, an intelligent feedback module and a case management module. The scene simulation module utilizes virtual reality and augmented reality technologies to restore the environment of an emergency room and dynamically simulate patient condition changes, and the condition changes comprise dynamic adjustment of the heart rate, the blood pressure, the respiratory rate, the pain degree and the consciousness state of a patient in real time according to different emergency diseases; the interaction module comprises a voice interaction device and an action interaction device. The system has the advantages that the adaptation period of students entering clinical practice, especially emergency room work, is effectively shortened, and the nursing work efficiency and quality are guaranteed.

Systems and methods for intelligent Human Interface Devices (HIDs) interactions. In some embodiments, an HID may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the HID to: process raw user input via an Artificial Intelligence (AI) model to produce processed user input; and transmit the processed user input to an Information Handling System (IHS) coupled to the HID.

The invention discloses a dynamic risk management and control method and system for an operation process and field interaction equipment, and relates to the technical field of industrial internet, machine vision and intrinsic safety control. The invention aims to solve the technical problems that the physical state and the digital approval in the existing job management are disjointed, the existing job management is easily attacked by multimedia data fraud (such as screen copying and historical photo forgery), and the control instruction is lagged in a dynamic environment. The method comprises the following steps: a system and a field controller establish bidirectional heartbeat monitoring based on a hardware watchdog, and equipment is set in a physical locking state by default; responding to the operation request, and acquiring multimedia evidence containing a bottom hardware level tamper-proof space-time fingerprint by utilizing a hardware security unit (SE) of the field interaction equipment; the authenticity and the space-time legality of hardware fingerprints are verified at first, and then moire detection, reflection analysis and semantic comparison are conducted through an AI algorithm; and only when the anti-counterfeiting and the content verification are both passed, generating an encryption driving signal to unlock. During operation, a state competition processing mechanism is introduced, if the environment is suddenly changed, the system preferentially suspends the authority through high-priority hardware interruption, and fault-oriented security (Fail-Safe) is achieved. According to the invention, through deep fusion of software and hardware, active defense and millisecond-level dynamic fusing of operation risks are realized.

The invention discloses a stair climbing robot and an operation and control method. The four or more mechanical legs are connected with the machine body, extend downwards and are used for standing or climbing stairs; the one or more manipulators extend out of the upper surface or the side surface or the front surface of the machine body and are used for grabbing handrails or handrails; the bearing mechanism is arranged on the machine body; the detection mechanism is arranged on the machine body or the mechanical legs or the manipulators; the computer control device and the man-machine interaction device are arranged in the system; the sensor and the storage battery are arranged in the system; the mechanical legs and the manipulator are driven and controlled by the computer control device, the machine body or the hip joint or the mechanical legs or the shoulder joint or the mechanical arm or a motor in the shell, a transmission mechanism and a sensor; the control system enables the step stepping action of the mechanical legs to be matched with the approaching or grasping or releasing action of the manipulator to the handrail or the handrail, so that the robot can safely and stably carry people to go up and down stairs.

The invention relates to an interaction device, system and method for a virtual digital human, and the method comprises the steps: obtaining environment information and user information based on a multi-mode sensor of the virtual digital human; based on the big language cue word project, the virtual digital human interacts with the user; and reloading the virtual digital human on the basis of character settings preset in the cue word project of the large language model. Real-time natural language communication between the virtual human and the user in the characteristic environment can be realized, and the technical effect of improving fusion of the virtual digital human and a real scene is achieved by matching with facial expressions, actions and occupational dress-up of the virtual digital human.

The invention provides a display screen dynamic control method and system, and relates to the technical field of data processing, the method comprises the following steps: constructing a space coordinate system comprising a plurality of entity nodes, the entity nodes comprising a display screen preset angular point, a user binocular vision center and a handheld interaction device; analyzing a relative pose relationship among the nodes by calculating a projection dot product of a space vector corresponding to each node; constructing a dynamic topology network based on the relative pose relationship, and synchronously collecting environment illumination intensity, user fixation point coordinates and user pose data; performing time sequence synchronization and Kalman filtering preprocessing on the acquired multi-modal data to obtain an initial feature set; and generating a spatial calibration coefficient according to the distribution characteristics of the dynamic topology network, and performing normalization compensation on the initial feature set through the calibration coefficient to obtain a calibrated multi-modal sensing feature vector. According to the invention, accurate and intelligent dynamic control is realized.

The invention discloses a design method of a head-mounted gesture interaction device for a 3D large screen. The interaction device comprises a positioning module, a gesture recognition module, 3D glasses and a large-screen terminal display module. The positioning module and the gesture recognition module are fixed on the 3D glasses, and the positioning module is used for determining viewpoint coordinates of a user in an interaction space. The large-screen terminal display module receives viewpoint coordinates and hand joint data provided by the positioning module and the gesture recognition module, and displays 3D virtual reality scene content required by a user viewpoint through a screen. The 3D glasses are used for watching the content displayed on the screen. According to the interaction device, the positioning module and the gesture recognition module are bound with the viewpoint of the user, and synchronous hand tracking under the dynamic viewpoint is achieved. The gesture recognition module pose is determined through the design method, on the premise that an effective interaction space is not affected, factors, such as gesture shielding, influencing recognition accuracy are weakened to the maximum extent, flexibility and recognition accuracy are improved, and cost is reduced.

Provided is a self-leveling rotary handling-type multi-autonomous underwater vehicle (AUV) docking and transfer device and its method. The device includes a docking module, a vertical handling module, and a rotary handling module; the docking module includes a rotary platform with a guide frame, and a top surface of the rotary platform is provided with a first clamping device; the vertical handling module is mounted on a side of the docking module; the vertical handling module includes a liftable handling platform, and the handling platform is provided with a locking device and a second clamping device; the rotary handling module is mounted below the docking module; the rotary handling module includes a multi-branch rotating shaft and a horizontal plate mounted on each branch rotating shaft; and the horizontal plate is arranged with an AUV charging and information interaction device and a third clamping device.

The invention discloses an interaction method, an interaction device and a vehicle. The method comprises the following steps: controlling a first display device of the vehicle to display a virtual image associated with a vehicle assistant; obtaining a first instruction, wherein the first instruction indicates a second display device of the vehicle to display a virtual image; according to the first instruction, controlling the virtual image displayed by the first display device to disappear with a first dynamic effect; and when or after the virtual image displayed by the first display device disappears, controlling the virtual image to be displayed on the second display device in a second dynamic effect. The technical scheme can be applied to the field of vehicle cabins of intelligent vehicles such as new energy vehicles and electric vehicles, a user can visually feel the effect of mobile transfer of the virtual image between two display devices when different display devices are switched to display the virtual image, the intelligent degree of the vehicle can be improved, and the user experience is improved. And the interaction experience when the user uses the vehicle assistant can also be improved.

The invention discloses a control system and method for controlling operation of a vehicle-mounted generator. The system comprises an interaction device configured to receive a user operation instruction to determine configuration information used for controlling the working state of the generator; a control device adapted to be installed in a vehicle is configured to directly or indirectly establish a communication connection with an interaction device through a communication link, the control device comprises a processor, and the processor is configured to: obtain a dynamic input signal related to controlling a working state of a generator, the dynamic input signal at least comprises a trigger signal generated by the vehicle or the vehicle-mounted equipment; and sending a state control instruction to the generator to control the working state of the generator, wherein the state control instruction is determined according to the configuration information and the dynamic input signal. According to the invention, the working state of the generator is automatically controlled according to the personalized demands of the user, the visual configuration of the user on the working state control of the generator is supported, and the flexibility of the working state control of the generator is improved.

The invention discloses a pointing method, interaction equipment and pointed equipment, and belongs to the field of man-machine interaction. In order to avoid adding additional parts to a pointed area, a flickering and directive light source is arranged in the pointing device, and the pointing device emits light to the pointed area so as to form flickering light spots in the pointed area; the field of view of an event-based sensor completely covers or at least partially covers the pointed area, and according to the event-based sensor, obtaining pixel coordinates indicating flicker spots; and mapping a pixel coordinate indicating a flicker light spot to the pointed area so as to indicate the current pointing of the pointing device. The pointed device or area does not need to be modified, a user can selectively achieve relative pointing or absolute pointing of the pointed area through the pointing device, and the method is particularly suitable for a projector and wider in application range.

The invention discloses an artificial intelligence interaction device and system based on cloud service, and the device comprises an adjusting assembly, the adjusting assembly is composed of a sliding groove, a first screw rod, a clamping groove, a limiting column and the like, the sliding groove is formed in an interaction machine, and the first screw rod is rotatably connected in the sliding groove; according to the method and the device, personalized interaction contents can be automatically provided for different users by using the personalized component, and the use privacy of the users is well protected; by using the adjusting assembly, the height of the auxiliary machine can be automatically adjusted according to the height of the user, the angle of the auxiliary machine can be conveniently adjusted and fixed, and the use experience of the user is improved; by using the auxiliary assembly, the interaction machine can automatically rotate along with a user, and a good supporting effect is provided for the interaction machine in the rotation process of the interaction machine; by using the protection assembly, the screen area of the interaction machine can be well protected when the interaction machine is not used, meanwhile, the screen is automatically cleaned, and the practicability is improved.

The invention relates to an autism spectrum disorder screening application system which comprises a front-end user interaction device and a background data processing server. The front-end user interaction device comprises a child information management module; the scale screening module is used for providing at least one autism screening scale for the user to select and fill, and generating a scale screening score after receiving a scale answer filled by the user; the photo screening module is used for receiving at least one child front face image uploaded by the user, preprocessing the face image and then calling a photo analysis model to generate a photo screening score; the screening process of the front-end user interaction device comprises the steps that after a user selects a target child through the child information management module, operation of the scale screening module and the photo screening module is completed in sequence, and the background data processing server generates a comprehensive score and a risk level for scale screening scores and photo screening scores through a weighted voting mechanism. Through the application system, accurate ASD pre-diagnosis classification can be quickly provided.

The invention discloses a tunnel science popularization element universe system, and relates to a traffic informatization and science popularization digital information technology. A tunnel development display module, a panoramic exhibition hall display module, an activity synchronization module, a rescue channel module, a vehicle inspection module, an unmanned aerial vehicle inspection module, a robot fire extinguishing module, a robot dog inspection module, a token interaction module, a disease evolution module, a fire escape module and a visual induction experience module are integrated. Original abstract tunnel knowledge is converted into visual and vivid virtual experience, in addition, complex tunnel knowledge is dispersed to all the modules, a large amount of complex tunnel knowledge can be presented to a user in an organized mode, and the user can conveniently select tunnel science popularization knowledge needing to be known according to actual needs; and meanwhile, the user can interact with the virtual environment through the interaction equipment corresponding to each module, so that the interestingness of learning is improved while the user knows tunnel knowledge.

This invention describes providing information of objects in the surroundings by a handheld device using a universal pointing and interacting device. The universal pointing and interacting (UPI) device is configured to identify objects in the surroundings and to interact with the handheld device such as a smartphone or a tablet. The handheld device is further configured to provide visual information on its screen or audio information by its loudspeaker or by a connected earpiece or headphones.

An interactive device is described that is configured to: display an output of a remote device, wherein an output delay exists between the output being generated by the remote device and the output being displayed on the interactive device, generate an interaction data in dependence on an interaction with the interactive device at a location, transmit the interaction data to the remote device, display an updated output of the remote device, the updated output being generated by the remote device subsequent to receiving the interaction data, wherein the interactive device being further configured to: generate an interaction image of an area of the updated output of the remote device corresponding to the location of the interaction, determine an interaction indication in dependence on the interaction image, displaying an interaction indication on the interactive device at a location of one or more further interactions with the interactive device.