91 results about "Interactive robot" patented technology

The invention provides an interactive robot grabbing method based on a large language model, and the method comprises the steps: obtaining a task operation sequence according to a two-dimensional image of a current scene, dialogue interaction information and the large language model, the task operation sequence comprises a target object, component information of the target object, target grabbing position information and action information; obtaining a target mask area according to the two-dimensional image and the target capture position information in combination with an image segmentation model, and obtaining a three-dimensional point cloud image with a target capture position according to the target mask area and the depth map of the current scene; and according to the action information, the three-dimensional point cloud picture with the target grabbing position and a grabbing prediction model, a target grabbing pose is obtained, and according to the target grabbing pose, a robot is controlled to grab the target object. According to the method, the analysis capability of the robot on the complex semantic instruction is improved, and the adaptability of the robot in a refined operation task is also improved.

A robotic controller for controlling a robot according to a sequence of robotic actions. comprises an input interface to receive multimodal inputs specifying instructions for performing a task in audio, video, and a text modality. The controller transforms the multimodal instructions into encodings using a large language model (LLM) encoder and decodes the encodings into a first sequence of robotic instructions and a robot action description of the actions using an LLM decoder. Human feedback input is received corresponding to at least one action in the first sequence of actions and the controller encodes the feedback input with the robot action description. The controller feeds the encoded data along with multimodal features generated from the encodings into the LLM decoder to generate a corrected sequence of actions. The controller is configured to control a robot according to the corrected sequence of actions.

The utility model discloses a driving structure of an interactive robot. The driving structure comprises a first driving motor; the robot body is internally provided with an accommodating space; the cross beam rod is arranged at the top of the accommodating space; the two mounting plates are arranged on the two sides of the cross beam rod, and the first driving motor is arranged between the two mounting plates; the driving rod is rotationally arranged between the two mounting plates; the two rotating discs are arranged at the two ends of the driving rod; one end of each connecting rod is rotationally connected with the rotating disc; the top ends of the mechanical legs are rotationally connected to the other end of the mounting plate, and the other ends of the connecting rods are rotationally connected to the mechanical legs; wherein the bottom of each mechanical leg is provided with a mounting piece for mounting a shoe. By means of the mode, the mechanical legs can be driven to drive the shoes to rotate, for example, spacewalk actions are carried out, the bionic effect and scientific charm of products are better shown, incomparable interactive experience of the products is achieved, and attention and interests of consumers can be well attracted.

The invention relates to the technical field of data analysis, in particular to an intelligent interaction robot control system which comprises a voice receiving module, a text conversion processing module, an audio analysis processing module and an emotion judgment adjusting module. Wherein the text conversion processing module is used for converting purified audio signals into text content and determining text word length, adjective ratio and negative word ratio, the audio analysis processing module is used for determining the speech speed, fundamental tone characteristic trend and frequency fluctuation tendency of a single purified audio signal, and the emotion judgment adjusting module is used for determining character emotion tendency and audio emotion tendency. Determining the current emotional state of the user in combination with the character emotional tendency and the audio emotional tendency so as to determine whether to switch the voice output style of the interaction robot; according to the intelligent interaction robot control system provided by the invention, efficient voice processing and emotion analysis functions are integrated, so that the intelligent level of man-machine interaction is remarkably improved.

The invention provides an intelligent triage method and system for outpatient and emergency treatment, and relates to the technical field of medical information. The method comprises the steps that physiological data, symptom description text data, facial image data and voice audio data of a patient are collected through a multi-mode sensor; analyzing the image and audio data by using an emotion calculation engine to generate emotion state data; processing the physiological and text data through an analysis model to generate illness state emergency degree data; fusing emotion and illness state data to form a preliminary triage result; in combination with the real-time medical resource state data, a triage decision-making scheme including department allocation, processing priority and personalized pacifying strategies is generated through a dynamic decision-making device; finally, guiding and pacifying are executed through the execution terminal and the interaction robot, automation, intelligence and humanization of the triage process are achieved, the triage efficiency and accuracy are remarkably improved, medical resource configuration is optimized, and care for psychological needs of patients is enhanced.

The invention discloses an intelligent interaction robot control system which comprises a sensing input module, a core processing module, an output execution module and a system management and maintenance module. The perception input module collects multi-modal data through a visual, auditory, environment and touch unit; the core processing module carries out fusion analysis on the data and generates a decision instruction through a multi-modal information fusion unit, a situation cognition and decision unit, an emotion calculation unit and a motion planning unit; the output execution module executes an interaction task through a voice unit, an expression action unit and a motion unit; and the system management and maintenance module provides knowledge base, cloud collaboration and energy monitoring support. Through multi-modal information deep fusion and situational cognition, accurate understanding of user intentions and environments is realized, emotional interaction and personalized service capabilities are provided, the problems that an existing system is single in interaction mode and lacks context understanding are solved, and the intelligent level and user experience of the robot are remarkably improved.

The present disclosure relates to the technical field of computers and relates to a model evaluation method and apparatus, and an electronic device, a storage medium and a program product. The method of the present disclosure comprises: on the basis of prompt information of a model to be evaluated, using an interactive robot to interact with said model; acquiring content generated by said model; and on the basis of the prompt information of said model and the content generated by said model, using an evaluation robot to evaluate said model to obtain an evaluation result.

The invention discloses an intelligent man-machine interaction method for an interactive robot. According to the method, the interaction accuracy and adaptability are remarkably improved through multi-dimensional technology fusion. On the intention understanding level, deep analysis of user requirements is achieved through dynamic feature weight distribution, and a strategy is generated by combining cross-domain knowledge graph embedding and emotional expression, so that response content can accurately match user core appeals and can also be naturally fused into professional knowledge and emotional temperature, and information transmission deviation is effectively reduced. According to the real-time feedback mechanism, a dynamic preference model is constructed by capturing facial expressions, voice intonation and behavior data, so that the system can adjust a content generation strategy according to instant emotional fluctuation and attention change of a user, personalized experience in an interaction process is enhanced, mechanical feeling brought by a fixed response mode is avoided, and user experience is improved. Cooperation of content generation and rhythm control is realized, so that the speed, pause and emotion expression of voice response form a natural rhythm, and the comfort level of information receiving is improved.

The invention discloses an interactive robot control method and system. The method comprises the steps that a semantic understanding process is regulated and controlled in real time based on a dialogue context dynamic model; carrying out weight adaptive optimization adjustment on the multi-modal input signal; constructing a feedback correction mechanism of cross-modal information fusion; a continuous consistent response is generated to maintain dialog coherence. The method has the beneficial effects that the complex change of the dialogue context is dynamically regulated and controlled to solve the problems of semantic misunderstanding and fault, and the weight distribution of multi-modal input is optimized and adjusted to solve the problem of inaccurate information fusion.

The present application provides a method, apparatus, electronic device and storage medium for generating an interactive robot. The method includes: in response to a basic interactive robot generation operation, displaying a design interface of the basic interactive robot on the graphical user interface; in response to an input operation of an expected behavior, generating an initial prompt template according to the input expected behavior; in response to a first interactive content input operation, displaying the first interactive content and a first response content fed back by the initial interactive robot to the first interactive content according to the initial prompt template; and adjusting the initial prompt template according to the first response content and a preset response effect to obtain an adjusted target prompt template. The present application generates an interactive robot through a non-programming interaction method, enabling non-expert users to easily create and configure interactive robots, reducing the need for professional knowledge, and improving the efficiency of creating interactive robots.

1. Name of the product in this design: Voice and Expression Interactive Robot. 2. Purpose of this design: This design is used to control the robot's facial expressions via voice commands. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.

The invention discloses a robot control method and system based on electroencephalogram signals, a robot is an interactive robot, and the method comprises the following steps that feature extraction is conducted based on the electroencephalogram signals, and corresponding frequency domain features, connectivity features and time domain mode features are obtained; performing feature fusion and dimension reduction based on the frequency domain feature, the time domain mode feature and the connectivity feature to obtain a corresponding fusion feature; performing feature analysis on the fusion feature according to a preset control strategy to obtain a corresponding analysis result; based on the control strategy, a control instruction corresponding to the analysis result is generated, and a target robot is controlled based on the control instruction; the connectivity characteristic comprises a phase locking value between each pair of channel signals; the time domain mode feature comprises the mode complexity of the electroencephalogram signal. According to the method, dynamic interaction with the target robot is achieved through the electroencephalogram signals by designing the frequency domain features, the connectivity features and the time domain mode features.

The utility model provides a clutch structure, posture adjustment subassembly, interactive robot and vehicle, clutch structure includes first connecting piece and second connecting piece, said first connecting piece and second connecting piece are connected mutually, said first connecting piece is used for connecting with said power source, said second connecting piece is used for connecting with said power source, said first connecting piece is used for connecting with said power source, said second connecting piece is used for connecting with said power source. The second connecting piece is used for being connected with a to-be-connected component; when the posture adjusting assembly is used for adjusting the posture of the robot, the second connecting piece and / or the to-be-connected part are / is subjected to external force, at least part of at least one of the first connecting piece and the second connecting piece can elastically deform, the first connecting piece and the second connecting piece move relatively, and therefore the electric function and / or the manual function of the posture adjusting assembly and the robot are / is achieved.

This invention discloses a suspended, flexible, deformable, and emotionally interactive robot. A flexible outer shell covers a flexible chassis, and a levitation airbag is installed inside the flexible outer shell. The levitation airbag is filled with buoyancy gas to provide the buoyancy required for the robot's suspension. An interactive control system inside the flexible chassis enables user interaction. A micro-airflow propulsion system is installed at the bottom of the flexible chassis, including multiple airflow generating units. By adjusting the airflow direction and intensity of the airflow generating units, the robot is driven to achieve spatial movement. The charging base station is an external device, and the bottom of the flexible chassis has an energy supply interface corresponding to the charging base station. When docked, the charging base station provides the robot with electrical energy or buoyancy gas. This invention is applicable to fields such as family emotional companionship, health and wellness, creating an intelligent indoor atmosphere, psychological relaxation assistance, and interactive displays in commercial scenarios. Through the organic integration of various systems, the robot achieves aerial suspension, flexible deformation, intelligent emotional interaction, and autonomous refueling.

1. Name of the product in this design: Robot Head Shell (Interactive). 2. Purpose of this design: For use as a head shell for an interactive robot. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

The utility model discloses a suspension AI interaction robot, and belongs to the field of robots. Comprising a robot body; a magnetic suspension base; a first magnetic structure is arranged at the bottom of the robot body, a second magnetic structure is arranged on the magnetic suspension base, and the first magnetic structure and the second magnetic structure are oppositely arranged up and down, so that the robot body can ascend, descend, swing or rotate relative to the magnetic suspension base. The utility model has the beneficial effects that compared with the prior art; firstly, the magnetic suspension robot is provided with a plurality of coil groups, so that the robot can be controlled to suspend, and the robot can also be controlled to swing or rotate, and the magnetic suspension robot can be conveniently applied to vehicle-mounted scenes where acceleration and deceleration are frequent. And secondly, the magnetic suspension robot can provide various working scenes such as families, work and driving partners through modules such as a radar, a microphone array and a camera, and has good interactivity and playability.

The invention relates to the technical field of interactive robots, and provides a robot with a body and a man-machine interaction learning method.The robot with the body comprises a robot body, the outer wall of the robot body is movably connected with a first mechanical arm, and the outer wall of the first mechanical arm is movably connected with an adjusting mechanism; the adjusting mechanism comprises a second mechanical arm sleeve movably installed on the outer wall of the first mechanical arm, a driving motor is fixedly installed on the inner wall of the second mechanical arm sleeve, and an output shaft of the driving motor is fixedly connected with a first rotating rod through a coupler. By starting a driving motor, a first transmission wheel fixedly connected with one end of a first rotating rod rotates, under transmission of a transmission belt, a second transmission wheel can rotate, a worm is driven to rotate along with the first transmission wheel, a worm gear rotates, and a third mechanical arm installed at the bottom of a second rotating rod is driven to rotate and adjust; and the effect that the angle between the mechanical arms can be stably adjusted according to the actual man-machine interaction requirement is achieved.

1. Name of the product in this design: Interactive Robot for Chinese Language Teaching. 2. Purpose of this design: For use in Chinese language teaching. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

An emotion support robot man-machine interaction method based on multi-modal emotion recognition belongs to the field of man-machine interaction technology, artificial intelligence and emotion calculation, and comprises the following steps: step 1, carrying out multi-modal emotion recognition on a user; 2, performing personalized emotion support dialogue generation based on an emotion recognition result in the step 1; and 3, transmitting the emotion recognition result in the step 1 and the emotion support dialogue in the step 2 to an interaction robot, determining a corresponding interaction action by the interaction robot according to the emotion recognition result, and outputting a personalized emotion support dialogue to a user through a TTS technology. According to the method, the multi-modal emotion data set for the college student group is constructed, the multi-modal emotion recognition model based on text enhancement is adopted, various complex emotions possibly possessed by the user at the same time can be recognized, quantitative calculation is conducted on the complex emotions, and therefore the current emotion state of the user can be recognized more accurately and more robustly, and the user experience is improved. And the limitation of single-mode identification is overcome.

The application relates to the field of interactive robot safety obstacle avoidance, and discloses an interactive robot close-range safety collision avoidance method based on a multi-envelope spherical human body area perception, which constructs a multi-envelope spherical human body area visualization labeling module based on a human body data set, generates high-precision training samples, designs a double-input network model, takes three-dimensional skeleton coordinates of 19 key joints of a human body and three-dimensional point clouds of the human body as double inputs, deeply fuses skeleton features and point cloud features, realizes accurate prediction of multi-envelope spherical parameters of each limb area of the human body, deploys the trained model to an interactive robot end, provides the robot with real-time and reliable human body area space contour perception capability, and supports close-range safety collision avoidance decision-making of the interactive robot. The application improves the perception accuracy and obstacle avoidance safety of the interactive robot on the human body, a lightweight model adapts to the deployment requirement of the interactive robot end side, and can be widely applied to human body safety protection in interactive scenes such as industrial collaborative robots and service robots.

To facilitate smooth communication between two parties.SOLUTION: An information processing apparatus of this technique analyzes utterances of each of two users who are conversing, detected by one or more agent apparatuses used by the two users, and outputs audio having a content about a network service from the one or more agent apparatuses as conversation assistance audio which is audio that assists the conversation, when a word related to the network service used by the one or more of the two users is included in the utterances of the one or more of the two users. This technique can be applied, for example, to a server that controls an operation of an interactive robot used by two people who have the conversation remotely.SELECTED DRAWING: Figure 4

The invention provides a multi-modal programming module for dance actions of an interactive robot, which belongs to the technical field of robots and comprises a semantic fusion tool for performing language translation on actions in a dance scene through a natural language processing module, a posture recognition module and an audio analysis module, performing semantic fusion on the basis of a kinetin-dance sentence-dance section model, and obtaining a semantic fusion result; generating an action file and sending the action file to the PC simulation tool; the PC simulation tool is in communication connection with the corresponding robot, when the corresponding robot needs to execute the robot action file, an execution request for executing the robot action file is sent to the PC simulation tool, and after the PC simulation tool receives the action execution request of the robot, the robot action file is executed; extracting an action frame and a corresponding time axis by automatically analyzing a robot action file; and the action optimization engine is used for calling the action file by the user through the action optimization engine, adjusting the action file based on the dance sentence, generating a latest dance file and sending the latest dance file to the PC simulation tool.

1. The name of the design product: interactive robot. 2. The use of the design product: the design product is used for home interactive service. 3. The design points of the design product: in shape. 4. The picture or photo that best shows the design points: perspective view 1.

1. The name of the design product: intelligent interactive robot (J020). 2. The use of the design product: for information interaction with people through actions, sound, light and image display. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective view. 5. Other circumstances that need to be explained: A part and B part are display screens.

The application discloses a kind of intelligent interactive robot dog systems and method for family environment, it is related to man-machine intelligent interaction technical field, including: data acquisition module, according to sensor array on robot dog, sensor data is collected, through synchronous positioning and map construction technology, generate three-dimensional point cloud map, and three-dimensional point cloud map is converted into grid map;Regional division module, semantic space regional division is carried out to grid map, and form semantic map;Atlas construction module, based on semantic knowledge atlas is constructed to semantic map;Through the grid map of update synchronization semantic map, based on the synchronous semantic map and real-time sensor data using navigation execution task model generates the navigation execution strategy of robot dog;From passive response upgrade to active service, so that robot dog can understand complex natural language instruction, and independently plan, execute cross-navigation, perception, composite task of device control.

The invention provides automatic ice cream cone filling equipment, which relates to the field of ice cream, and comprises an interactive robot for automatically cruising to provide ice cream to surrounding personnel, a spoon-like tool for providing ice cream, an ice cream cone and paper cup matching storage and discharge module, and a swing arm module for automatically delivering the ice cream cone, the ice cream cone self-adaption module is used for adapting to ice cream containers with different sizes, eight inclined supporting arc pieces support and hoop the ice cream containers in a self-adaption mode according to the container width recognized by a camera, and meanwhile a cone bottom camera located on the lower portion recognizes the appearance of the bottoms of the ice cream containers; the volume of a cup body can be measured according to an intelligent system after container appearance data is obtained through data of two sets of cameras, the ice cream storage and discharge module can be controlled to discharge ice cream with the amount suitable for that of a current container in a feedback mode, and the problem that existing filling equipment is inconvenient to conduct self-adaptive filling according to different containers delivered by customers is solved.

The application belongs to the technical field of intelligent robot control, and particularly relates to a self-adaptive step length control method for a live broadcast interactive robot; the method comprises the following steps: robot control instructions are recognized from a barrage text information, and the robot control instructions and a live broadcast scene image are input into a vision-language-action model for processing to obtain a candidate action sequence under current iteration; window action deviations and convergence slopes of action sites in the candidate action sequence are calculated in sequence; if the window action deviations and the convergence slopes of the first m action sites all satisfy a stable condition, and the (m+1)th action site does not satisfy the stable condition, the first m action sites are output; otherwise, the candidate action sequence is output again; the live broadcast interactive robot executes the first m action sites, and continues to process remaining action sites in the candidate action sequence until the entire robot control instruction is executed; the application can realize high-frequency and low-delay interaction while ensuring control stability, and is more suitable for a cost-sensitive and high-concurrency live broadcast environment.

1. The name of this design product: Robot. 2. Purpose of this design product: This design product is used for a voice interactive robot. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: Stereoscopic drawing 1.

The present invention discloses a multi-modal emotion prediction method and system based on the dialogue of an interactive robot. The method includes: constructing multi-modal features based on the dialogue between a user and an interactive robot; adjusting the modal time series window of the multi-modal features; fusing the multi-modal features after the adjustment of the modal time series window; and inputting the fused multi-modal features into a trained neural network model to perform emotion category prediction. The present invention fuses and identifies the three modalities of text, speech, and video generated in the dialogue, and can better identify the emotional changes during the dialogue interaction between the user and the customer service, providing knowledge support for improving user satisfaction and creating a warm and emotional dialogue robot.