Control method of intelligent robot with body

By obtaining and analyzing the operator's characteristic information and environmental data, combining speech recognition and sentiment analysis, and generating control commands, the problem of embodied intelligent robots understanding intentions in complex environments is solved, and more rich and personalized functions are achieved.

CN119200585APending Publication Date: 2024-12-27QINGDAO HAIFA ENVIRONMENTAL PROTECTION IND HLDG CO LTD
View PDF 0 Cites 3 Cited by

Patent Information

Application Number
CN202411197802.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-29
Publication Date
2024-12-27

AI Technical Summary

Technical Problem

Existing embodied intelligent robots have difficulty accurately understanding the operator's intentions in complex and changeable natural languages ​​and environments, resulting in the inability to meet the current usage needs.

Method used

By obtaining the operator's characteristic information, receiving voice and wireless remote control signals, performing speech recognition, natural language understanding, semantic analysis and emotion analysis, combining environmental data to generate control commands, and controlling the intelligent robot to perform corresponding motion work.

Benefits of technology

It realizes that intelligent robots accurately understand the operator's intentions in complex environments, generate corresponding control commands, meet the current usage needs, have richer functions, and meet personalized needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119200585A_ABST
    Figure CN119200585A_ABST
Patent Text Reader

Abstract

The invention discloses a control method for an intelligent robot with a body, and the method is characterized in that the method comprises the following steps: S1, starting: starting the intelligent robot; s2, obtaining feature information of an operator; s3, receiving an input signal; s4, determining the intention of an operator according to the input signal; s5, acquiring nearby environment data; and S6, controlling the intelligent robot to execute corresponding movement work according to the intention of an operator in combination with the environment data. By processing the voice information, in the interaction process of the intelligent robot and an operator, when the operator says a sentence, the meaning of the input voice can be known, the intention of the operator is clearer, and at least one of the environment information, the map information and the obstacle information is obtained; and the corresponding control command is generated in combination with the voice information of the operator, and the intelligent robot is controlled to execute the control command, so that the use requirements at the present stage are met, the functions are richer, and the individual requirements of the operator are met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of embodied intelligent robot control, and specifically relates to a control method for an embodied intelligent robot. Background Art

[0002] With the continuous maturity of artificial intelligence, robotics and other technologies, embodied intelligence has entered a rapid development stage. Embodied intelligence is a research direction of artificial intelligence that emphasizes the interaction between intelligent agents and the environment and the impact of the body on intelligence. Embodied intelligence emphasizes that intelligent agents need to have the ability to perceive, recognize, make decisions and act in order to interact with the environment in real time and make corresponding decisions and actions according to changes in the environment. Robots with embodied intelligence are embodied intelligent robots.

[0003] The emergence of embodied intelligence provides an important technical and theoretical basis for improving the current cognitive capabilities of robots and moving towards general intelligence. Through interaction with the environment and humans, robots can obtain feedback from humans and the environment from real physical or virtual digital spaces, thereby better completing tasks.

[0004] However, human natural language contains uncertainty, and real-life scenarios are often complex and changeable. Single-modal data can only enable robots to complete specific and simple tasks and cannot meet current usage needs. Summary of the invention

[0005] In view of the problems raised by the above background technology, the purpose of the present invention is to provide a control method for an embodied intelligent robot.

[0006] In order to achieve the above technical objectives, the technical solution adopted by the present invention is as follows:

[0007] A control method for an embodied intelligent robot, characterized in that it comprises the following steps:

[0008] S1: Turn on the machine and start the intelligent robot;

[0009] S2: Obtain operator characteristic information;

[0010] S3: receiving input signal;

[0011] S4: determining the operator's intention based on the input signal;

[0012] S5: Get nearby environment data:

[0013] S6: Control the intelligent robot to perform corresponding motion tasks based on the operator's intention and environmental data.

[0014] It is further defined that in said S2, characteristic information of the operator is obtained including one or more of identity information, fingerprint information and facial information, and information processing and characteristic recognition are performed to determine the operator.

[0015] It is further defined that, in said S3, receiving the input signal includes a voice signal input and a wireless remote control signal input.

[0016] It is further defined that in S4, speech recognition is performed on the speech signal, and one or more of natural speech understanding, semantic analysis, and sentiment analysis are performed on the recognition result to determine the operator's intention.

[0017] It is further defined that in said S5, one or more of environmental information, map information and obstacle information is obtained.

[0018] It is further defined that in S6, a first control command is generated according to the operator's intention in combination with environmental data, the first control command is processed, and it is determined whether the control command can be executed. If it cannot be executed, the input signal is received again, and the operator's intention is determined according to the input signal, and then the control command is regenerated. If it can be executed, it is determined that the intelligent robot needs to execute the first command. If it is determined to be executed, the intelligent robot responds to the first control command and performs the operation. After the execution, it is determined whether the current operation is completed. If not, the operation continues to be executed. After the operation is completed, it is determined whether a new control command needs to be added. If it needs to be added, a new control command is generated, the new control command is processed, and it is determined whether the control command can be executed. If no new command needs to be added, the work is terminated.

[0019] It is further defined that it also includes a control system, the control system includes a main control module, the main control module includes an information processing and feature recognition module, an information receiving module, an artificial intelligence module, an image acquisition module, an action management module and a time module, and the main control module is connected to the information processing and feature recognition module, the information receiving module, the artificial intelligence module, the image acquisition module, the action management module and the time module.

[0020] It is further defined that the information processing and feature recognition module includes an identity information collection module, a facial information collection module and a fingerprint information collection module, and the information processing and feature recognition module is connected to the identity information collection module, the facial information collection module and the fingerprint information collection module.

[0021] It is further defined that the image acquisition module includes a video acquisition module, a video processing module and a video determination module, and the image acquisition module is connected to the video acquisition module, the video processing module and the video determination module.

[0022] It is further defined that the motion management module includes a path control module, a visual guidance module, a tactile management module and a motion execution module, and the motion management module is connected to the path control module, the visual guidance module, the tactile management module and the motion execution module.

[0023] The beneficial effects of the present invention are as follows: the present invention performs speech recognition on voice information, and performs one or more of natural language understanding, semantic analysis, and sentiment analysis on the recognition results to determine the intention of the operator. Specifically, the processing of voice information requires speech recognition, natural language understanding, semantic analysis, machine translation, sentiment analysis, etc. Through the above-mentioned processing, when the operator says a sentence during the interaction between the intelligent robot and the operator, the intelligent robot can know the meaning of the voice input by the operator, and the intention of the operator is more clear, and at least one of the environmental information, map information and obstacle information is obtained, and the corresponding control command is generated in combination with the operator's voice information, and the intelligent robot is controlled to execute the control command, thereby meeting the current usage needs, having richer functions, and meeting personalized needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The present invention can be further illustrated by the non-limiting examples given in the accompanying drawings;

[0025] Figure 1 This is an overall flow chart of a control method for an embodied intelligent robot according to an embodiment of the present invention;

[0026] Figure 2 S2 is a flow chart of a control method of an embodied intelligent robot according to an embodiment of the present invention;

[0027] Figure 3 S3 is a flow chart of a control method of an embodied intelligent robot according to an embodiment of the present invention;

[0028] Figure 4 S4 is a flow chart of a control method of an embodied intelligent robot according to an embodiment of the present invention;

[0029] Figure 5 S5 is a flow chart of a control method of an embodied intelligent robot according to an embodiment of the present invention;

[0030] Figure 6 S6 is a flow chart of a control method of an embodied intelligent robot according to an embodiment of the present invention;

[0031] Figure 7 A schematic diagram of a control system of a control method for an embodied intelligent robot according to an embodiment of the present invention;

[0032] Figure 8A schematic diagram of an information processing and feature recognition module of a control method for an embodied intelligent robot according to an embodiment of the present invention;

[0033] Fig. 9 This is a schematic diagram of an image acquisition module of a control method for an embodied intelligent robot according to an embodiment of the present invention;

[0034] Fig.10 A schematic diagram of an action management module of a control method for an embodied intelligent robot according to an embodiment of the present invention;

[0035] The main component symbols are described as follows:

[0036] Control system 1, main control module 2, information processing and feature recognition module 3, information receiving module 4, artificial intelligence module 5, image acquisition module 6, action management module 7, time module 8, identity information acquisition module 9, facial information acquisition module 10, fingerprint information acquisition module 11, video acquisition module 12, video processing module 13, video determination module 14, path control module 15, visual guidance module 16, tactile management module 17, action execution module 18. DETAILED DESCRIPTION

[0037] In order to enable those skilled in the art to better understand the present invention, the technical solution of the present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0038] Embodiment 1, as Figure 1 As shown, a control method for an embodied intelligent robot comprises the following steps:

[0039] S1: Turn on the machine and start the intelligent robot;

[0040] S2: Obtain operator characteristic information;

[0041] S3: receiving input signal;

[0042] S4: determining the operator's intention based on the input signal;

[0043] S5: Get nearby environment data:

[0044] S6: Control the intelligent robot to perform corresponding motion tasks based on the operator's intention and environmental data.

[0045] In this embodiment: S1: Turn on the machine and start the intelligent robot.

[0046] Start the intelligent robot and put it into standby mode, ready to receive instructions and move.

[0047] S2: Obtain operator characteristic information.

[0048] In actual implementation, various operator feature information can be obtained based on the sensors installed on the intelligent robot. For example, the operator's facial information can be obtained through the camera installed on the intelligent robot. The operator's identity information and fingerprint information can also be obtained through the identity identifier and fingerprint identifier installed on the intelligent robot to confirm whether the operator has the authority to operate and prevent the illegal use of the intelligent robot.

[0049] S3: Receive input signal.

[0050] The voice information input by the operator is obtained through the sensors installed on the intelligent robot.

[0051] S4: Determine the operator's intention based on the input signal.

[0052] The speech information is recognized, and one or more of natural language understanding, semantic analysis, and sentiment analysis are performed on the recognition results to determine the operator's intention. Specifically, the processing of speech information requires speech recognition, natural language understanding, semantic analysis, machine translation, sentiment analysis, etc. Through the above processing, when the operator says a sentence during the interaction with the operator, the intelligent robot can know the meaning of the speech input by the operator and make the operator's intention clearer.

[0053] S5: Obtain nearby environment data.

[0054] Collect nearby environmental data, environmental information, map information and obstacle information, and make judgments and plans to determine the movement route.

[0055] S6: Control the intelligent robot to perform corresponding motion tasks based on the operator's intention and environmental data.

[0056] After the operator interacts with the intelligent robot, the operator generates a corresponding control command based on at least one of the environmental information, map information and obstacle information, and obtains voice information. The control command is a command for controlling the intelligent robot to perform an operation. The operation that the intelligent robot needs to perform is determined according to the control command, and a decision is made according to the control command to further determine the operation that the intelligent robot needs to perform. Before determining the operation that the intelligent robot needs to perform according to the control command, the intelligent robot detects the distance signal generated between the intelligent robot and the surrounding objects to obtain distance data. The distance data can be obtained by measuring the distance signal through the ranging module. The intelligent robot generates a distance signal between the intelligent robot and the surrounding objects during walking. The intelligent robot judges the surrounding obstacles based on the distance signal and then determines the obstacle avoidance behavior to avoid the obstacles.

[0057] Embodiment 2, as Figure 2As shown, in S2, characteristic information of the operator including one or more of identity information, fingerprint information and facial information is obtained, and information processing and characteristic recognition are performed to determine the operator.

[0058] In this embodiment, when obtaining the characteristic information of the operator, one or more of the operator's identity information, fingerprint information and facial information can be collected, and information processing and feature recognition can be performed to determine whether the operator has the authority to operate the operator, thereby preventing the illegal use of the intelligent robot.

[0059] Embodiment 3, as Figure 3 As shown, in S3, the received input signal includes a voice signal input and a wireless remote control signal input.

[0060] In this embodiment, when in use, under normal usage environments, the voice information input by the operator can be obtained through voice signal input, and in some dangerous environments, wireless remote control signal input can be used to transmit operation instructions to the intelligent robot through wireless communication technology, thereby realizing remote control and operation of the intelligent robot.

[0061] Embodiment 4, as Figure 4 As shown, in S4, speech recognition is performed on the speech signal, and one or more of natural speech understanding, semantic analysis, and sentiment analysis are performed on the recognition result to determine the operator's intention.

[0062] In this embodiment, when the voice information input by the operator is obtained, speech recognition is performed on the voice information, and one or more of natural language understanding, semantic analysis, and sentiment analysis are performed on the recognition result to determine the operator's intention. Specifically, the processing of the voice information requires speech recognition, natural language understanding, semantic analysis, machine translation, sentiment analysis, etc. Through the above processing, when the operator says a sentence during the interaction with the operator, the intelligent robot can know the meaning of the voice input by the operator and make the operator's intention clearer.

[0063] Embodiment 5, as Figure 5 As shown, in S5, one or more of environmental information, map information and obstacle information is obtained.

[0064] In this embodiment, a corresponding control command is generated according to at least one of the environmental information, the map information and the obstacle information, and the acquired voice information.

[0065] Embodiment 6, as Figure 6As shown, in S6, a first control command is generated according to the operator's intention in combination with environmental data, the first control command is processed, and it is determined whether the control command can be executed. If it cannot be executed, the input signal is received again, and the operator's intention is determined according to the input signal, and then the control command is regenerated. If it can be executed, it is determined that the intelligent robot needs to execute the first command. If it is determined to be executed, the intelligent robot responds to the first control command and performs the operation. After the execution, it is determined whether the current operation is completed. If not, the operation continues to be performed. After the operation is completed, it is determined whether a new control command needs to be added. If it needs to be added, a new control command is generated, the new control command is processed, and it is determined whether the control command can be executed. If no new command needs to be added, the work is terminated.

[0066] In this embodiment, by acquiring at least one of environmental information, map information and obstacle information, and combining the operator's voice information to generate corresponding control commands, and controlling the intelligent robot to execute the control commands, the intelligent robot is made more intelligent and has richer functions to meet the operator's personalized needs.

[0067] Embodiment 7, as Figure 7 As shown, it also includes a control system 1, the control system 1 includes a main control module 2, the main control module 2 includes an information processing and feature recognition module 3, an information receiving module 4, an artificial intelligence module 5, an image acquisition module 6, an action management module 7 and a time module 8, and the main control module 2 is connected to the information processing and feature recognition module 3, the information receiving module 4, the artificial intelligence module 5, the image acquisition module 6, the action management module 7 and the time module 8.

[0068] In this embodiment, when in use, the identity information, facial information and fingerprint information of the operator are collected and identified through the information processing and feature recognition module 3 to determine the operator. The information receiving module 4 is used to receive the operator's voice information and receive wireless remote control signals to control the operation of the intelligent robot. The artificial intelligence module 5 is used to determine the operator's intention based on the voice information. The image acquisition module 6 is used for the intelligent robot to detect surrounding objects and determine whether surrounding obstacles affect the operation. The operation of the intelligent robot can be controlled through the action management module 7. The time module 8 can be used to perform probability calculations on the time for subsequent inquiries.

[0069] Embodiment 8, as Figure 8 As shown, the information processing and feature recognition module 3 includes an identity information collection module 9, a facial information collection module 10 and a fingerprint information collection module 11, and the information processing and feature recognition module 3 is connected to the identity information collection module 9, the facial information collection module 10 and the fingerprint information collection module 11.

[0070] In this embodiment, when collecting one or more of the operator's identity information, fingerprint information and facial information, the operator's information characteristics can be collected and identified through the identity information collection module 9, the facial information collection module 10 and the fingerprint information collection module 11 to determine whether the operator has the operating authority.

[0071] Embodiment 9, as Fig. 9 As shown, the image acquisition module 6 includes a video acquisition module 12 , a video processing module 13 and a video determination module 14 , and the image acquisition module 6 is connected to the video acquisition module 12 , the video processing module 13 and the video determination module 14 .

[0072] In this embodiment, the video acquisition module 12 is used for the intelligent robot to detect surrounding objects, the video processing module 13 is used to determine whether surrounding obstacles affect the operation, and the video determination module 14 is used to determine whether the intelligent robot can pass through the obstacles.

[0073] Embodiment 10, as Fig.10 As shown, the action management module 7 includes a path control module 15, a visual guidance module 16, a tactile management module 17 and an action execution module 18, and the action management module 7 is connected to the path control module 15, the visual guidance module 16, the tactile management module 17 and the action execution module 18.

[0074] In this embodiment, the path control module 15 is used to make the intelligent robot move along a specific path. The intelligent robot is required to move along a predetermined trajectory and speed within a certain accuracy range to complete the task. The visual guidance module 16 is used in combination with the image acquisition module 6 to obtain information about the working environment, and this information is input into the main control module 2 to control the intelligent robot to perform tasks of precise positioning, identification and detection. Through the tactile management module 17, when the intelligent robot is in motion and an obstacle suddenly appears in the action route of the intelligent robot and touches the intelligent robot, the intelligent robot stops moving and determines whether it needs to bypass the obstacle. When it is determined that the obstacle needs to be bypassed, the action execution module 18 executes the bypass program to enable the intelligent robot to bypass the obstacle and return to the original route to continue running.

[0075] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed by the present invention should still be covered by the claims of the present invention.

Claims

1. A control method for an embodied intelligent robot, characterized in that: The following steps are involved: S1: Turn on the machine and start the intelligent robot; S2: Obtain operator characteristic information; S3: receiving input signal; S4: determining the operator's intention based on the input signal; S5: Get nearby environment data: S6: Control the intelligent robot to perform corresponding motion tasks based on the operator's intention and environmental data.

2. The control method of an embodied intelligent robot according to claim 1, characterized in that: In S2, characteristic information of the operator including one or more of identity information, fingerprint information and facial information is obtained, and information processing and characteristic recognition are performed to determine the operator.

3. The control method of an embodied intelligent robot according to claim 2, characterized in that: In S3, the received input signal includes a voice signal input and a wireless remote control signal input.

4. The control method of an embodied intelligent robot according to claim 3, characterized in that: In S4, speech recognition is performed on the speech signal, and one or more of natural speech understanding, semantic analysis, and sentiment analysis are performed on the recognition result to determine the operator's intention.

5. The control method of an embodied intelligent robot according to claim 4, characterized in that: In S5, one or more of environmental information, map information and obstacle information is obtained.

6. The control method of an embodied intelligent robot according to claim 5, characterized in that: In S6, a first control command is generated according to the operator's intention and the environmental data, and the first control command is processed to determine whether the control command can be executed. If it cannot be executed, the input signal is received again, and the operator's intention is determined according to the input signal, and then the control command is regenerated. If it can be executed, it is determined that the intelligent robot needs to execute the first command. If it is determined to be executed, the intelligent robot responds to the first control command and performs the operation. After the execution, it is determined whether the current operation is completed. If not, the operation continues to be executed. After the operation is completed, it is determined whether a new control command needs to be added. If it needs to be added, a new control command is generated, the new control command is processed, and it is determined whether the control command can be executed. If no new command needs to be added, the work is terminated.

7. The control method of an embodied intelligent robot according to claim 6, characterized in that: The invention also comprises a control system (1), wherein the control system (1) comprises a main control module (2), wherein the main control module (2) comprises an information processing and feature recognition module (3), an information receiving module (4), an artificial intelligence module (5), an image acquisition module (6), an action management module (7) and a time module (8), and the main control module (2) is connected to the information processing and feature recognition module (3), the information receiving module (4), the artificial intelligence module (5), the image acquisition module (6), the action management module (7) and the time module (8).

8. The control method of an embodied intelligent robot according to claim 7, characterized in that: The information processing and feature recognition module (3) comprises an identity information collection module (9), a facial information collection module (10) and a fingerprint information collection module (11); the information processing and feature recognition module (3) is connected to the identity information collection module (9), the facial information collection module (10) and the fingerprint information collection module (11).

9. The control method of an embodied intelligent robot according to claim 8, characterized in that: The image acquisition module (6) comprises a video acquisition module (12), a video processing module (13) and a video determination module (14); the image acquisition module (6) is connected to the video acquisition module (12), the video processing module (13) and the video determination module (14).

10. The control method of an embodied intelligent robot according to claim 9, characterized in that: The action management module (7) comprises a path control module (15), a visual guidance module (16), a tactile management module (17) and an action execution module (18); the action management module (7) is connected to the path control module (15), the visual guidance module (16), the tactile management module (17) and the action execution module (18).

Citation Information

Cited By

  • Task execution method of intelligent agent with body

    CN120134299A

  • Task execution method for embodied agent

    CN120134299B

  • Merculation edge-equipped intelligent service vehicle system and control method

    CN121552348A