Method and system for replacing wearable visual module of robot

By obtaining robot task and environment information, and automatically determining and replacing vision modules, the problem of insufficient adaptability of robot vision modules in the prior art is solved, reducing costs and improving adaptability.

CN118990474AActive Publication Date: 2024-11-22SHENZHEN SUPERNODE NETWORK TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411094219.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-11-22
Estimated Expiration
2044-08-09

AI Technical Summary

Technical Problem

The existing robot vision module design cannot adapt to changing work scenarios and work needs, resulting in excessive production, maintenance and operation costs.

Method used

By obtaining the robot's current task requirements and working environment information, determining the target vision module, and generating visual module replacement instructions, the automatic replacement of the visual module is realized, improving the diversity and adaptability of the visual module.

Benefits of technology

It realizes the rapid replacement of robot vision modules without manual participation, reduces production, maintenance and operation costs, and improves the robot's ability to adapt to changing scenarios and needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118990474A_ABST
    Figure CN118990474A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of wearable equipment, and particularly discloses a method and a system for replacing a wearable visual module of a robot. Obtaining a current task demand of the robot and / or working environment information of the robot; determining a target visual module based on the current task demand and / or the working environment information; and based on the target visual module, generating a visual module replacement instruction to control the robot to replace the visual module. The target visual module meeting the current task requirement and / or the working environment information can be selected according to the current task requirement and / or the working environment information of the robot, the robot is controlled to replace the visual module, manual participation is not needed, the robot can rapidly replace different visual modules according to actual requirements, and the working efficiency is improved. The diversity of the robot vision module is improved, the robot vision module can adapt to variable working scenes and working requirements, and low production, maintenance and operation cost can be maintained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of wearable devices, and in particular to a method and system for replacing a wearable vision module of a robot. Background Art

[0002] With the rapid development of automation and intelligent technology, automation equipment (such as robots) has been widely used in many fields such as industrial manufacturing, medical surgery, and service industries. Robots often need to be equipped with visual modules to realize the perception of the environment and the recognition of targets. In modern robot design, the robot's visual module is usually integrated as an inherent part, and each robot is only installed with a single-function visual module, which makes the robot unable to adapt to changing work scenes or work requirements. When performing tasks with different work scenes or work requirements, it is necessary to select different visual modules based on the experience of developers and design different robots according to the visual modules to complete them, and multiple robots need to be maintained, which greatly increases the production cost and maintenance cost of the robot. If multiple visual modules (such as thermal imaging visual modules, infrared night vision visual modules, multi-spectral visual modules, and near-far focus visual modules) are integrated into the same robot, although the robot can adapt to a variety of work scenes or work requirements, the maintenance and operation of multiple visual modules increases the maintenance and operation cost of the robot, making the robot only work for a short time. Therefore, how to design a robot vision system so that it can adapt to changing work scenes and work requirements while maintaining low production, maintenance and operation costs has become an urgent problem to be solved. Summary of the invention

[0003] The present application provides a method and system for replacing a wearable vision module of a robot to achieve replacement of the robot vision module and improve the diversity of the robot vision module so that it can adapt to changing work scenarios and work requirements while maintaining low production, maintenance and operation costs.

[0004] In a first aspect, the present application provides a method for replacing a wearable vision module of a robot, the method comprising:

[0005] Obtaining current task requirements of the robot and / or working environment information of the robot;

[0006] Determining a target visual module based on the current task requirements and / or the working environment information;

[0007] Based on the target vision module, a vision module replacement instruction is generated to control the robot to replace the vision module.

[0008] In a second aspect, the present application also provides a system for replacing a wearable vision module of a robot, the system comprising:

[0009] An information acquisition module, used to acquire the current task requirements of the robot and / or the working environment information of the robot;

[0010] An embedded computing module, used for determining a target visual module based on the current task requirement and / or the working environment information;

[0011] The instruction execution module is used to generate a visual module replacement instruction based on the target visual module to control the robot to replace the visual module.

[0012] In one embodiment, the embedded computing module comprises:

[0013] A visual demand index obtaining unit, configured to analyze the current task demand and the working environment information based on a preset visual module recommendation model, and obtain visual demand indicators corresponding to the current task demand and the working environment information;

[0014] The target visual module determination unit is used to match the visual demand index with the performance parameters of each visual module, obtain the matching degree between the visual demand index and each visual module, and use the visual module with the highest matching degree as the target visual module.

[0015] In a third aspect, the present application also provides a robot comprising a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the method for replacing a wearable visual module of the robot as described above when executing the computer program.

[0016] In a fourth aspect, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the method for replacing a wearable vision module of a robot as described above.

[0017] The present application discloses a method and system for replacing a wearable vision module of a robot, which obtains the current task requirements of the robot and / or the working environment information of the robot; determines the target vision module based on the current task requirements and / or the working environment information; generates a vision module replacement instruction based on the target vision module to control the robot to replace the vision module. The present application can select a target vision module that meets the current task requirements and / or working environment information according to the current task requirements and / or working environment information of the robot, and control the robot to replace the vision module without human intervention, so that the robot can quickly replace different vision modules according to actual needs, thereby improving the diversity of the robot's vision module, so that it can adapt to changing work scenarios and work requirements, and maintain low production, maintenance and operation costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 is a schematic flow chart of a first embodiment of a method for replacing a wearable vision module of a robot provided in an embodiment of the present application;

[0020] Figure 2 is a schematic flow chart of a second embodiment of a method for replacing a wearable vision module of a robot provided in an embodiment of the present application;

[0021] Figure 3 A schematic block diagram of a replacement system for a wearable vision module of a robot provided in an embodiment of the present application;

[0022] Figure 4 A schematic block diagram of the structure of a robot provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0025] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0026] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0027] The embodiments of the present application provide a method and system for replacing a wearable vision module of a robot. Among them, the method for replacing a wearable vision module of a robot can be applied to a replacement system of a wearable vision module of a robot, and a target vision module that meets the current task requirements and / or working environment information of the robot is selected according to the current task requirements and / or working environment information of the robot, and the robot is controlled to replace the vision module, so that the robot can quickly replace different vision modules according to actual needs, thereby improving the diversity of the robot's vision module, so that it can adapt to changing work scenes and work requirements, and maintain low production, maintenance and operation costs.

[0028] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0029] See also Figure 1 , Figure 1 This is a schematic flow chart of the first embodiment of a method for replacing a wearable vision module of a robot provided in an embodiment of the present application. The method for replacing a wearable vision module of a robot can be applied to a replacement system of a wearable vision module of a robot, and is used to select a target vision module that meets the current task requirements and / or working environment information of the robot according to the current task requirements and / or working environment information of the robot, and control the robot to replace the vision module, so that the robot can quickly replace different vision modules according to actual needs, thereby improving the diversity of the robot's vision module, so that it can adapt to changing work scenes and work requirements, and maintain low production, maintenance and operation costs.

[0030] like Figure 1As shown, the method for replacing the robot wearable vision module specifically includes steps S101 to S103.

[0031] S101, obtaining the current task requirements of the robot and / or the working environment information of the robot;

[0032] In one embodiment, the current task requirement is a requirement related to the task that the robot is currently performing or waiting to perform. For example, the task of mining or search and rescue requires enhancing the robot's operating performance under diverse terrain conditions, which requires the robot's visual module to be able to collect images of different frequency bands and have higher image processing capabilities.

[0033] In one embodiment, the current task requirements can be extracted from the user input content or obtained by analyzing the task. Specifically, by analyzing the current task of the robot, the specific goals of the task are obtained, such as identifying specific objects, tracking motion trajectories, analyzing scene changes, etc.; as well as the specific operations involved in the task, including the identification and processing of static and dynamic elements. Then, according to the task goals, the visual feature requirements that need to be extracted and processed are determined, such as color, shape, texture, size, and position. Determine the accuracy requirements, processing speed requirements, and stability requirements of the visual module.

[0034] In one embodiment, the working environment information is the environment information of the robot's current location, such as lighting information, color changes, background complexity, humidity and temperature information, etc.

[0035] In one embodiment, the working environment information can be obtained through the visual module currently worn by the robot, wherein the worn visual module includes a wearable visual module or an original visual module of the robot. Specifically, the environmental image of the robot's current location is collected through the data module, and the environmental image is recognized to obtain the working environment information.

[0036] Furthermore, the obtaining of the working environment information of the robot includes: based on a visual module worn by the robot, collecting an environmental image of the working environment; based on preset environmental information parameters, identifying the environmental image to obtain the working environment information.

[0037] In one embodiment, the worn vision module may be a wearable vision module currently worn by the robot, or may be an original vision module of the robot.

[0038] In one embodiment, the preset environmental information parameters may include temperature, humidity, light level, visibility, etc., which are used to guide the recognition of environmental images and obtain required data.

[0039] In one embodiment, first, the environment image of the robot's current working environment is collected through the worn visual module. Then, based on the preset environmental information parameters, the environment image is recognized to obtain data corresponding to the environmental information parameters, that is, the working environment information. Specifically, this can be accomplished by using machine learning algorithms, image processing technology, or pattern recognition technology.

[0040] In a specific embodiment, feature information corresponding to environmental information parameters can be extracted from environmental images through image processing and computer vision techniques such as edge detection, corner detection, and texture analysis. Then, machine learning or deep learning algorithms are used to analyze and process the extracted feature information to obtain data corresponding to the environmental information parameters.

[0041] In another embodiment, after the environmental image is obtained, the environmental image may be preprocessed, which may include operations such as adjusting the image size, cropping the image, and enhancing the image contrast, so as to improve the image recognition accuracy.

[0042] S102, determining a target visual module based on the current task requirement and / or the working environment information;

[0043] Furthermore, determining the target visual module based on the current task requirement or the working environment information includes: based on a preset task and visual module mapping table, determining a visual module corresponding to the current task requirement as the target visual module; or, based on a preset environment and visual module mapping table, determining a visual module corresponding to the environment and visual module mapping table as the target visual module.

[0044] In one embodiment, the task and visual module mapping table stores different task requirements and the visual modules corresponding to each task requirement, and is used to find the visual module matching the current task requirement.

[0045] In one embodiment, the task and visual module mapping table can be set by the user according to actual needs. The task and visual module mapping table can also be generated by analyzing historical task requirements and the best visual modules corresponding to the historical task requirements to obtain the mapping relationship between tasks and visual modules.

[0046] In one embodiment, the environment and visual module mapping table stores different working environment information and the visual modules corresponding to each working environment information, and is used to search for the visual module matching the current working environment information.

[0047] In one embodiment, the environment and visual module mapping table can be set by the user according to actual needs, and can also be obtained by analyzing historical working environment information and the best visual module corresponding to the historical working environment information.

[0048] In another embodiment, the target visual module may be determined based on a comprehensive analysis of current task requirements and the working environment.

[0049] S103. Generate a vision module replacement instruction based on the target vision module to control the robot to replace the vision module.

[0050] In one embodiment, the visual module replacement instruction includes a removal instruction for the worn visual module and a wearing instruction for the target visual module. The visual module replacement instruction includes an identifier corresponding to the target visual module so that the robot can accurately identify and grab the target visual module.

[0051] In one embodiment, the robot is controlled by a visual module replacement instruction to remove the worn visual module and wear a target visual module. There is no need for manual disassembly of the visual module. The robot can automatically remove and wear the visual module, thereby achieving rapid replacement of the visual module.

[0052] Furthermore, after generating a visual module replacement instruction based on the target visual module to control the robot to replace the visual module, it also includes: based on the device information of the target visual module, determining and loading the driver and dependent library corresponding to the target visual module to support the successful operation of the target visual module.

[0053] In one embodiment, in order to ensure the successful operation of the target vision module, the corresponding driver and dependent library need to be loaded. First, obtain the device information of the target vision module, including manufacturer, model, operating system version, etc. This information can be obtained by viewing the device label or using the device manager. Then, according to the device information, find the corresponding driver and dependent library inside the robot. Finally, load the driver and dependent library.

[0054] In one embodiment, after the driver and dependent library are loaded, it is also possible to test whether the driver and dependent library can work properly, which can be done by running the test program provided by the device or using the test tool provided by the operating system. When the driver and dependent library are installed and pass the test, the target visual module can be supported to run successfully.

[0055] The above embodiment provides a method and system for replacing a wearable vision module of a robot, obtaining the current task requirements of the robot and / or the working environment information of the robot; determining the target vision module based on the current task requirements and / or the working environment information; generating a vision module replacement instruction based on the target vision module to control the robot to replace the vision module. The present application can select a target vision module that meets the current task requirements and / or working environment information according to the current task requirements and / or working environment information of the robot, and control the robot to replace the vision module without human intervention, so that the robot can quickly replace different vision modules according to actual needs, thereby improving the diversity of the robot vision module. Secondly, the realization of the replaceable robot vision module eliminates the need for developers to design robots with different vision modules for different tasks or working environments, nor does it require integrating multiple vision modules into one robot, thereby avoiding resource consumption caused by the operation of multiple vision modules, and reducing the production cost, maintenance cost and operating cost of the robot.

[0056] See also Figure 2 , Figure 2 This is a schematic flow chart of the second embodiment of a method for replacing a wearable vision module of a robot provided in an embodiment of the present application. The method for replacing a wearable vision module of a robot can be applied to a replacement system of a wearable vision module of a robot, and is used to determine a target vision module according to the current task requirements and working environment information of the robot, and then control the robot to quickly replace the target vision model, so that the robot can quickly replace different vision modules according to actual needs, thereby improving the diversity of the robot's vision module, enabling the robot to quickly adapt to changing work scenes and work requirements and reducing the production, maintenance and operation costs of the robot.

[0057] like Figure 2 As shown, the method for replacing the robot wearable vision module specifically includes steps S201 to S202.

[0058] S201, analyzing the current task requirement and the working environment information based on a preset visual module recommendation model to obtain visual requirement indicators corresponding to the current task requirement and the working environment information;

[0059] S202, matching the visual demand index with the performance parameters of each visual module to obtain the matching degree between the visual demand index and each visual module, and taking the visual module with the highest matching degree as the target visual module.

[0060] In one embodiment, the vision module recommendation model can recommend the vision module that best suits the current task requirements and working environment according to different tasks and environmental conditions.

[0061] In one embodiment, the visual module recommendation model is used to comprehensively analyze the current task requirements and the working environment information to determine the visual requirement index for completing the current task under the current working environment. Specifically, the visual module recommendation model is used to analyze the current task requirements to determine the initial task requirement index. Then, the working environment information is analyzed to obtain the stability of the lighting in the working environment, possible lighting changes, and environmental complexity, etc., and to evaluate the degree of interference of the environment with the work of the visual module. Finally, the initial task requirement index is corrected in combination with the degree of interference to obtain the visual requirement index for completing the current task under the current working environment.

[0062] In one embodiment, the visual demand index is the demand value of each visual indicator, which may include image clarity, color reproduction, contrast, field of view, response speed stability and robustness, visual feature recognition capability, scene understanding capability, three-dimensional reconstruction capability, etc.

[0063] In one embodiment, the performance parameters of the vision module are actual performance values ​​of various vision indicators, which can be obtained from the device information of the vision module.

[0064] In a specific embodiment, the performance parameters of each visual module are compared with the visual requirement index to evaluate the matching degree between them. Specifically, the actual performance value and the requirement value corresponding to each visual indicator can be compared, and the matching degree between each visual module and the visual requirement index can be obtained by combining the weight calculation. The visual modules are sorted according to the matching score, and the visual module with the highest matching degree is selected as the target visual module.

[0065] In one embodiment, after the robot completes the task wearing the target vision module, its performance can be evaluated and verified. If the actual performance meets expectations, the module can be confirmed as a suitable solution. Otherwise, the relevant parameters of the matching evaluation are adjusted, and the target vision module corresponding to the above-mentioned visual requirement indicators is re-acquired at the next replacement.

[0066] Furthermore, before the preset visual module recommendation model analyzes the current task requirements and the working environment information to determine the target visual module, it also includes: obtaining historical task requirements, historical working environment information and historical target visual modules; analyzing the historical task requirements and historical working environment information based on a preset pre-trained model to obtain a historical recommended visual module; comparing the historical recommended visual module with the historical target visual module to obtain a recommendation success rate of the pre-trained model; and when the recommendation success rate is not less than a preset success rate threshold, using the pre-trained model as the visual module recommendation module.

[0067] In one embodiment, the task requirements, working environment information, and target vision modules selected at that time of the tasks that the robot has performed in the past are obtained, which can be obtained from a database, a log file, user feedback, and the like.

[0068] In one embodiment, a pre-trained model is used to analyze historical task requirements and historical work environment information to obtain historical visual demand indicators corresponding to the historical task requirements and historical work environment information, and a historical recommended visual module is obtained based on the historical visual demand indicators. The historically recommended visual module is compared with the target visual module actually used, and the recommendation success rate of the model is calculated. Specifically, the success rate can be calculated by matching the recommended visual module with the target visual module actually used. The pre-trained model can be a convolutional neural network model, a recurrent neural network model, etc.

[0069] In one embodiment, if the recommendation success rate is not less than a preset success rate threshold, the pre-trained model can be used as a visual module recommendation module. Otherwise, the pre-trained model is adjusted or optimized until its recommendation success rate reaches the preset threshold.

[0070] In the above embodiment, the visual module recommendation model can recommend different visual modules according to different task requirements and working environment information, and then control the robot to quickly change the target visual model, thereby improving the diversity of the robot's visual modules and enabling it to quickly adapt to changing work scenarios and work requirements. There is no need to design robots with different visual modules for different tasks or working environments or integrate multiple visual modules into one robot, thereby reducing the production cost and maintenance cost of the robot, and at the same time avoiding the resource consumption caused by the operation of multiple visual modules, thereby reducing the robot's operating cost.

[0071] See also Figure 3 , Figure 3 The present invention provides a schematic block diagram of a replacement system for a wearable vision module of a robot.

[0072] like Figure 3 As shown, the replacement system 300 of the robot wearable vision module includes:

[0073] An information acquisition module 301 is used to acquire the current task requirements of the robot and / or the working environment information of the robot;

[0074] The embedded computing module 302 is used to determine a target visual module based on the current task requirement and / or the working environment information;

[0075] The instruction execution module 303 is used to generate a vision module replacement instruction based on the target vision module to control the robot to replace the vision module.

[0076] Furthermore, the embedded computing module comprises:

[0077] A visual demand index obtaining unit, configured to analyze the current task demand and the working environment information based on a preset visual module recommendation model, and obtain visual demand indicators corresponding to the current task demand and the working environment information;

[0078] The target visual module determination unit is used to match the visual demand index with the performance parameters of each visual module, obtain the matching degree between the visual demand index and each visual module, and use the visual module with the highest matching degree as the target visual module.

[0079] In one embodiment, the embedded computing module provides the necessary computing resources for the wearable vision module. Each vision module is equipped with an embedded processor that can perform advanced data processing, such as image recognition and machine learning algorithms. It allows fast local decision-making without the need to transmit data back to the robot's main computing system, thereby reducing latency and improving response speed.

[0080] In one embodiment, the robot wearable vision module replacement system also includes: a universal adaptation framework for wearing the target vision module; a data transmission module for transmitting information acquired by the vision module; and a software adaptation module for determining and loading a driver and dependent library corresponding to the target vision module based on the device information of the target vision module.

[0081] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and each module described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0082] The above system can be implemented in the form of a computer program. Figure 4 Run on the robot shown.

[0083] See also Figure 4 , Figure 4 is a schematic block diagram of the structure of a robot provided in an embodiment of the present application. Figure 4 The robot includes a processor, a memory and a network interface connected through a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0084] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any method for replacing a wearable vision module of a robot.

[0085] The processor is used to provide computing and control capabilities to support the operation of the entire robot.

[0086] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any method for replacing the wearable vision module of the robot.

[0087] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will understand that Figure 4 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the robot to which the scheme of the present application is applied. The specific robot may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0088] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0089] In one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:

[0090] Obtaining current task requirements of the robot and / or working environment information of the robot;

[0091] Determining a target visual module based on the current task requirements and / or the working environment information;

[0092] Based on the target vision module, a vision module replacement instruction is generated to control the robot to replace the vision module.

[0093] In one embodiment, after the processor generates a visual module replacement instruction based on the target visual module to control the robot to replace the visual module, the processor is further used to implement:

[0094] Based on the device information of the target vision module, determine and load the driver and dependent library corresponding to the target vision module to support the successful operation of the target vision module.

[0095] In one embodiment, when acquiring the working environment information of the robot, the processor is used to implement:

[0096] Based on the worn vision module of the robot, collecting an environmental image of the working environment;

[0097] Based on preset environmental information parameters, the environmental image is identified to obtain the working environment information.

[0098] In one embodiment, when determining the target visual module based on the current task requirement and the working environment information, the processor is used to implement:

[0099] Based on a preset visual module recommendation model, the current task requirement and the working environment information are analyzed to obtain visual requirement indicators corresponding to the current task requirement and the working environment information;

[0100] The visual demand index is matched with the performance parameters of each visual module to obtain the matching degree between the visual demand index and each visual module, and the visual module with the highest matching degree is used as the target visual module.

[0101] In one embodiment, before the processor implements the analysis of the current task requirements and the working environment information based on the preset visual module recommendation model to determine the target visual module, it is further configured to implement:

[0102] Obtain historical task requirements, historical work environment information, and historical target visual modules;

[0103] Analyze the historical task requirements and historical work environment information based on a preset pre-trained model to obtain a historical recommended visual module;

[0104] Comparing the historical recommended visual module with the historical target visual module to obtain the recommendation success rate of the pre-trained model;

[0105] When the recommendation success rate is not less than a preset success rate threshold, the pre-trained model is used as the visual module recommendation module.

[0106] In one embodiment, when the processor determines the target visual module based on the current task requirement or the working environment information, it is used to implement:

[0107] Based on a preset task and visual module mapping table, determining a visual module corresponding to the current task requirement as the target visual module;

[0108] Or, based on a preset environment and visual module mapping table, a visual module corresponding to the environment and visual module mapping table is determined as the target visual module.

[0109] A computer-readable storage medium is also provided in an embodiment of the present application, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and the processor executes the program instructions to implement any method for replacing a robot wearable vision module provided in an embodiment of the present application.

[0110] The computer-readable storage medium may be an internal storage unit of the robot described in the foregoing embodiments, such as a hard disk or memory of the robot. The computer-readable storage medium may also be an external storage device of the robot, such as a plug-in hard disk, a smart memory card (Smart Med ia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the robot.

[0111] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for replacing a wearable vision module of a robot, characterized in that: include: Obtaining current task requirements of the robot and / or working environment information of the robot; Determining a target visual module based on the current task requirements and / or the working environment information; Based on the target vision module, a vision module replacement instruction is generated to control the robot to replace the vision module.

2. The method for replacing a wearable robot vision module according to claim 1, characterized in that: After the visual module replacement instruction is generated based on the target visual module to control the robot to replace the visual module, the method further includes: Based on the device information of the target vision module, determine and load the driver and dependent library corresponding to the target vision module to support the successful operation of the target vision module.

3. The method for replacing a wearable robot vision module according to claim 1, characterized in that: The obtaining of the working environment information of the robot comprises: Based on the worn vision module of the robot, collecting an environmental image of the working environment; Based on preset environmental information parameters, the environmental image is identified to obtain the working environment information.

4. The method for replacing a wearable robot vision module according to claim 1, characterized in that: The determining of the target visual module based on the current task requirement and the working environment information includes: Based on a preset visual module recommendation model, the current task requirement and the working environment information are analyzed to obtain visual requirement indicators corresponding to the current task requirement and the working environment information; The visual demand index is matched with the performance parameters of each visual module to obtain the matching degree between the visual demand index and each visual module, and the visual module with the highest matching degree is used as the target visual module.

5. The method for replacing a wearable robot vision module according to claim 4, characterized in that: Before analyzing the current task requirements and the working environment information based on the preset visual module recommendation model to determine the target visual module, the method further includes: Obtain historical task requirements, historical work environment information, and historical target visual modules; Analyze the historical task requirements and historical work environment information based on a preset pre-trained model to obtain a historical recommended visual module; Comparing the historical recommended visual module with the historical target visual module to obtain the recommendation success rate of the pre-trained model; When the recommendation success rate is not less than a preset success rate threshold, the pre-trained model is used as the visual module recommendation module.

6. The method for replacing a wearable vision module of a robot according to any one of claims 1 to 5, characterized in that: The determining of the target visual module based on the current task requirement or the working environment information includes: Based on a preset task and visual module mapping table, determining a visual module corresponding to the current task requirement as the target visual module; Or, based on a preset environment and visual module mapping table, a visual module corresponding to the environment and visual module mapping table is determined as the target visual module.

7. A robot wearable vision module replacement system, characterized in that: include: An information acquisition module, used to acquire the current task requirements of the robot and / or the working environment information of the robot; An embedded computing module, used for determining a target visual module based on the current task requirement and / or the working environment information; The instruction execution module is used to generate a visual module replacement instruction based on the target visual module to control the robot to replace the visual module.

8. The robot wearable vision module replacement system according to claim 7, characterized in that: The embedded computing module comprises: A visual demand index obtaining unit, configured to analyze the current task demand and the working environment information based on a preset visual module recommendation model, and obtain visual demand indicators corresponding to the current task demand and the working environment information; The target visual module determination unit is used to match the visual demand index with the performance parameters of each visual module, obtain the matching degree between the visual demand index and each visual module, and use the visual module with the highest matching degree as the target visual module.

9. A robot, characterized in that: The robot includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the method for replacing the robot wearable vision module as described in any one of claims 1 to 6 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed by a processor, enables the processor to implement the method for replacing a wearable vision module of a robot as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • All-weather unmanned autonomous working platform in unknown environment

    CN110827415A

  • Control method and related device for automatically replacing loading modules

    CN113858168A

  • Autonomous navigation inspection robot based on distributed framework

    CN115657662A

  • Robot and camera combined inspection method and system

    CN117831147A

  • Collaborative inspection device for cable tunnel

    CN214028901U