Power plant inspection operation robot control method, device and equipment and storage medium
By detecting abnormal gathering points in the power plant and selecting inspection robots to collect audio and video information, and using language model analysis, the problem that inspection robots cannot promptly inspect and report temporary abnormalities is solved, and the timeliness and flexibility of inspections is improved.
Patent Information
- Application Number
- CN202411717775.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-03-04
AI Technical Summary
The inspection robot is unable to promptly inspect and report temporary abnormalities found by staff in the power plant, resulting in the inability to determine the on-site situation in a timely manner and feedback.
When an abnormal gathering point is detected in the target factory, the target robot for inspection is selected, the robot will be controlled to collect on-site audio and video information, and sort this information through the target language model to generate inspection abnormal information.
It realizes that when the staff finds an abnormality but does not report it, automatically determines the abnormal gathering point, selects a robot for inspection, and obtains the abnormal inspection information through audio and video analysis, so as to promptly discover abnormalities and control the inspection, which improves the timeliness and flexibility of the inspection.
Smart Images

Figure CN119556698A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of large models, and in particular to a control method, device, equipment and storage medium for a power plant inspection robot. Background Art
[0002] With the development of science and technology and the continuous development of industry, the scale of various power plants is getting larger and larger, and the working environment of power plants is also more complex, accommodating a large number of staff. Therefore, the monitoring of the working conditions of the entire power plant and various industrial equipment needs to be combined with inspection robots for monitoring and inspection. However, in the case of emergencies or abnormal situations that are too late to report, the inspection robots are often not dispatched in time, resulting in the inability to determine the on-site situation and feedback in time.
[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention
[0004] The main purpose of the present invention is to provide a control method, device, equipment and storage medium for a power plant inspection robot, aiming to solve the technical problem that the inspection robot cannot promptly check and report temporary situations discovered by staff.
[0005] To achieve the above object, the present invention provides a control method for a power plant inspection robot, the method comprising the following steps:
[0006] When abnormal gathering points are detected in the target factory area, a target robot is selected for inspection;
[0007] Control the target robot to collect on-site audio and video information of interview feedback from on-site personnel;
[0008] The on-site audio and video information is collated through a target language large model to obtain inspection abnormality information.
[0009] In some embodiments, when an abnormal gathering point is detected in the target factory area, selecting a target robot for inspection includes:
[0010] Obtain robot inspection plan information and factory personnel gathering information;
[0011] Determine abnormal gathering points based on the information on gathering of personnel in the factory area;
[0012] The target robot for inspection is determined based on the abnormal gathering points and the robot inspection plan information.
[0013] In some embodiments, determining a target robot to be inspected according to the abnormal gathering point and the robot inspection plan information includes:
[0014] Determine inspection route information and inspection time information of multiple standby robots according to the robot inspection plan information;
[0015] Determine the target destination and current position of each standby robot according to the inspection route information and inspection time information;
[0016] A target robot for inspection is selected from each standby robot according to the current position, the target destination and the abnormal gathering point.
[0017] In some embodiments, controlling the target robot to collect on-site audio and video information of interview feedback from on-site personnel includes:
[0018] Controlling the target robot to collect on-site video information of the abnormal gathering point;
[0019] Editing the on-site video information to obtain a personnel feedback video;
[0020] The video is split and processed according to the feedback from the personnel to obtain on-site audio and video information.
[0021] In some embodiments, the step of collating the on-site audio and video information by using the target language big model to obtain the inspection abnormality information includes:
[0022] Inputting the on-site audio and video information into a target language model to obtain a language analysis result;
[0023] The language analysis results are collated to obtain inspection abnormality information.
[0024] In some embodiments, the language analysis results are sorted to obtain inspection abnormality information, including:
[0025] Obtain word frequency information and sentence concatenation information according to the language analysis results;
[0026] Determine inspection summary keywords according to the word frequency information and the sentence concatenation information;
[0027] Inspection abnormality information is generated according to the inspection summary keywords.
[0028] In some embodiments, generating inspection abnormality information according to the inspection summary keywords includes:
[0029] Determine the reason for the gathering of people based on the inspection summary keywords;
[0030] According to the information on the reason for the gathering of people, a preset database is searched to obtain a standard structure sentence corresponding to the information on the reason for the gathering of people;
[0031] Generate inspection exception information according to the standard structure statement
[0032] In addition, to achieve the above-mentioned purpose, the present invention also proposes a power plant inspection robot control device, the power plant inspection robot control device comprising:
[0033] The target selection module is used to select the target robot for inspection when abnormal gathering points are detected in the target factory area;
[0034] A site collection module, used to control the target robot to collect on-site audio and video information of interview feedback from on-site personnel;
[0035] The inspection summary module is used to organize the on-site audio and video information through the target language large model to obtain inspection abnormality information.
[0036] In addition, to achieve the above-mentioned objectives, the present invention also proposes a power plant inspection work robot control device, the power plant inspection work robot control device comprising: a memory, a processor, and a power plant inspection work robot control program stored in the memory and executable on the processor, the power plant inspection work robot control program being configured to implement the steps of the power plant inspection work robot control method as described above.
[0037] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a power plant inspection operation robot control program is stored. When the power plant inspection operation robot control program is executed by a processor, the steps of the power plant inspection operation robot control method described above are implemented.
[0038] When the present invention detects an abnormal gathering point in the target factory area, a target robot for inspection is selected; the target robot is controlled to collect on-site audio and video information fed back by interviews with on-site personnel; and the on-site audio and video information is sorted out through the target language large model to obtain inspection abnormality information. In this way, when a staff member finds an abnormality but does not report it, the location where the personnel gather abnormally can be automatically determined, and then a robot is selected for inspection, and finally, according to the on-site audio and video analysis, the inspection abnormality information can be obtained, so that the abnormality can be discovered in time when it is not reported and the inspection robot can be controlled for inspection, thereby improving the timeliness and flexibility of the inspection. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 This is a flow chart of a first embodiment of a control method for a power plant inspection robot according to the present invention;
[0040] Figure 2 This is a flow chart of a second embodiment of a control method for a power plant inspection robot according to the present invention;
[0041] Figure 3This is a structural block diagram of the first embodiment of the power plant inspection robot control device of the present invention.
[0042] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0043] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0044] The embodiment of the present invention provides a control method for a power plant inspection robot, referring to Figure 1 , Figure 1 The figure is a flow chart of a first embodiment of a control method for a power plant inspection robot according to the present invention.
[0045] In this embodiment, the power plant inspection robot control method includes the following steps:
[0046] Step S10: When an abnormal gathering point is detected in the target factory area, a target robot is selected for inspection.
[0047] In this embodiment, the executor of this embodiment is a power plant inspection operation robot control device, wherein the power plant inspection operation robot control device has functions such as data processing, data communication and program running. The power plant inspection operation robot control device can be a computer terminal device or other network device, and of course it can also be other devices with similar functions, and this embodiment does not limit this.
[0048] It should be noted that the target plant area may be any pre-set power plant, or any area of any power plant, which is not limited in this embodiment.
[0049] It should be understood that an abnormal gathering point refers to an area or location where a certain device has not reported an abnormality and where at least two staff members gather.
[0050] In some embodiments, in order to accurately select the nearest or most suitable working robot for inspection, step S10 includes: obtaining robot inspection plan information and factory personnel gathering information; determining abnormal gathering points based on the factory personnel gathering information; and determining the target robot for inspection based on the abnormal gathering points and the robot inspection plan information.
[0051] In the specific implementation, the robot inspection plan information is first obtained, that is, the inspection location and route plan corresponding to all inspection robots working normally in the target factory area. The factory personnel gathering information refers to the location information of all areas in the target factory area where at least two people gather.
[0052] It should be noted that by excluding the normal gathering places and areas in the factory personnel gathering information, abnormal gathering points can be obtained.
[0053] It should be understood that after determining the existence of abnormal gathering points, the most suitable robot is selected from all the inspection robots to collect information in combination with the robot inspection plan.
[0054] In some embodiments, in order to accurately select the optimal target robot, the step of determining the target robot for inspection based on the abnormal gathering points and the robot inspection plan information includes: determining the inspection route information and inspection time information of multiple standby robots based on the robot inspection plan information; determining the target destination and current position of each standby robot based on the inspection route information and the inspection time information; and selecting the target robot for inspection from each standby robot based on the current position, the target destination and the abnormal gathering points.
[0055] In the specific implementation, the inspection routes and inspection time requirements of multiple standby robots that can perform inspections are first determined based on the robot inspection plan information, and then the next inspection location that each standby robot needs to go to is determined as the target location based on the inspection route information and the inspection time information, as well as the current location.
[0056] It should be noted that after determining the current position and target location of each standby robot, the time and distance for each standby robot to move from the current position to the abnormal gathering point and then to the corresponding target location are calculated and taken into consideration, and the robot with the shortest time or the shortest distance is selected as the target robot.
[0057] Step S20: Control the target robot to collect on-site audio and video information fed back by interviewers on site.
[0058] It should be understood that after the target robot is determined, the target robot is controlled to go to the abnormal gathering point, and then the on-site audio and video information fed back by the interviews of the on-site personnel is collected.
[0059] In some embodiments, in order to accurately collect on-site audio and video information, step S20 includes: controlling the target robot to collect on-site video information of the abnormal gathering point; editing according to the on-site video information to obtain personnel feedback video; splitting and processing according to the personnel feedback video to obtain on-site audio and video information.
[0060] In a specific implementation, the target robot is first controlled to reach the abnormal gathering point, and then the abnormal gathering point is photographed on site through the camera of the target robot to obtain on-site video information.
[0061] It should be noted that after obtaining the on-site video information, it is edited to remove unnecessary noise and meaningless images, so as to obtain audio and video that only contains the interview answers of the staff and the details of the abnormal location.
[0062] It should be understood that after obtaining the personnel feedback video, the personnel feedback information is subjected to audio track splitting and video editing to obtain processed audio and video respectively, and obtain the final on-site audio and video information.
[0063] Step S30: The on-site audio and video information is sorted by the target language large model to obtain inspection abnormality information.
[0064] In a specific implementation, after obtaining the on-site audio and video information, it is input into a pre-trained target language large model, so that the final inspection abnormality information can be output and sorted.
[0065] This embodiment selects a target robot for inspection when an abnormal gathering point is detected in the target factory area; controls the target robot to collect on-site audio and video information from interviews with on-site personnel; and uses the target language large model to organize the on-site audio and video information to obtain inspection abnormality information. In this way, when a staff member finds an abnormality but does not report it, the location where the staff gathers abnormally can be automatically determined, and then a robot can be selected for inspection. Finally, according to the on-site audio and video analysis, the inspection abnormality information can be obtained, so that the abnormality can be discovered in time when it is not reported and the inspection robot can be controlled for inspection, which improves the timeliness and flexibility of the inspection.
[0066] refer to Figure 2 , Figure 2 The figure is a flow chart of a second embodiment of a control method for a power plant inspection robot according to the present invention.
[0067] Based on the first embodiment described above, the power plant inspection robot control method of this embodiment includes in step S30:
[0068] Step S301: input the on-site audio and video information into a target language model to obtain a language analysis result.
[0069] It should be noted that the on-site audio and video information is first input into the target language model, so that the language analysis result can be obtained based on the target language model. The language analysis result refers to the result obtained by semantically understanding the information fed back by the staff interview.
[0070] It should be understood that the language analysis results may include a summary statement obtained by the inspection robot through analysis of the target large model, or may be the expression of the meaning of the image in the audio and video information, for example: an abnormality occurs in the equipment in the image, etc.
[0071] Step S302: sorting the language analysis results to obtain inspection abnormality information.
[0072] In a specific implementation, in order to accurately perform language analysis to obtain inspection abnormality information, it is necessary to further process the language analysis result to obtain the inspection abnormality information.
[0073] In some embodiments, in order to accurately obtain inspection exception information, step S302 includes: obtaining word frequency information and sentence concatenation information according to the language analysis results; determining inspection summary keywords according to the word frequency information and the sentence concatenation information; and generating inspection exception information according to the inspection summary keywords.
[0074] It should be noted that first, word frequency information and sentence concatenation information are obtained based on the language analysis results. The word frequency information refers to the frequency information of each word with the same meaning in the language analysis results. First, all words in the language analysis results need to be semantically summarized, and the words with the same semantics are classified into the same field, and then the word frequency information can be obtained. Sentence concatenation information refers to context analysis, that is, each word is analyzed in combination with the conversation context of the on-site personnel, so that the context concatenation relationship information of each word can be obtained.
[0075] It should be understood that after obtaining the word frequency information and sentence series information, the words that better represent key semantics among the words with higher occurrence frequency can be determined according to the sentence series information as the inspection summary keywords.
[0076] In the specific implementation, firstly, the words are arranged from high to low according to the frequency of occurrence based on the word frequency information, and then the semantic importance is sorted based on the sentence concatenation information and semantics, so that the inspection summary keywords can be selected.
[0077] In some embodiments, in order to accurately generate inspection exception information, the steps of generating inspection exception information according to the inspection summary keywords include: determining the personnel gathering reason information according to the inspection summary keywords; querying a preset database according to the personnel gathering reason information to obtain the standard structure statement corresponding to the personnel gathering reason information; generating inspection exception information according to the standard structure statement.
[0078] It should be noted that after obtaining the inspection summary keywords, semantic analysis and understanding are performed on the inspection summary keywords to determine the reasons for the gathering of personnel, that is, why the staff gathered at the abnormal gathering point for no reason, such as: equipment failure, data abnormality, or environmental abnormality.
[0079] It should be understood that after determining the information on the reason for the gathering of people, the preset database is queried according to the information on the reason for the gathering of people, so that the result of the semantic conversion can be converted into a standard structure sentence. The preset database refers to a pre-set, standardized sentence that stores all special situations such as faults and anomalies related to the power plant, for example: words such as "broken" and "abnormal" are uniformly converted into the standard structure sentence "fault".
[0080] In a specific implementation, after obtaining the standard structure sentence, a summary and aggregation are performed to obtain a conclusive summary of the inspection results and anomalies, namely, inspection anomaly information.
[0081] In this embodiment, the on-site audio and video information is input into the target language big model to obtain the language analysis result; the language analysis result is sorted to obtain the inspection abnormality information. In this way, the on-site audio and video analysis and text extraction based on the big model are realized, so that more accurate text information can be extracted and sorted based on the language big model, making the final inspection abnormality information summary and compilation more accurate and comprehensive.
[0082] In addition, an embodiment of the present invention further proposes a storage medium, on which a power plant inspection operation robot control program is stored. When the power plant inspection operation robot control program is executed by a processor, the steps of the power plant inspection operation robot control method as described above are implemented.
[0083] Reference Figure 3 , Figure 3 This is a structural block diagram of the first embodiment of the power plant inspection robot control device of the present invention.
[0084] like Figure 3 As shown, the power plant inspection robot control device proposed in the embodiment of the present invention includes:
[0085] The target selection module 10 is used to select a target robot for inspection when an abnormal gathering point is detected in the target factory area.
[0086] The on-site collection module 20 is used to control the target robot to collect on-site audio and video information fed back by the on-site personnel during the interview.
[0087] The inspection summary module 30 is used to organize the on-site audio and video information through the target language large model to obtain inspection abnormality information.
[0088] This embodiment selects a target robot for inspection when an abnormal gathering point is detected in the target factory area; controls the target robot to collect on-site audio and video information from interviews with on-site personnel; and uses the target language large model to organize the on-site audio and video information to obtain inspection abnormality information. In this way, when a staff member finds an abnormality but does not report it, the location where the staff gathers abnormally can be automatically determined, and then a robot can be selected for inspection. Finally, according to the on-site audio and video analysis, the inspection abnormality information can be obtained, so that the abnormality can be discovered in time when it is not reported and the inspection robot can be controlled for inspection, which improves the timeliness and flexibility of the inspection.
[0089] In some embodiments, the target selection module 10 is also used to obtain robot inspection plan information and factory personnel gathering information; determine abnormal gathering points based on the factory personnel gathering information; and determine the target robot for inspection based on the abnormal gathering points and the robot inspection plan information.
[0090] In some embodiments, the target selection module 10 is also used to determine the inspection route information and inspection time information of multiple standby robots based on the robot inspection plan information; determine the target destination and current position of each standby robot based on the inspection route information and the inspection time information; and select a target robot for inspection from each standby robot based on the current position, the target destination and the abnormal gathering point.
[0091] In some embodiments, the on-site acquisition module 20 is also used to control the target robot to collect on-site video information of the abnormal gathering point; to edit the on-site video information to obtain personnel feedback video; and to split and process the personnel feedback video to obtain on-site audio and video information.
[0092] In some embodiments, the inspection summary module 30 is further used to input the on-site audio and video information into a target language model to obtain a language analysis result; and to organize the language analysis result to obtain inspection abnormality information.
[0093] In some embodiments, the inspection summary module 30 is further used to obtain word frequency information and sentence concatenation information based on the language analysis results; determine inspection summary keywords based on the word frequency information and the sentence concatenation information; and generate inspection exception information based on the inspection summary keywords.
[0094] In some embodiments, the inspection summary module 30 is also used to determine the reason information for personnel gathering based on the inspection summary keywords; query a preset database based on the reason information for personnel gathering to obtain a standard structure statement corresponding to the reason information for personnel gathering; and generate inspection exception information based on the standard structure statement.
[0095] An embodiment of the present application also provides a power plant inspection work robot control device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus, and the memory is used to store the power plant inspection work robot control program; the processor is used to implement the above-mentioned power plant inspection work robot control method when executing the program stored in the memory.
[0096] The communication bus mentioned in the above power plant inspection robot control device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc.
[0097] The communication interface is used for communication between the above-mentioned power plant inspection robot control device and other devices.
[0098] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.
[0099] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, and discrete hardware components.
[0100] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.
[0101] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0102] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0103] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
[0104] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.
[0105] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.
[0106] In addition, for technical details that are not described in detail in this embodiment, reference can be made to the power plant inspection robot control method provided in any embodiment of the present invention, and will not be repeated here.
[0107] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0108] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0109] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0110] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
[0111] It is understandable that the system provided by the embodiment of the present invention corresponds to the method provided by the embodiment of the present invention, and the explanation, examples and beneficial effects of the relevant contents can refer to the corresponding parts in the above method.
Claims
1. A control method for a power plant inspection robot, characterized in that: The power plant inspection robot control method comprises: When abnormal gathering points are detected in the target factory area, a target robot is selected for inspection; Control the target robot to collect on-site audio and video information of interview feedback from on-site personnel; The on-site audio and video information is collated through a target language large model to obtain inspection abnormality information.
2. The method according to claim 1, characterized in that When an abnormal gathering point is detected in the target factory area, a target robot is selected for inspection, including: Obtain robot inspection plan information and factory personnel gathering information; Determine abnormal gathering points based on the information on gathering of personnel in the factory area; The target robot for inspection is determined based on the abnormal gathering points and the robot inspection plan information.
3. The method according to claim 2, characterized in that The step of determining a target robot to be inspected according to the abnormal gathering point and the robot inspection plan information includes: Determine inspection route information and inspection time information of multiple standby robots according to the robot inspection plan information; Determine the target destination and current position of each standby robot according to the inspection route information and inspection time information; A target robot for inspection is selected from each standby robot according to the current position, the target destination and the abnormal gathering point.
4. The method according to claim 1, characterized in that The controlling the target robot to collect on-site audio and video information of interview feedback from on-site personnel includes: Controlling the target robot to collect on-site video information of the abnormal gathering point; Editing the on-site video information to obtain a personnel feedback video; The video is split and processed according to the feedback from the personnel to obtain on-site audio and video information.
5. The method according to claim 1, characterized in that The method of obtaining inspection abnormality information by collating the on-site audio and video information through the target language big model includes: Inputting the on-site audio and video information into a target language model to obtain a language analysis result; The language analysis results are collated to obtain inspection abnormality information.
6. The method according to claim 5, characterized in that The language analysis results are collated to obtain inspection abnormality information, including: Obtain word frequency information and sentence concatenation information according to the language analysis results; Determine inspection summary keywords according to the word frequency information and the sentence concatenation information; Inspection abnormality information is generated according to the inspection summary keywords.
7. The method according to claim 6, characterized in that The generating of inspection abnormality information according to the inspection summary keywords includes: Determine the reason for the gathering of people based on the inspection summary keywords; According to the information on the reason for the gathering of people, a preset database is searched to obtain a standard structure sentence corresponding to the information on the reason for the gathering of people; Generate inspection exception information according to the standard structure statement.
8. A power plant inspection robot control device, characterized in that: The power plant inspection robot control device comprises: The target selection module is used to select the target robot for inspection when abnormal gathering points are detected in the target factory area; A site collection module, used to control the target robot to collect on-site audio and video information of interview feedback from on-site personnel; The inspection summary module is used to organize the on-site audio and video information through the target language large model to obtain inspection abnormality information.
9. A power plant inspection robot control device, characterized in that: The power plant inspection work robot control device includes: a memory, a processor, and a power plant inspection work robot control program stored in the memory and executable on the processor, and the power plant inspection work robot control program is configured to implement the steps of the power plant inspection work robot control method as described in any one of claims 1 to 7.
10. A storage medium, characterized in that: The storage medium stores a power plant inspection operation robot control program, and when the power plant inspection operation robot control program is executed by the processor, the steps of the power plant inspection operation robot control method according to any one of claims 1 to 7 are implemented.
Citation Information
Cited By
Intelligent inspection operation robot
CN120395992A