Grid member patrol assisting method, device, equipment and medium

Abstract

The invention provides a grid member patrol assisting method, device and equipment and a medium. The method comprises the following steps: S1, receiving an on-site picture or video collected and uploaded by a grid member in a grid patrol process; s2, using a social governance scene recognition algorithm pre-created through a multi-modal large model technology to intelligently recognize the on-site picture or video to obtain a recognition result; s3, automatically generating a problem description corresponding to the social governance scene according to an identification result; and S4, carrying out association storage on the corresponding grid ID, the problem description and the on-site picture or video, and reporting to a social governance processing department. According to the method, the problem description is automatically generated through intelligent scene recognition, so that the problems of low data acquisition efficiency and poor accuracy in the patrolling process of grid members are solved, and the intelligent level of patrolling work is improved.

Description

Technical Field

[0001] The present invention mainly relates to technical fields such as social governance, artificial intelligence image recognition, and natural language description generation, and in particular to a method, device, equipment and medium for assisting grid workers in patrolling. Background Art

[0002] Social governance is a process in which multiple subjects such as governments, social organizations, enterprises, institutions, communities and individuals guide and regulate social affairs, social organizations and social life in accordance with the law through equal cooperation, dialogue, consultation and communication, so as to ultimately maximize public interests.

[0003] Grid management of social governance is an innovative grassroots social governance model. It divides the community into several grids, and each grid is patrolled by a corresponding grid member, who records and reports patrol matters, so as to achieve refined and systematic management of people, land, objects, feelings, events, organizations, etc. in the community. This management model emphasizes individual responsibility and piecemeal responsibility, aiming to improve the efficiency and service quality of grassroots governance.

[0004] In current social governance, grid workers usually need to record and report on-site conditions during patrols. However, grid workers currently use manual recording or simple photo-taking to keep evidence, and then manually analyze and describe the photos. This manual recording method is inefficient and easy to miss important information; and the simple photo-taking method lacks instant scene recognition and description functions, which is not conducive to rapid response and problem handling.

[0005] With the development of artificial intelligence technology, intelligent scene recognition technology has been widely used, but its application in grid patrol is still insufficient. Therefore, in order to make up for this deficiency, the present invention proposes a grid patrol auxiliary mechanism, which is suitable for grid patrol work in the field of social governance, especially in urban management, community patrol, environmental monitoring and other occasions that require on-site data collection and description. Summary of the invention

[0006] The technical problem to be solved by the present invention is to provide a method, device, equipment and medium for assisting grid workers in patrolling, which automatically generates problem descriptions through intelligent scene recognition, thereby solving the problems of low efficiency and poor accuracy in data collection during grid workers' patrolling and improving the intelligence level of patrolling work.

[0007] In a first aspect, the present invention provides a method for assisting grid personnel in patrolling, comprising:

[0008] S1. Receive on-site photos or videos collected and uploaded by grid workers during grid inspections;

[0009] S2. Using a social governance scene recognition algorithm pre-created by a multimodal large model technology to intelligently recognize the on-site photos or videos to obtain recognition results;

[0010] S3, automatically generate the problem description corresponding to the social governance scenario based on the recognition results;

[0011] S4. Determine the corresponding social governance department based on the problem description;

[0012] S5. The corresponding grid ID, the problem description and the on-site photo or video are associated and stored and reported to the social governance processing department.

[0013] In a second aspect, the present invention provides a device for assisting grid personnel in patrolling, comprising:

[0014] A receiving module is used to receive on-site photos or videos collected and uploaded by grid workers during grid inspections;

[0015] A recognition module, used to intelligently recognize the on-site photos or videos using a social governance scene recognition algorithm pre-created through multimodal large model technology to obtain a recognition result;

[0016] The problem description module is used to automatically generate the problem description corresponding to the social governance scenario based on the recognition results;

[0017] The judgment module is used to determine the corresponding social governance department based on the problem description;

[0018] The reporting module is used to associate and store the corresponding grid ID, the problem description and the on-site photo or video and report them to the social governance processing department.

[0019] In a third aspect, the present invention provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the program.

[0020] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect.

[0021] One or more technical solutions provided by the present invention have at least the following technical effects or advantages: through the social governance scenario recognition algorithm pre-created by multimodal large model technology, automatic recognition of social governance scenarios and automatic generation of problem descriptions are achieved, thereby solving the problems of low efficiency and poor accuracy in data collection during grid workers' patrols and improving the intelligence level of patrol work.

[0022] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The present invention will be further described below in conjunction with embodiments with reference to the accompanying drawings.

[0024] Figure 1 is a flow chart of the method in Embodiment 1 of the present invention;

[0025] Figure 2 A schematic diagram of an intelligent scene recognition process according to an embodiment of the present invention;

[0026] Figure 3 A schematic diagram of a problem reporting interface according to an embodiment of the present invention;

[0027] Figure 4 It is a structural schematic diagram of the device in the second embodiment of the present invention;

[0028] Figure 5 This is a schematic diagram of the structure of an electronic device in Embodiment 3 of the present invention;

[0029] Figure 6 Schematic diagram of the structure of the medium in the fourth embodiment of the present invention. DETAILED DESCRIPTION

[0030] The embodiments of the present application provide a method, device, equipment and medium for assisting grid workers in patrolling, and automatically generate problem descriptions through intelligent scene recognition, thereby solving the problems of low efficiency and poor accuracy in data collection during grid workers' patrolling, and improving the intelligence level of patrolling work.

[0031] The overall idea of ​​the technical solution in the embodiments of the present application is as follows: through the social governance scene recognition algorithm pre-created by multimodal large model technology, grid members can take photos and videos in real time through handheld terminals during the patrol process, and call the social governance scene recognition algorithm to realize automatic recognition of social governance scenes and automatic generation of problem descriptions, which greatly improves the efficiency of data collection and the accuracy of problem descriptions, and improves the intelligence level of patrol work.

[0032] It is known to those skilled in the art that a multimodal large model refers to a model that combines multimodal information such as text, images, videos, and audio for training, and it can obtain corresponding processing results according to the user's prompt words. For image recognition, the multimodal large models currently on the market can already realize the recognition of faces, vehicles, human bodies, non-motor vehicles, gait, living bodies, behaviors, etc., so only the prompt words are needed to realize a certain aspect of the recognition function, thereby creating a corresponding recognition algorithm. Furthermore, for the present invention, the system background can pre-create various recognition algorithms for daily social governance scenarios through a multimodal large model, such as: illegal small advertisement recognition algorithms, wandering beggar recognition algorithms, illegal parking recognition algorithms, fire hazard recognition algorithms, etc. These algorithms are created and saved in the algorithm library. When the grid worker takes photos and videos, the system can automatically call all recognition algorithms in the algorithm library to recognize daily social governance scenarios.

[0033] Embodiment 1

[0034] like Figure 1 As shown, this embodiment provides a method for assisting grid personnel in patrolling, including:

[0035] S1. Receive on-site photos or videos collected and uploaded by grid workers during their grid inspections; when grid workers encounter social governance scenarios that need to be recorded or reported while inspecting the grid, they can take photos or videos of the scene through handheld terminals.

[0036] S2. Using a social governance scene recognition algorithm pre-created by a multimodal large model technology to intelligently recognize the on-site photos or videos to obtain a recognition result; the intelligent recognition includes category recognition and specific location recognition of the social governance scene;

[0037] For grid workers, daily patrol tasks are relatively fixed, so the system can pre-create social governance scene recognition algorithms corresponding to various daily patrol tasks. When on-site photos or videos are collected and uploaded, they are automatically identified based on the social governance scene recognition algorithm.

[0038] S3. Automatically generate problem descriptions corresponding to social governance scenarios based on recognition results. Specifically, retrieve and display pre-set description sentences in the problem description library based on recognition results, and provide an adjustment entry for the description sentences. When grid workers believe that there are unreasonable aspects of the description sentences, they can modify and adjust them through the adjustment entry.

[0039] Similarly, since the daily patrol tasks of grid workers are relatively fixed, the system can pre-set the descriptive statements corresponding to each social governance scenario and save them in the problem description library for intelligent identification and automatic retrieval and generation.

[0040] S4. Determine the corresponding social governance department based on the problem description;

[0041] Grid workers generally only conduct inspections and do not have administrative law enforcement powers. Problems found by grid workers during inspections need to be handled by specific departments, so it is necessary to determine which administrative department should handle the problem description;

[0042] S5. The corresponding grid ID, the problem description and the on-site photo or video are associated and stored and reported to the social governance processing department for timely processing.

[0043] If the on-site photos or videos include multiple social governance scenarios, multiple recognition results will be obtained after intelligent recognition. Different social governance issues need to be handled by different government departments. The system will automatically distribute and report different problem descriptions to the corresponding processing departments for timely processing. For example, if a photo shows both road occupation and illegal parking, as well as homeless beggars performing arts and begging, the recognition results of the three social governance scenarios of road occupation, illegal parking, and homeless beggars performing arts and begging can be identified, so that the problem descriptions of the three recognition results can be reported to the urban management, traffic management departments, or county-level and above governments and other processing departments.

[0044] Furthermore, in S1, the system may first issue social governance inspection tasks to the grid members. The inspection tasks may come from daily inspection tasks or temporary inspection tasks of various government departments. Each inspection task may correspond to a relevant inspection task details registration form, so that the on-site photos or videos collected and uploaded by the grid members during the grid inspection process may be received through the inspection task details registration form;

[0045] In S1, the grid worker can also be located through the handheld terminal to obtain the grid ID of the current patrol grid;

[0046] The intelligent identification in S2 also includes retrieving similar cases and providing detailed links of similar cases; some cases can be handled directly on-site by grid workers. After the grid workers check the detailed links to understand the processing mode of similar cases, they can refer to the processing mode to directly handle the cases on-site.

[0047] In S3, whether the social governance scenario requires an early warning and the warning level are determined based on the identification results and the problem description. If so, early warning information is generated and uploaded to the social governance processing department so that the processing department can handle it in a timely manner.

[0048] For some temporary patrol tasks, the system also provides a creation interface for the social governance scenario recognition algorithm. The creation interface provides configuration items for the algorithm name, prompt words, and warning level. The created social governance scenario recognition algorithm is saved to the system for subsequent calls.

[0049] like Figure 2 and Figure 3 As shown, when a grid worker finds small advertisements posted on a bulletin board during his routine patrol to a certain grid, he can use on-site photos or video recordings to have the system automatically identify the small advertisements as illegal and generate a specific location description. Based on the identification results, one similar case can be retrieved.

[0050] Based on the same inventive concept, the present application also provides a device corresponding to the method in Example 1, see Example 2 for details.

[0051] Embodiment 2

[0052] like Figure 4 As shown, in this embodiment, a device for assisting grid workers in patrolling is provided, including:

[0053] A receiving module is used to receive on-site photos or videos collected and uploaded by grid workers during grid inspections;

[0054] A recognition module, used to perform intelligent recognition of the on-site photos or videos using a social governance scene recognition algorithm pre-created through multimodal large model technology to obtain a recognition result; the intelligent recognition includes category recognition and specific location recognition of the social governance scene;

[0055] The problem description module is used to automatically generate a problem description corresponding to the social governance scenario based on the recognition results; the problem description module specifically retrieves the pre-set description sentences in the problem description library, displays them after matching, and provides an adjustment entry for the description sentences.

[0056] The reporting module is used to associate and store the corresponding grid ID, the problem description and the on-site photo or video and report them to the social governance processing department.

[0057] Furthermore, the implementation device may also include:

[0058] The task issuing module is used to issue patrol tasks for social governance, and receive on-site photos or videos collected and uploaded by grid workers during the patrol process through the patrol task details registration form;

[0059] The positioning module is used to locate the grid worker through the handheld terminal and obtain the grid ID of the current patrol grid;

[0060] The retrieval module is used to retrieve similar cases during the intelligent identification process of the identification module and provide links to the details of similar cases;

[0061] The early warning module is used to determine whether the social governance scenario requires an early warning and the warning level based on the identification results and the problem description. If so, early warning information is generated and uploaded to the social governance processing department.

[0062] The algorithm creation module is used to provide a creation interface for the social governance scenario recognition algorithm. The creation interface provides configuration items for the algorithm name, prompt words, and warning level. The created social governance scenario recognition algorithm is saved to the system for subsequent calls.

[0063] Since the device introduced in the second embodiment of the present invention is a device used to implement the method of the first embodiment of the present invention, those skilled in the art can understand the specific structure and deformation of the device based on the method introduced in the first embodiment of the present invention, so it is not described here in detail. All devices used in the method of the first embodiment of the present invention belong to the scope of protection of the present invention.

[0064] Based on the same inventive concept, the present application provides an electronic device embodiment corresponding to the first embodiment, see the third embodiment for details.

[0065] Embodiment 3

[0066] This embodiment provides an electronic device, such as Figure 5 As shown, it includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, any implementation method in the first embodiment can be implemented.

[0067] Since the electronic device introduced in this embodiment is a device used to implement the method in the first embodiment of the present application, based on the method introduced in the first embodiment of the present application, a person skilled in the art can understand the specific implementation of the electronic device of the present embodiment and its various variations, so how the electronic device implements the method in the embodiment of the present application is not described in detail here. As long as a person skilled in the art implements the device used by the method in the embodiment of the present application, it belongs to the scope of protection of the present application.

[0068] Based on the same inventive concept, the present application provides a storage medium corresponding to the first embodiment, see the fourth embodiment for details.

[0069] Embodiment 4

[0070] This embodiment provides a computer-readable storage medium, such as Figure 6 As shown, a computer program is stored thereon, and when the computer program is executed by a processor, any implementation method in Example 1 can be implemented.

[0071] The technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: the methods, devices, systems, equipment and media provided in the embodiments of the present application,

[0072] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0073] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0074] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0075] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0076] Although the specific implementation modes of the present invention are described above, those skilled in the art should understand that the specific implementation modes described are only illustrative and are not intended to limit the scope of the present invention. Equivalent modifications and changes made by those skilled in the art in accordance with the spirit of the present invention should be included in the scope of protection of the claims of the present invention.

Claims

1. A method for assisting grid workers in patrolling, characterized in that: include: S1. Receive on-site photos or videos collected and uploaded by grid workers during grid inspections; S2. Using a social governance scene recognition algorithm pre-created by a multimodal large model technology to intelligently recognize the on-site photos or videos to obtain a recognition result; S3, automatically generate the problem description corresponding to the social governance scenario based on the recognition results; S4. Determine the corresponding social governance department based on the problem description; S5. The corresponding grid ID, the problem description and the on-site photo or video are associated and stored and reported to the social governance processing department.

2. A method for assisting grid workers in patrolling according to claim 1, characterized in that: S1 also includes issuing patrol tasks for social governance, and receiving on-site photos or videos collected and uploaded by grid workers during the patrol process through the patrol task details registration form; The grid worker is also located through the handheld terminal to obtain the grid ID of the current patrol grid; The intelligent identification in S2 also includes retrieving similar cases and providing detailed links of similar cases; In S3, whether the social governance scenario requires an early warning and the warning level are determined based on the identification result and the problem description. If so, early warning information is generated and uploaded to the social governance processing department.

3. A method for assisting grid workers in patrolling according to claim 1, characterized in that: The intelligent identification in S2 includes category identification and specific location identification of social governance scenarios; The S3 specifically uses the recognition result as a prompt word of the multimodal large model, and the multimodal large model matches the corresponding description sentence in the problem description library and displays it, and provides an adjustment entry for the description sentence.

4. A method for assisting grid personnel in patrolling according to claim 1, characterized in that: A creation interface for the social governance scenario recognition algorithm is also provided. The creation interface provides configuration items for the algorithm name, prompt words, and warning levels. The created social governance scenario recognition algorithm is saved to the system for subsequent calls.

5. A device for assisting grid workers in patrolling, characterized in that: include: A receiving module is used to receive on-site photos or videos collected and uploaded by grid workers during grid inspections; A recognition module, used to intelligently recognize the on-site photos or videos using a social governance scene recognition algorithm pre-created through multimodal large model technology to obtain a recognition result; The problem description module is used to automatically generate the problem description corresponding to the social governance scenario based on the recognition results; The judgment module is used to determine the corresponding social governance department based on the problem description; The reporting module is used to associate and store the corresponding grid ID, the problem description and the on-site photo or video and report them to the social governance processing department.

6. A device for assisting grid workers in patrolling according to claim 5, characterized in that: Also includes: The task issuing module is used to issue patrol tasks for social governance, and receive on-site photos or videos collected and uploaded by grid workers during the patrol process through the patrol task details registration form; The positioning module is used to locate the grid worker through the handheld terminal and obtain the grid ID of the current patrol grid; The retrieval module is used to retrieve similar cases during the intelligent identification process of the identification module and provide links to the details of similar cases; The early warning module is used to determine whether the social governance scenario requires an early warning and the warning level based on the identification results and the problem description. If so, early warning information is generated and uploaded to the social governance processing department.

7. A device for assisting grid personnel in patrolling according to claim 5, characterized in that: The intelligent identification includes category identification and specific location identification of social governance scenarios; The problem description module specifically uses the recognition result as the prompt word of the multimodal large model, matches the corresponding description sentence in the problem description library from the multimodal large model and displays it, and provides an adjustment entry for the description sentence.

8. The device for assisting grid workers in patrolling according to claim 5, characterized in that: Also includes: The algorithm creation module is used to provide a creation interface for the social governance scenario recognition algorithm. The creation interface provides configuration items for the algorithm name, prompt words, and warning level. The created social governance scenario recognition algorithm is saved to the system for subsequent calls.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 4 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

Images