Method, device, storage medium and processor for processing charging pile information

Abstract

The present application discloses a method, device, storage medium and processor for processing charging pile information. The method includes: obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo performs information interaction with a human-computer interaction system through an interface perception module to obtain a target picture after interaction, where the target picture includes key information; matching the key information with a target template box through a template matching algorithm to obtain a matching result. Wherein, the target template box includes template information; processing the charging pile interface information according to the matching result. Through the present application, the problem of low efficiency of manual detection when processing the information of the charging pile in the related art is solved.

Description

Technical Field

[0001] The present application relates to the technical field of new energy vehicle charging pile evaluation, and more specifically, to a method, device, storage medium, and processor for processing charging pile information. Background Art

[0002] With the continuous development of social economy, the problems of energy shortage and environmental pollution have become increasingly serious. Automobiles account for a relatively large proportion in environmental pollution and energy consumption. In order to address issues such as global warming and energy depletion, new energy electric vehicles have emerged as the times require. As a green travel tool, electric vehicles have been vigorously promoted by countries around the world in recent years. At the same time, charging piles, as important facilities for replenishing electric energy for electric vehicles, have also developed rapidly. China is also actively promoting the construction of charging piles and other infrastructure. However, the charging piles on the market generally have problems such as non-standard protocols and incompatible charging, resulting in the inability to charge normally and even charging safety accidents. In order to ensure that charging piles can serve users safely and reliably, the functional testing of charging piles before leaving the factory is particularly important. In this regard, the relevant national departments have introduced strict standards, requiring mandatory testing of the communication protocol consistency and interoperability of charging piles. There are as many as 97 items in the project content, and the test logic is complex.

[0003] The current detection method mainly adopts the method of manual inspection one by one. This method has the following three disadvantages:

[0004] First, before leaving the factory, the charging piles are in an uninstalled state and do not have complete safety protection devices. For example, the output voltage of most charging piles is extremely high, about 720v. If electric leakage occurs during the manual testing process, it will pose a great threat to the life safety of workers. The manual testing method is inefficient and may have large subjective errors. If these errors cannot be discovered in time, there will be many interoperability problems and safety hazards when the charging piles are actually put into use, resulting in product scrapping and recycling, which will cause waste of time and cost for enterprises, and may even lead to safety accidents in severe cases, with unthinkable consequences.

[0005] Second, there are many operation interfaces for charging piles. The positions and contents of the key information to be extracted are different for different interfaces. The text boxes output by simply using traditional text detection algorithms may have two abnormal situations: content truncation and redundant information, which increases the difficulty of subsequent text recognition work. This phenomenon can rely on manually re-labeling the character connection boxes of the data set to retrain the text recognition network, but this is obviously very inefficient.

[0006] III. In the case of diverse text categories, diverse text font sizes, and changes in text size and template structure, and using only a single text recognition model, it is even more difficult to ensure the accuracy of detection and recognition. At the same time, when there is a large amount of text on the recognition interface, if all text, whether key information or not, needs to be recognized one by one, the processing speed of the system is difficult to meet the requirements.

[0007] Regarding the problem of low efficiency of manual detection when processing the information of charging piles in related technologies, no effective solution has been proposed yet. Summary of the Invention

[0008] The main purpose of this application is to provide a method, device, storage medium, and processor for processing the information of charging piles, so as to solve the problem of low efficiency of manual detection when processing the information of charging piles in related technologies.

[0009] To achieve the above object, according to one aspect of the present application, a method for processing the information of charging piles is provided. The method includes: obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo interacts with the human-computer interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information; matching the key information with a target template box through a template matching algorithm to obtain a matching result. Among them, the target template box includes template information; processing the charging pile interface information according to the matching result.

[0010] Further, a binocular camera is installed on the robotic arm, and a photo of the charging pile interface is taken through the binocular camera.

[0011] Further, before matching the key information with the target template box through the template matching algorithm, the method further includes: extracting the text information in the target picture through the template matching algorithm; obtaining the key information in the extracted text information to obtain the key information.

[0012] Further, matching the key information with the target template box through the template matching algorithm includes: determining a target detection box based on the key information, where the target detection box contains the key information; matching the target detection box with the target template box through the template matching algorithm.

[0013] Further, before matching the target detection box with the target template box through the template matching algorithm, the method further includes: determining whether the target template box includes multiple target detection boxes; if the target template box includes multiple target detection boxes, merging the target detection boxes.

[0014] Further, before matching the target detection box with the target template box through the template matching algorithm, the method further includes: determining whether the target detection box is associated with multiple target template boxes; if the target detection box is associated with multiple target template boxes, performing segmentation processing on the target detection box.

[0015] Further, matching the target detection box with the target template box through the template matching algorithm includes: determining target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box; matching the target detection box with the target template box through the target coordinate information.

[0016] Further, determining the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box includes: comparing the coordinate information of the target template box with the coordinate information of the target detection box to obtain the maximum value in the coordinate information; determining the coordinate information of the rectangle according to the maximum and minimum values in the coordinate information.

[0017] Further, after matching the key information with the target template box through the template matching algorithm, the method further includes: processing the format of the target detection box to obtain a processed target format, where the target format is the same as the format of the target template box.

[0018] Further, after processing the format of the target detection box to obtain a processed target format, the method further includes: detecting the matching result according to the template matching algorithm to obtain a detection result; classifying the key information according to the detection result.

[0019] To achieve the above object, according to another aspect of the present application, there is provided a processing device for charging pile information. The device includes: a first acquisition unit for acquiring a photo of the charging pile interface through a robotic arm on the charging pile; a first interaction unit for performing information interaction on the photo with the human-computer interaction system through an interface perception module to obtain an interaction target picture, where the target picture includes key information; a first matching unit for matching the key information with the target template box through a template matching algorithm, where the target template box includes template information; a first processing unit for processing the charging pile interface information according to the matching result.

[0020] Further, a binocular camera is installed on the robotic arm, and the charging pile interface is photographed through the binocular camera to obtain a photo.

[0021] Further, the device further includes: a first extraction unit, configured to extract text information in a target picture through a template matching algorithm before matching key information with a target template box through the template matching algorithm; a second acquisition unit, configured to acquire key information in the extracted text information to obtain the key information.

[0022] Further, the first matching unit includes: a first determination subunit, configured to determine a target detection box based on the key information, where the target detection box contains the key information; a first matching subunit, configured to match the target detection box with the target template box through a template matching algorithm.

[0023] Further, the device further includes: a first judgment unit, configured to judge whether the target template box includes multiple target detection boxes before matching the target detection box with the target template box through a template matching algorithm; a first merging unit, configured to merge the target detection boxes if the target template box includes multiple target detection boxes.

[0024] Further, the device further includes: a second judgment unit, configured to judge whether the target detection box is associated with multiple target template boxes before matching the target detection box with the target template box through a template matching algorithm; a first splitting unit, configured to perform splitting processing on the target detection box if the target detection box is associated with multiple target template boxes.

[0025] Further, the first matching subunit includes: a first determination module, configured to determine target coordinate information, where the target coordinate information includes coordinate information of the target template box, coordinate information of the target detection box, and coordinate information of a rectangle obtained by intersection of the target template box and the target detection box; a first matching module, configured to match the target detection box with the target template box through the target coordinate information.

[0026] Further, the first determination module includes: a first comparison sub-module, configured to compare the coordinate information of the target template box with the coordinate information of the target detection box to obtain the maximum value in the coordinate information; a first determination sub-module, configured to determine the coordinate information of the rectangle according to the maximum and minimum values in the coordinate information.

[0027] Further, the device further includes: a second processing unit, configured to process the format of the target detection box after matching the key information with the target template box through a template matching algorithm to obtain a processed target format, where the target format is the same as the format of the target template box.

[0028] Further, the device further includes: a first detection unit, configured to detect a matching result according to a template matching algorithm after processing the format of the target detection box to obtain a processed target format, to obtain a detection result; a first classification unit, configured to classify the key information according to the detection result.

[0029] According to another aspect of the embodiments of the present application, a processor is further provided, and the processor is used to run a program. When the program runs, the method described in any one of the above is executed.

[0030] According to another aspect of the embodiments of the present application, a computer-readable storage medium is further provided, on which a computer program / instructions are stored. When the computer program / instructions are executed by a processor, the method described in any one of the above is executed.

[0031] Through the present application, the following steps are adopted: obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo performs information interaction with the human-computer interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information; matching the key information with a target template box through a template matching algorithm to obtain a matching result. Among them, the target template box includes template information; processing the charging pile interface information according to the matching result. This solves the problem of low efficiency of manual detection when processing the information of the charging pile in the related art. By performing human-computer interaction on the photo of the charging pile interface obtained by the robotic arm on the charging pile to obtain a target picture, and matching the key information in the target picture with the target template box through a template matching algorithm, based on the matching result, when processing the information of the charging pile, the system can automatically match, thereby achieving the effect of improving the detection efficiency of the charging pile information. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings constituting a part of the present application are used to provide a further understanding of the present application. The schematic embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation to the present application. In the drawings:

[0033] Figure 1 is a flowchart of the method for processing charging pile information provided by the embodiments of the present application;

[0034] Figure 2 is a schematic diagram of the overall structure of the method for processing charging pile information provided by the embodiments of the present application;

[0035] Figure 3 is a schematic diagram of the module matching algorithm of the method for processing charging pile information provided by the embodiments of the present application;

[0036] Figure 4 is a schematic diagram of a single solid line rectangular box of the method for processing charging pile information provided by the embodiments of the present application;

[0037] Figure 5 is a schematic diagram of a double solid line rectangular box of the method for processing charging pile information provided by the embodiments of the present application;

[0038] Figure 6 It is a schematic diagram of the coordinate list of the intersection rectangle of the method for processing charging pile information provided by the embodiments of the present application;

[0039] Figure 7 It is a schematic diagram of the area of the overlap-box of the method for processing charging pile information provided by the embodiments of the present application;

[0040] Figure 8 It is a schematic diagram of the undetected part of the method for processing charging pile information provided by the embodiments of the present application;

[0041] Figure 9 It is a schematic diagram of the one-to-many detection boxes of the method for processing charging pile information provided by the embodiments of the present application;

[0042] Figure 10 It is a schematic diagram of the many-to-one detection boxes of the method for processing charging pile information provided by the embodiments of the present application;

[0043] Figure 11 It is a schematic diagram of the one-to-one detection boxes of the method for processing charging pile information provided by the embodiments of the present application;

[0044] Figure 12 It is a schematic diagram of the device for processing charging pile information provided by the embodiments of the present application. Detailed implementation manners

[0045] It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other. The present application will be described in detail below with reference to the drawings and in combination with the embodiments.

[0046] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0047] It should be noted that the terms "first", "second", etc. in the description, claims and above-mentioned drawings of this application are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so as to implement the embodiments of the present application described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0048] According to an embodiment of the present application, a method for processing charging pile information is provided.

[0049] Figure 1 It is a flowchart of the method for processing charging pile information according to an embodiment of the present application. As Figure 1 shown, the method includes the following steps:

[0050] Step S101, obtain a photo of the charging pile interface through a robotic arm on the charging pile.

[0051] For example, a robotic arm is arranged on one side of the charging pile, and a binocular camera is installed on the robotic arm. The robotic arm is used to replace the tester to perform intelligent detection on the charging pile before leaving the factory, and the real-time picture of the charging pile interface is taken by installing a binocular camera on the robotic arm to replace the human eye to detect and identify the interface.

[0052] Optionally, in the method for processing charging pile information provided by the embodiment of the present application, a binocular camera is installed on the robotic arm, and a photo of the charging pile interface is taken through the binocular camera.

[0053] Specifically, after obtaining the photo of the charging pile interface, the present application uses a method to replace the human hand by moving the robotic arm on the charging pile to the target position to touch each function button on the charging pile interface for interface switching and function testing, which not only improves the detection efficiency but also avoids the occurrence of safety accidents.

[0054] Step S102, the photo interacts with the human-computer interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information.

[0055] For example, Figure 2 It is a schematic diagram of the overall structure of the method for processing charging pile information provided by an embodiment of the present application. As Figure 2As shown, the binocular camera installed on the robotic arm inputs the real-time picture of the charging pile interface into the interface perception module. The interface perception module interacts with the human-machine interaction system. The real-time picture of each type of interface has a fixed template. The template matching algorithm extracts and identifies the key information on each text from the real-time picture image with a complex background.

[0056] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, before matching the key information with the target template box through the template matching algorithm, the method further includes: extracting the text information in the target picture through the template matching algorithm; obtaining the key information in the extracted text information to obtain the key information.

[0057] For example, when recharging a charging card on the charging pile interface, the binocular camera is used to obtain the recharge interface of the charging pile. If 100 yuan is recharged through the robotic arm, the real-time recharge interface of the charging pile is photographed. The photographed real-time recharge interface (corresponding to the target picture in the present application) is interacted with the human-machine interaction system through the interface perception module. The text information of the charging pile recharge interface is extracted through the template matching algorithm in the human-machine interaction system. For example, the key information obtained on the text is "100 yuan".

[0058] Step S103, match the key information with the target template box through the template matching algorithm to obtain a matching result. Among them, the target template box includes template information.

[0059] For example, there are 10 target template boxes, which respectively represent the numbers 0-9. 100 yuan is matched with the target template boxes one by one according to the template matching algorithm.

[0060] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, matching the key information with the target template box through the template matching algorithm includes: determining a target detection box based on the key information, where the target detection box contains the key information; matching the target detection box with the target template box through the template matching algorithm.

[0061] For example, the key information extracted from the text information of the charging pile interface is "100 yuan". 100 is split into "1", "0", "0". Each split 100 is placed in the target detection box, and the target detection box is matched with the target template box through the template matching algorithm to obtain a matching result.

[0062] Step S104, process the charging pile interface information according to the matching result.

[0063] For example, improving the template matching algorithm in the human-computer interaction system to match the target detection box with the target template box, identify the key information "100 yuan" and recharge, and the charging interface shows that the recharge is successful.

[0064] Specifically, according to Figure 2 It can be seen that the present application processes the charging pile interface information according to the matching result, and realizes the detection of the charging pile function based on the calculation of the coordinates in the text information.

[0065] Figure 3 It is a schematic diagram of the module matching algorithm for the method of processing charging pile information provided by the embodiments of the present application. As Figure 3 shown, the template matching algorithm includes three types of coordinate information: the template box, the detection box, and the intersection rectangle coordinate information of these two boxes. In the template matching algorithm, it is set that the area of template_box is: A(Gi); the area of detect-box is: A(Di); the template box coordinates are: template_box = [x t0 , y t0 , x t1 , y t1 , the detection box coordinates: detection_box = [x d0 , y d0 , x d1 , y d1 .

[0066] Optionally, in the method for processing charging pile information provided by the embodiments of the present application, matching the target detection box with the target template box through the template matching algorithm includes: determining target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box; matching the target detection box with the target template box through the target coordinate information.

[0067] Specifically, Figure 4 It is a schematic diagram of the single solid line rectangle box for the method of processing charging pile information provided by the embodiments of the present application. As Figure 4 shown, the present application uses the form of a single solid line rectangle box to represent the coordinates of the target template box, where the target template box coordinates are: template_box = [x t0 , y t0 , x t1 , y t1 .

[0068] Specifically, Figure 5 It is a schematic diagram of the double solid line rectangle box for the method of processing charging pile information provided by the embodiments of the present application. As Figure 5As shown, the present application uses a double solid line rectangular box to represent the coordinates of the target detection box. Among them, the coordinates of the target detection box are: detection_box = [x d0 , y d0 , x d1 , y d1 . At this time, the coordinates of the detection box are the coordinates on the original image with a complex background.

[0069] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, determining the coordinate information of the rectangle obtained by intersecting the target template box and the target detection box includes: comparing the coordinate information of the target template box with the coordinate information of the target detection box to obtain the maximum value in the coordinate information; determining the coordinate information of the rectangle according to the maximum and minimum values in the coordinate information.

[0070] Specifically, Figure 6 is a schematic diagram of the coordinate list of the intersecting rectangle in the method for processing charging pile information provided in the embodiments of the present application. As Figure 6 shown, when both the detection box and the template box are rectangles, the coordinates of the intersecting rectangle are the maximum and minimum values of the same position coordinates of the template box and the detection box. The coordinate information of the intersecting rectangle is calculated using the template matching algorithm. The coordinate information list of the intersecting rectangle is as follows:

[0071] overlap_box = [max(x d0 , x t0 ), max(y d0 , y t0 ), min(x d1 , x t1 ), min(y d1 , y t1 )], where

[0072] overlay_box is the coordinate list of the intersecting rectangle.

[0073] Specifically, Figure 7 is a schematic diagram of the area of the overlap-box in the method for processing charging pile information provided in the embodiments of the present application. As Figure 7 shown, the area of the overlap-box is: A(G i ) ∩ A(D i ).

[0074] Specifically, Figure 8 is a schematic diagram of the missed detection part in the method for processing charging pile information provided in the embodiments of the present application. As Figure 8 shown, the missed detection part is: A(G error ) = A(G i ) - A(D i ) ∩ A(G i);The ratio of the detected area to the template_box is: The ratio of the detected area to the detect-box is:

[0075] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, before matching the target detection box with the target template box through the template matching algorithm, the method further includes: determining whether the target template box includes multiple target detection boxes; if the target template box includes multiple target detection boxes, merging the target detection boxes.

[0076] Specifically, as Figure 3 shown, when 0 < Gx ≤ 0.9 and 0.2 ≤ Dx ≤ 1, when the target template box includes multiple target detection boxes or the target detection box includes multiple target template boxes, the target detection boxes are merged, and the merged effect diagram is as Figure 9 、as Figure 10 shown.

[0077] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, before matching the target detection box with the target template box through the template matching algorithm, the method further includes: determining whether the target detection box is associated with multiple target template boxes; if the target detection box is associated with multiple target template boxes, performing a segmentation process on the target detection box.

[0078] Specifically, as Figure 3 shown, when 0.9 ≤ Gx ≤ 1 and 0.2 ≤ Dx ≤ 1, when the same target detection box straddles one or more target template boxes, the target detection box is segmented, and the segmentation effect diagram is as Figure 11 shown.

[0079] Optionally, in the method for processing charging pile information provided in the embodiments of the present application, after matching the key information with the target template box through the template matching algorithm, the method further includes: processing the format of the target detection box to obtain a processed target format, where the target format is the same as the format of the target template box.

[0080] Specifically, after processing the format of the target detection box to obtain a processed target format, the method further includes: detecting the matching result according to the template matching algorithm to obtain a detection result; classifying the key information according to the detection result.

[0081] For example, the template matching algorithm can correct the current matching result under the condition of a small sample. The key information extracted from the matching result is divided into different attributes. This algorithm extracts the key information and places it before text recognition. It does not perform text recognition on unimportant text lines, which not only improves the accuracy of key information extraction and recognition but also enables text recognition and key information extraction in a parallel and structured manner, thus ensuring the real-time performance of the system.

[0082] As can be seen from the above steps S101 - S104, the present application uses a fast template matching algorithm for extracting key information from text, which can quickly and accurately extract the key information on the text image and rapidly extract and recognize the key information on each text from the images of multiple types of texts with complex backgrounds. While ensuring the accuracy of text recognition, it also guarantees the real-time performance of the system.

[0083] The method for processing charging pile information provided in the embodiments of the present application includes obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo interacts with the human - machine interaction system through an interface perception module to obtain a target image after interaction, where the target image includes key information; the key information is matched with a target template box through a template matching algorithm to obtain a matching result. Among them, the target template box includes template information; the charging pile interface information is processed according to the matching result. This solves the problem of low efficiency of manual detection when processing the information of charging piles in the related art. By performing human - machine interaction on the photo of the charging pile interface obtained by the robotic arm on the charging pile to obtain a target image, and matching the key information in the target image with the target template box through a template matching algorithm, based on the matching result, when processing the information of the charging pile, the system can automatically match, thereby achieving the effect of improving the detection efficiency of the charging pile information.

[0084] It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer - executable instructions. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0085] The embodiments of the present application also provide a device for processing charging pile information. It should be noted that the device for processing charging pile information in the embodiments of the present application can be used to execute the method for processing charging pile information provided in the embodiments of the present application. The following introduces the device for processing charging pile information provided in the embodiments of the present application.

[0086] Figure 12 is a schematic diagram of the device for processing charging pile information according to the embodiments of the present application. As Figure 12As shown in the figure, the device includes: a first acquisition unit 1201, a first interaction unit 1202, a first matching unit 1203, and a first processing unit 1204.

[0087] Specifically, the first acquisition unit 1201 is configured to obtain a photo of the charging pile interface through a robotic arm on the charging pile.

[0088] The first interaction unit 1202 is configured to perform information interaction on the photo with the human-machine interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information.

[0089] The first matching unit 1203 is configured to match the key information with a target template box through a template matching algorithm, where the target template box includes template information.

[0090] The first processing unit 1204 is configured to process the charging pile interface information according to the matching result.

[0091] In summary, for the processing device of the charging pile information provided in the embodiment of the present application, the first acquisition unit 1201 obtains a photo of the charging pile interface through the robotic arm on the charging pile; the first interaction unit 1202 performs information interaction on the photo with the human-machine interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information; the first matching unit 1203 matches the key information with a target template box through a template matching algorithm, where the target template box includes template information; the first processing unit 1204 processes the charging pile interface information according to the matching result, which solves the problem of low efficiency of manual detection when processing the information of the charging pile in the related art. By performing human-machine interaction on the photo of the charging pile interface obtained by the robotic arm on the charging pile to obtain a target picture, and matching the key information in the target picture with the target template box through a template matching algorithm, based on the matching result, when processing the information of the charging pile, the system can automatically match, thereby achieving the effect of improving the detection efficiency of the charging pile information.

[0092] Optionally, in the processing device of the charging pile information provided in the embodiment of the present application, a binocular camera is installed on the robotic arm, and a photo of the charging pile interface is taken through the binocular camera.

[0093] Optionally, in the processing device of the charging pile information provided in the embodiment of the present application, the device further includes: a first extraction unit, configured to extract the text information in the target picture through a template matching algorithm before matching the key information with the target template box; a second acquisition unit, configured to acquire the key information in the extracted text information to obtain the key information.

[0094] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the first matching unit includes: a first determining subunit, configured to determine a target detection frame based on key information, where the target detection frame contains the key information; a first matching subunit, configured to match the target detection frame with a target template frame through a template matching algorithm.

[0095] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the device further includes: a first judging unit, configured to judge whether the target template frame includes a plurality of target detection frames before matching the target detection frame with the target template frame through a template matching algorithm; a first combining unit, configured to combine the target detection frames if the target template frame includes a plurality of target detection frames.

[0096] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the device further includes: a second judging unit, configured to judge whether the target detection frame is associated with a plurality of target template frames before matching the target detection frame with the target template frame through a template matching algorithm; a first splitting unit, configured to perform a splitting process on the target detection frame if the target detection frame is associated with a plurality of target template frames.

[0097] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the first matching subunit includes: a first determining module, configured to determine target coordinate information, where the target coordinate information includes coordinate information of the target template frame, coordinate information of the target detection frame, and coordinate information of a rectangle obtained by the intersection of the target template frame and the target detection frame; a first matching module, configured to match the target detection frame with the target template frame through the target coordinate information.

[0098] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the first determining module includes: a first comparing sub-module, configured to compare the coordinate information of the target template frame with the coordinate information of the target detection frame to obtain the maximum value in the coordinate information; a first determining sub-module, configured to determine the coordinate information of the rectangle according to the maximum or minimum value in the coordinate information.

[0099] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the device further includes: a second processing unit, configured to process the format of the target detection frame after matching the key information with the target template frame through a template matching algorithm to obtain a processed target format, where the target format is the same as the format of the target template frame.

[0100] Optionally, in the processing device for charging pile information provided in the embodiments of the present application, the device further includes: a first detection unit, configured to, after processing the format of the target detection frame to obtain a processed target format, detect the matching result according to the template matching algorithm to obtain a detection result; a first classification unit, configured to classify key information according to the detection result.

[0101] The processing device for charging pile information includes a processor and a memory. The above-mentioned first acquisition unit 1201, first interaction unit 1202, first matching unit 1203, first processing unit 1204, etc. are all stored in the memory as program units, and the processor executes the above program units stored in the memory to implement corresponding functions.

[0102] The processor includes a kernel, and the kernel retrieves the corresponding program unit from the memory. One or more kernels can be set, and the charging pile information is processed by adjusting the kernel parameters.

[0103] The memory may include non-permanent memory in a computer-readable medium, forms such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one storage chip.

[0104] The embodiments of the present invention provide a storage medium, on which a program is stored, and when the program is executed by a processor, it implements a method for processing charging pile information.

[0105] The embodiments of the present invention provide a processor, and the processor is used to run a program, wherein when the program runs, it executes a method for processing charging pile information.

[0106] The embodiments of the present invention provide a device, which includes a processor, a memory, and a program stored on the memory and executable on the processor. When the processor executes the program, the following steps are implemented: obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo interacts with a human-computer interaction system through an interface perception module to obtain an interactive target picture, wherein the target picture includes key information; matching the key information with a target template box through a template matching algorithm to obtain a matching result. Wherein, the target template box includes template information; processing the charging pile interface information according to the matching result.

[0107] When the processor executes the program, the following steps are further implemented: a binocular camera is installed on the robotic arm, and a photo of the charging pile interface is taken through the binocular camera.

[0108] When the processor executes the program, the following steps are also implemented: Before matching the key information with the target template box through the template matching algorithm, extract the text information in the target picture through the template matching algorithm; obtain the key information in the extracted text information to get the key information.

[0109] When the processor executes the program, the following steps are also implemented: Determine the target detection box based on the key information, where the target detection box contains the key information; match the target detection box with the target template box through the template matching algorithm.

[0110] When the processor executes the program, the following steps are also implemented: Before matching the target detection box with the target template box through the template matching algorithm, determine whether the target template box includes multiple target detection boxes; if the target template box includes multiple target detection boxes, merge the target detection boxes.

[0111] When the processor executes the program, the following steps are also implemented: Before matching the target detection box with the target template box through the template matching algorithm, determine whether the target detection box is associated with multiple target template boxes; if the target detection box is associated with multiple target template boxes, perform a segmentation process on the target detection box.

[0112] When the processor executes the program, the following steps are also implemented: Determine the target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box; match the target detection box with the target template box through the target coordinate information.

[0113] When the processor executes the program, the following steps are also implemented: Compare the coordinate information of the target template box with the coordinate information of the target detection box to obtain the maximum value in the coordinate information; determine the coordinate information of the rectangle according to the maximum and minimum values in the coordinate information.

[0114] When the processor executes the program, the following steps are also implemented: After matching the key information with the target template box through the template matching algorithm, process the format of the target detection box to obtain the processed target format, where the target format is the same as the format of the target template box.

[0115] When the processor executes the program, the following steps are also implemented: After processing the format of the target detection box to obtain the processed target format, detect the matching result according to the template matching algorithm to obtain the detection result; classify the key information according to the detection result.

[0116] The device in this article can be a server, PC, PAD, mobile phone, etc.

[0117] The present application also provides a computer program product, which, when executed on a data processing device, is adapted to execute a program initialized with the following method steps: obtaining a photo of the charging pile interface through a robotic arm on the charging pile; the photo interacts with the human-machine interaction system through an interface perception module to obtain a target photo after interaction, where the target photo includes key information; matching the key information with a target template box through a template matching algorithm to obtain a matching result. Wherein, the target template box includes template information; processing the charging pile interface information according to the matching result.

[0118] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: a binocular camera is installed on the robotic arm, and a photo of the charging pile interface is taken through the binocular camera.

[0119] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: before matching the key information with the target template box through a template matching algorithm, extracting the text information in the target photo through the template matching algorithm; obtaining the key information from the extracted text information to obtain the key information.

[0120] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: determining a target detection box based on the key information, where the target detection box contains the key information; matching the target detection box with the target template box through a template matching algorithm.

[0121] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: before matching the target detection box with the target template box through a template matching algorithm, determining whether the target template box includes multiple target detection boxes; if the target template box includes multiple target detection boxes, merging the target detection boxes.

[0122] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: before matching the target detection box with the target template box through a template matching algorithm, determining whether the target detection box is associated with multiple target template boxes; if the target detection box is associated with multiple target template boxes, performing a splitting process on the target detection box.

[0123] When executed on a data processing device, it is also adapted to execute a program initialized with the following method steps: determining target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box; matching the target detection box with the target template box through the target coordinate information.

[0124] When executed on a data processing device, it is also suitable for executing a program initialized with the following method steps: comparing the coordinate information of a target template box with the coordinate information of a target detection box to obtain the maximum value in the coordinate information; determining the coordinate information of a rectangle based on the maximum value in the coordinate information.

[0125] When executed on a data processing device, it is also suitable for executing a program initialized with the following method steps: after matching key information with a target template box through a template matching algorithm, processing the format of a target detection box to obtain a processed target format, where the target format is the same as the format of the target template box.

[0126] When executed on a data processing device, it is also suitable for executing a program initialized with the following method steps: after processing the format of a target detection box to obtain a processed target format, detecting the matching result according to the template matching algorithm to obtain a detection result; classifying the key information according to the detection result.

[0127] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0128] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one or more flows or multiple flows and / or blocks Figure 1 one or more blocks or multiple blocks.

[0129] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one or more flows or multiple flows and / or blocks Figure 1 one or more blocks or multiple blocks.

[0130] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide for implementing in the process Figure 1 One process or multiple processes and / or boxes Figure 1 Steps for the functions specified in one box or multiple boxes.

[0131] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and memory.

[0132] The memory may include non-permanent memory in the form of computer-readable media, random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.

[0133] Computer-readable media includes permanent and non-permanent, removable and non-removable media and can store information by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0134] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or also includes elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the existence of additional identical elements in the process, method, commodity or device comprising the element.

[0135] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0136] The above are only the embodiments of the present application and are not intended to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

1. A method for processing charging pile information, characterized in that, Including: Obtaining a photo of the charging pile interface through a robotic arm on the charging pile; The photo interacts with the human-machine interaction system through an interface perception module to obtain a target picture after interaction, where the target picture includes key information; Matching the key information with a target template box through a template matching algorithm to obtain a matching result; where the target template box includes template information; Processing the charging pile interface information according to the matching result; Among them, the matching of the key information with the target template box through the template matching algorithm includes: Determining a target detection box based on the key information, where the target detection box contains the key information; Determining target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of a rectangle obtained by the intersection of the target template box and the target detection box; Matching the target detection box with the target template box through the target coordinate information.

2. The method according to claim 1, wherein A binocular camera is installed on the robotic arm, and the photo of the charging pile interface is taken through the binocular camera.

3. The method according to claim 1, wherein Before matching the key information with the target template box through the template matching algorithm, the method further includes: Extracting text information in the target picture through the template matching algorithm; Obtaining key information in the extracted text information to obtain the key information.

4. The method according to claim 1, wherein Before matching the target detection box with the target template box through the template matching algorithm, the method further includes: Judging whether the target template box includes multiple target detection boxes; If the target template box includes multiple target detection boxes, merging the target detection boxes.

5. The method according to claim 1, wherein Before matching the target detection box with the target template box through the template matching algorithm, the method further includes: Judging whether the target detection box is associated with multiple target template boxes; If the target detection box is associated with multiple target template boxes, performing a splitting process on the target detection box.

6. The method according to claim 1, characterized in that, Determining the coordinate information of the rectangle obtained by the intersection of the target template box and the target detection box includes: Comparing the coordinate information of the target template box with the coordinate information of the target detection box to obtain the maximum value in the coordinate information; Determining the coordinate information of the rectangle according to the maximum and minimum values in the coordinate information.

7. The method according to claim 1, wherein After matching the key information with the target template box through the template matching algorithm, the method further includes: Processing the format of the target detection box to obtain a processed target format, where the target format is the same as the format of the target template box.

8. The method according to claim 1, wherein After processing the format of the target detection box to obtain a processed target format, the method further includes: Detecting the matching result according to the template matching algorithm to obtain a detection result; Classifying the key information according to the detection result.

9. A processing device for charging pile information, characterized in that, Including: A first obtaining unit for obtaining a photo of the charging pile interface through a robotic arm on the charging pile; The first interaction unit is configured to perform information interaction between the photo and the human-computer interaction system through the interface perception module to obtain a target picture after interaction, where the target picture includes key information; The first matching unit is configured to match the key information with a target template box through a template matching algorithm, where the target template box includes template information; The first processing unit is configured to process the charging pile interface information according to the matching result; Among them, the first matching unit is configured to determine a target detection box based on the key information, where the target detection box contains the key information; match the target detection box with the target template box through a template matching algorithm; Among them, the device is further configured to determine target coordinate information, where the target coordinate information includes the coordinate information of the target template box, the coordinate information of the target detection box, and the coordinate information of a rectangle obtained by the intersection of the target template box and the target detection box; match the target detection box with the target template box through the target coordinate information.

10. A processor, characterized in that, The processor is configured to run a program, where the program, when running, executes the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that, The storage medium includes a stored program, where the program executes the method according to any one of claims 1 to 8.

Images