Charging pile remote control method and system

Abstract

The present invention relates to a remote control method and system for a charging pile, comprising a collection terminal, which obtains state information of the charging pile during operation and sends it to an intelligent operation and maintenance platform; the intelligent operation and maintenance platform obtains image information of the charging pile based on a corresponding image collection module according to the state information obtained by the collection terminal, determines that the charging pile is in an abnormal state and has restart conditions based on a screen content area, an indicator light area, a pile body area and a surrounding environment area in the image, and sends a restart instruction to the charging pile; an open-in open-out circuit is arranged on the charging pile, receives the instruction sent by the intelligent operation and maintenance platform, and controls the restart of the charging pile by powering off and on.

Description

Technical Field

[0001] The present invention relates to the technical field of charging pile operation and maintenance, and in particular to a charging pile remote control method and system. Background Art

[0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art.

[0003] Charging piles in operation are generally connected to the service center via 3G or 4G wireless networks. When the network fluctuates, there will be situations such as charging startup failure and connection failure. When the system installed in the charging pile has been running for too long or there are operating errors, the charging pile will "freeze" and cannot be used anymore. There will also be network failures, equipment tripping, etc., which cause the equipment to go offline. These failures do not involve specific parts damage. In most cases, the charging pile can be restored to its configuration by restarting it. However, due to the scattered distribution of charging piles, the operation and maintenance personnel cannot be notified in time after a failure and arrive at the site to deal with it, especially when it comes to simple failures that can be restored by restarting, which makes the operation efficiency of the charging piles insufficient. Summary of the invention

[0004] In order to solve the technical problems existing in the above-mentioned background technology, the present invention provides a remote control method and system for a charging pile, which collects video information of the operation screen of the charging pile on site, divides the image in the video into regions, and executes corresponding judgment logic in different regions to determine whether the current charging pile is abnormal and has the conditions for restarting, and uses the open-in and open-out circuits pre-installed on the charging pile to perform remote restart.

[0005] In order to achieve the above object, the present invention adopts the following technical solution:

[0006] A first aspect of the present invention provides a charging pile remote control system, comprising:

[0007] The collection terminal obtains the status information of the charging pile during operation and sends it to the intelligent operation and maintenance platform;

[0008] The intelligent operation and maintenance platform obtains the image information of the charging pile based on the corresponding image acquisition module according to the status information obtained by the acquisition terminal, determines that the charging pile is in an abnormal state and has the conditions for restarting based on the screen content area, indicator light area, pile body area and surrounding environment area in the image, and issues a restart command to the charging pile;

[0009] The open-in and open-out circuit is installed on the charging pile, and receives the command sent by the intelligent operation and maintenance platform to control the restart of the charging pile by powering off and on.

[0010] When the status information is charging or idle, the pile is marked as operating normally;

[0011] When the status information is faulty or offline, the pile is marked as abnormal operation;

[0012] If the status data is not uploaded within the set time, the pile is marked as abnormal operation.

[0013] When the charging pile operates abnormally, the video file is extracted according to the set period to obtain image information and form a static image.

[0014] After preprocessing and image segmentation of the static image, the charging pile equipment image is obtained, and the remaining area is the surrounding environment image; in the charging pile equipment image, the charging pile screen image, the charging pile indicator light image, and the pile body image are obtained through image segmentation.

[0015] When there is a human figure in the screen image of the charging pile and the image of the surrounding environment, the charging pile does not meet the conditions for remote restart.

[0016] The status of the charging pile is determined according to the color features in the charging pile indicator light image. When there is a red indicator light, a restart is required.

[0017] The screen status of the charging pile is determined by the color of the set area in the screen image of the charging pile. When the screen area is blue, black, gray or other solid colors, the charging pile is in a faulty state and needs to be restarted.

[0018] When the charging pile is in a faulty state, at least two images of the charging pile screen are extracted according to the set period, and the screen is judged whether it is stuck according to the similarity of the images. Specifically:

[0019] When the number of different data bits between the two images exceeds the set value, the charging pile screen content is in an active and changing state, and no restart is required;

[0020] When the number of data bits that differ between the two images does not exceed the set value, the sampling period is increased to obtain the third group of charging pile screen images. When the number of data bits that differ between the third group of charging pile screen images and the second group of charging pile screen images still does not exceed the set value, it is determined that the screen is stuck and needs to be restarted.

[0021] The image acquisition module obtains the image information of the charging pile to form a video file stored in the NVR server, which is sent to the intelligent operation and maintenance platform through the edge IoT gateway. After the intelligent operation and maintenance platform determines that the charging pile is in an abnormal state and has the conditions for restarting, it sends a restart command to the charging pile through the remote measurement and control module.

[0022] A second aspect of the present invention provides a method for implementing remote control of a charging pile based on the above system, comprising the following steps:

[0023] Get the status information of the charging pile during operation;

[0024] Acquire the image information of the charging pile at the corresponding position according to the status information of the charging pile, determine that the charging pile is in an abnormal state and has restart conditions according to the image information, and issue a restart command to the charging pile;

[0025] The charging pile that receives the restart command restarts by powering off and then powering on.

[0026] Compared with the prior art, one or more of the above technical solutions have the following beneficial effects:

[0027] 1. When a charging pile is faulty and offline, the video surveillance file obtained by the corresponding image acquisition module is called, and the image information is extracted. By segmenting the image, the corresponding judgment logic is executed on the screen, indicator light, pile body and surrounding environment of the charging pile. After determining that the charging pile is in an abnormal state and has the conditions for restarting, a command is issued to power off and power on the charging pile to restart it, thereby realizing remote control of the charging pile. It can automatically solve simple faults that can be recovered by restarting without the need for operation and maintenance personnel to go to the site, thereby improving the operating efficiency of the charging pile.

[0028] 2. Image information is formed by extracting the monitoring video file of the charging pile site, and different areas in the image are divided based on image segmentation. Different areas execute different judgment logics to determine whether the current charging pile needs to be restarted. Since it is an image of a single target, the image structure is simple and can be implemented using existing mature algorithms, making remote control cost-effective.

[0029] 3. Remote control can help operation and maintenance personnel quickly identify some simple faults that only require a restart to restore the operation of the charging pile, thus eliminating the need for operation and maintenance personnel to go to the site to determine the fault, freeing up some manpower and improving the efficiency of charging pile operation and maintenance. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.

[0031] Figure 1 is a schematic diagram of a video screen structure provided by one or more embodiments of the present invention;

[0032] Figure 2 is a schematic diagram of a remote control process of a charging pile provided by one or more embodiments of the present invention;

[0033] Figure 3 It is a schematic diagram of the structure of a charging pile remote control system provided by one or more embodiments of the present invention. DETAILED DESCRIPTION

[0034] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0035] It should be noted that the following detailed descriptions are exemplary and are intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meanings as those commonly understood by those skilled in the art to which the present invention belongs.

[0036] The following embodiments provide a remote control method and system for a charging pile, which collects video information of the operation screen of the charging pile on site and divides the image in the video into regions. Different regions execute different judgment logics to determine whether the current charging pile needs to be restarted, and uses the open-in and open-out circuits pre-installed on the charging pile to perform a remote restart.

[0037] Embodiment 1:

[0038] like Figure 1-Figure 3 As shown, the charging pile remote control system includes:

[0039] The collection terminal obtains the status information of the charging pile during operation and sends it to the intelligent operation and maintenance platform;

[0040] The intelligent operation and maintenance platform obtains the image information of the charging pile based on the corresponding image acquisition module according to the status information obtained by the acquisition terminal, determines that the charging pile is in an abnormal state and has the conditions for restarting based on the screen content area, indicator light area, pile body area and surrounding environment area in the image, and issues a restart command to the charging pile;

[0041] The open-in and open-out circuit is installed on the charging pile, and receives the command sent by the intelligent operation and maintenance platform to control the restart of the charging pile by powering off and on.

[0042] Specific:

[0043] The image acquisition module (smart camera) collects video data from the charging pile site, the NVR server stores the video files, and the edge IoT switch sends the video files to the intelligent operation and maintenance platform.

[0044] The charging pile is equipped with an open-in and open-out circuit, an open-in circuit with remote signal transmission, and controls the restart of the charging pile by powering off and on.

[0045] The collection terminal is installed on the charging pile to collect various charging pile data on the charging pile, including charging, idle, fault, offline and other status values ​​to the intelligent operation and maintenance platform.

[0046] First, establish a running image library for the charging pile. Including: normal state, abnormal state, ... as a standard image set, and set and record the preset point configuration of the image acquisition module corresponding to each image generated, including the preset pan / tilt position and camera status. Each image in the charging pile standard image set corresponds to a camera preset point value.

[0047] The intelligent operation and maintenance platform receives video data uploaded by the edge IoT gateway within the station and status data uploaded by the acquisition terminal.

[0048] After receiving the device data, the intelligent operation and maintenance platform makes the following judgments:

[0049] When the charging device status value is charging and idle, the charging pile is marked as operating normally;

[0050] When the charging equipment status value is faulty or offline, the charging pile is marked as abnormal operation;

[0051] When the charging device fails to upload the device status data within the specified time, the charging pile is marked as operating abnormally.

[0052] When the charging device is operating abnormally, the preset point configuration information of the camera corresponding to the charging device is read, and the camera is remotely controlled to set the pan / tilt position value to the preset point configuration value corresponding to the charging device for video monitoring.

[0053] For video files uploaded by charging devices that are operating normally, frame extraction and image capture operations are performed at a scheduled time (usually every 30 minutes).

[0054] For video files uploaded by charging equipment that is operating abnormally, perform immediate frame extraction (usually every 60 seconds), capture image operations, and obtain a static image of the charging pile.

[0055] Perform image segmentation and content recognition on the static image of the charging pile, specifically:

[0056] like Figure 1 As shown, the image is segmented and partitioned, including the charging pile screen content area as the first static image, the charging pile indicator light content area as the second static image, the pile body content area as the third static image, and the surrounding environment content area as the fourth static image.

[0057] Image segmentation and partitioning method: After obtaining the image, the image is first processed by the image enhancement process to obtain the grayscale image of the image. Then the grayscale image is globally thresholded, and the noise particles are removed by morphological processing, the particles of interest are filled and the boundary particles are removed to obtain a binary image.

[0058] The image is segmented using the image region segmentation method to obtain the charging pile device image, and the remaining area of ​​the image is the surrounding environment content area, that is, the fourth static image. In the charging pile device image, the upper part is identified as the first static image containing the charging pile screen content area, the middle part of the image is identified as the second static image containing the charging pile indicator light content area, and the area below the middle is identified as the third static image containing the pile body content area.

[0059] After the image is cut into different areas, different image recognition and judgment algorithms are used for different areas to improve recognition speed and accuracy.

[0060] (1) A first static image including the charging pile screen content area and a fourth static image including the surrounding environment content area are used to recognize human features and adopt an image recognition algorithm of semantic segmentation. If a person is recognized in the image, it is considered that the charging pile may be operated by a user or an operation and maintenance personnel, that is, the charging pile is marked as not meeting the conditions for remote restart to avoid affecting the processing of the on-site operation and maintenance personnel or the operation of the charging user.

[0061] (2) The charging pile indicator light content area is the second static image. The color of the indicator light is used to identify whether the charging pile is normal and to determine the status of the charging pile. Specifically:

[0062] Using the OpenCV-Python algorithm, the segmented second static image is converted to the HSV color space and split into three HSV channels. Different saturation thresholds are set to erase all pixels below the threshold. Specific colors (red (red hue lower limit 150, upper limit 180), yellow (yellow hue lower limit 10, upper limit 60), green (green hue lower limit 70, upper limit 100)), and appropriate brightness range (brightness 120) can be used to obtain a mask suitable for the image. After processing with each color mask, the number of remaining non-empty pixels is counted. If there are still a large number of non-empty pixels in the remaining part of the image, it can be judged as an indicator light of the corresponding color.

[0063] If a red indicator light is detected, it means that the charging station is faulty and needs to be restarted.

[0064] (3) The charging pile screen content area is the first static image.

[0065] 1) Determine whether it is a blue screen, a black screen, or the screen is not lit, etc., by judging by the color of the screen area and various signs. The method is similar to the method for judging the indicator light content area. That is, image masks of different colors are established in turn, and the number of remaining non-empty pixels is counted to determine the color of the screen area. When the screen area is blue, black, gray or other pure colors, it is determined that the charging pile is in a fault state and needs to be restarted.

[0066] 2) By taking continuous screenshots (generally at an interval of 30 seconds, with the camera in the same preset position), the perceptual hash algorithm is used to calculate the similarity between the two images, and based on the similarity, it is determined whether the image content has changed, whether the screen is displayed but is actually stuck, etc.

[0067] In this embodiment, the video is framed and captured at intervals to obtain a screenshot. Figure 1 With cut Figure 2 First, cut Figure 1 With cut Figure 2 The image is uniformly reduced to 160*160 size, a total of 25600 pixels, to remove the size and ratio differences, and only retain the image structure, brightness and other information. The reduced image is converted to a 64-level grayscale image, and the grayscale average of all pixels is calculated. The grayscale value of each pixel is traversed in turn. If the value is greater than or equal to the grayscale average, it is recorded as 1, and if it is less than the grayscale average, it is recorded as 0. The result values ​​are combined together to obtain a 25600-bit binary number. That is, two binary numbers can be used to represent the truncation. Figure 1 With cut Figure 2 . Compare the two binary numbers bit by bit. If the number of bits that are different exceeds 6%, then the cutoff value is Figure 1 With cut Figure 2 If the number of different data does not exceed 6%, the screenshot is incorrect. Figure 1 With cut Figure 2 The difference is small, so you need to increase the time interval (change it to 120 minutes to take screenshots again, and the camera needs to be in the same preset position). Figure 3 With cut Figure 2 If the similarity is still high, it is determined that the screen is frozen and needs to be restarted.

[0068] 3) Compare with the historical fault images in the charging pile fault library, and use the learning-based perceptual similarity measurement algorithm to search whether there are fault images with high similarity in the charging pile fault library. If there are, it can be judged that a fault has occurred. If there is a fault, it needs to be restarted.

[0069] If the charging pile status requires restart, the intelligent operation and maintenance platform sends a restart command to the remote measurement and control module.

[0070] After receiving the restart command, the remote measurement and control module first communicates with the input and output module to verify the status of the charging pile. After determining that the charging pile is in a fault state and can be restarted, it sends a trip command of a switch quantity to the input and output circuit of the charging pile.

[0071] The charging pile opens and closes the circuit, cuts off the power and then powers on again to restart.

[0072] When the status information of the charging pile is used to determine that it is faulty and offline, the video file obtained by the corresponding camera is called from the platform according to the location of the charging pile. By segmenting the image in the video file, the corresponding judgment logic is executed on the screen, indicator light, pile body and surrounding environment of the charging pile. After determining that the charging pile is in an abnormal state and has the conditions for restarting, a command is issued to cut off the power and power on the charger to restart, thereby realizing remote control of the charging pile, automatically solving simple faults and improving operational efficiency.

[0073] Embodiment 2:

[0074] The charging pile remote control method comprises the following steps:

[0075] Get the status information of the charging pile during operation;

[0076] Acquire the image information of the charging pile at the corresponding position according to the status information of the charging pile, determine that the charging pile is in an abnormal state and has restart conditions according to the image information, and issue a restart command to the charging pile;

[0077] The charging pile that receives the restart command restarts by powering off and then powering on.

[0078] When a charging pile is faulty and offline, the corresponding image acquisition module is called to obtain the video surveillance file and extract the image information. By segmenting the image, the corresponding judgment logic is executed on the screen, indicator light, pile body and surrounding environment of the charging pile. After determining that the charging pile is in an abnormal state and has the conditions for restarting, a command is issued to cut off the power and restart the charging pile, thereby realizing remote control of the charging pile. It can automatically solve simple faults that can be recovered by restarting without the need for operation and maintenance personnel to be on site, thereby improving the operating efficiency of the charging pile.

[0079] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. Charging pile remote control system, characterized in that: include: The collection terminal obtains the status information of the charging pile during operation and sends it to the intelligent operation and maintenance platform; The intelligent operation and maintenance platform obtains the image information of the charging pile based on the corresponding image acquisition module according to the status information obtained by the acquisition terminal, determines that the charging pile is in an abnormal state and has the conditions for restarting based on the screen content area, indicator light area, pile body area and surrounding environment area in the image, and issues a restart command to the charging pile. When the charging pile operates abnormally, the video file is extracted according to the set period to obtain image information and form a static image; After preprocessing and image segmentation, the static image obtains a charging pile device image and a fourth static image containing the surrounding environment content area; in the charging pile device image, after image segmentation, a first static image containing the charging pile screen content area, a second static image containing the charging pile indicator light content area, and a third static image containing the pile body content area are obtained; for the first static image containing the charging pile screen content area and the fourth static image containing the surrounding environment content area, human feature recognition is used, and an image recognition algorithm for semantic segmentation is used to recognize that there is a person in the image, that is, the charging pile is marked as not meeting the remote restart condition; the charging pile indicator light content area is the second static image, and the color of the indicator light is used to identify whether the charging pile is normal, and the charging pile status is judged. The OpenCV-Python algorithm is used to convert the segmented second static image into the HSV color space, and split it into three HSV channels, and different saturation thresholds are set to erase all pixels below the threshold. Red uses a red hue lower limit of 150 and an upper limit of 180; For yellow, the lower limit of the yellow hue is 10 and the upper limit is 60; for green, the lower limit of the green hue is 70 and the upper limit is 100; and the lightness is 120 to obtain a mask suitable for the image; after processing with each color mask, the number of remaining non-empty pixels is counted. If there are still a large number of non-empty pixels in the remaining part of the image, it is determined to be an indicator light of the corresponding color. The color of the indicator light can be used to identify whether the charging pile is normal and determine the status of the charging pile; The open-in and open-out circuit is installed on the charging pile, and receives the command sent by the intelligent operation and maintenance platform to control the restart of the charging pile by powering off and on.

2. The charging pile remote control system according to claim 1, characterized in that: When the status information is charging and idle, the marker pile is operating normally; When the status information is faulty or offline, the mark pile is abnormal operation; If the status data is not uploaded within the set time, the pile is marked as abnormal operation.

3. The charging pile remote control system according to claim 1, characterized in that: The status of the charging pile is determined according to the color features in the charging pile indicator light image. When there is a red indicator light, a restart is required.

4. The charging pile remote control system according to claim 1, characterized in that: The screen status of the charging pile is determined by the color of the set area in the screen image of the charging pile. When the screen area is blue, black or gray, the charging pile is in a faulty state and needs to be restarted.

5. The charging pile remote control system according to claim 2, characterized in that: When the charging pile is in a faulty state, at least two images of the charging pile screen are extracted according to the set period, and the screen is judged whether it is stuck according to the similarity of the images. Specifically: When the number of different data bits between the two images exceeds the set value, the charging pile screen content is in an active and changing state, and no restart is required; When the number of data bits that differ between the two images does not exceed the set value, the sampling period is increased to obtain the third group of charging pile screen images. When the number of data bits that differ between the third group of charging pile screen images and the second group of charging pile screen images still does not exceed the set value, it is determined that the screen is stuck and needs to be restarted.

6. The charging pile remote control system according to claim 1, characterized in that: The image acquisition module obtains the image information of the charging pile to form a video file stored in the NVR server, which is sent to the intelligent operation and maintenance platform through the edge IoT gateway. After the intelligent operation and maintenance platform determines that the charging pile is in an abnormal state and has the conditions for restarting, it sends a restart command to the charging pile through the remote measurement and control module.

7. A method for implementing remote control of a charging pile based on the charging pile remote control system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Get the status information of the charging pile during operation; Acquire the image information of the charging pile at the corresponding position according to the status information of the charging pile, determine that the charging pile is in an abnormal state and has restart conditions according to the image information, and issue a restart instruction to the charging pile; The charging pile that receives the restart command restarts by powering off and then powering on.

Images