Vehicle, charging control method and device therefor, and storage medium

By automatically recognizing the charging station's QR code using the vehicle's camera and combining it with point cloud data, the problem of users manually scanning codes and brand-specific charging was solved, enabling automatic vehicle charging and improving intelligence and compatibility.

CN116001630BActive Publication Date: 2026-05-29ZHEJIANG ZEEKR INTELLIGENT TECH CO LTD +1

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
ZHEJIANG ZEEKR INTELLIGENT TECH CO LTD
Filing Date
2023-02-24
Publication Date
2026-05-29

AI Technical Summary

Technical Problem

In existing technologies, users need to manually scan a code or use a vehicle brand-specific charging method, resulting in a lack of intelligent charging operation and poor compatibility with public charging stations.

Method used

The system uses onboard cameras to automatically identify QR codes in images of charging stations, combines point cloud data to determine the location of the charging station, and verifies the QR code to enable automatic vehicle charging.

Benefits of technology

It enables automated charging of vehicles without increasing costs, covers most public charging stations, and improves user experience and intelligence.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116001630B_ABST
    Figure CN116001630B_ABST
Patent Text Reader

Abstract

The application discloses a vehicle, a charging control method and device thereof and a storage medium. After a charging port of the vehicle is connected with a charging gun of a charging pile, an image of the charging pile is acquired through a camera on the vehicle. A two-dimensional code of the charging pile is recognized to obtain a charging two-dimensional code. The charging two-dimensional code is verified, and charging of the vehicle is started after verification. The method can realize automatic starting of charging without a specially customized charging pile, can cover most public charging stations, and the camera of the vehicle is reused, so that the user experience is optimized and the intelligent level of the vehicle is improved without increasing the cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of vehicle charging technology, and in particular to a vehicle and its charging control method, charging control device, and storage medium. Background Technology

[0002] In scenarios where cars are charged at public charging stations, relevant technologies include: users plugging in the charging gun themselves and then confirming the charging operation by scanning a QR code using a charging application on their mobile phones; a very small number of OEM-customized charging piles can automatically match the vehicle's characteristic data (such as vehicle brand, VIN, etc.) based on the brand, and automatically start charging after successful verification (eliminating the need for QR code confirmation). However, these technologies suffer from the drawbacks of requiring user operation via mobile phone, lacking in intelligence, and having poor compatibility with public charging piles. Summary of the Invention

[0003] This invention aims to at least partially solve one of the technical problems in related technologies. Therefore, the object of this invention is to provide a vehicle and its charging control method, charging control device, and storage medium.

[0004] This method enables vehicles to automatically start charging, covering most public charging stations. Furthermore, it reuses the vehicle's own cameras, optimizing the user experience and enhancing the vehicle's intelligence level without increasing costs.

[0005] To achieve the above objectives, a first aspect of the present invention provides a vehicle charging control method, the method comprising: connecting the charging port of the vehicle to the charging gun of the charging pile, acquiring an image of the charging pile through a camera on the vehicle; performing QR code recognition on the charging pile image to obtain a charging QR code; verifying the charging QR code, and starting to charge the vehicle after successful verification.

[0006] In addition, the vehicle charging control method of the above embodiments of the present invention may also have the following additional technical features:

[0007] According to one embodiment of the present invention, the number of cameras is multiple, and the method further includes: acquiring point cloud data of the area surrounding the vehicle through radar on the vehicle; obtaining the location of a charging pile connected to the charging port of the vehicle based on the point cloud data; determining a target camera from the multiple cameras based on the location of the charging pile; wherein, acquiring the charging pile image through the camera on the vehicle includes: acquiring the charging pile image through the target camera.

[0008] According to one embodiment of the present invention, obtaining the location of the charging pile connected to the charging port of the vehicle based on the point cloud data includes: obtaining the location of the charging gun connection line based on the point cloud data; creating an image map of the charging gun connection line to the charging pile based on the location of the charging gun connection line; identifying the direction and area of ​​the charging pile relative to the vehicle from the image map to obtain the location of the charging pile.

[0009] According to an embodiment of the present invention, the step of obtaining a charging QR code by QR code recognition of the charging pile image includes: performing a segmentation process on the charging pile image to obtain multiple segmented images; performing a parsing on each of the segmented images once to obtain a segmented image containing a QR code, which is denoted as a target segmented image; performing a second parsing on each of the target segmented images in sequence, and using the QR code that is successfully parsed in the first second parsing as the charging QR code.

[0010] According to one embodiment of the present invention, the method further includes: after the charging QR code verification is successful, controlling the vehicle to issue a charging start success message; after the charging QR code verification fails, controlling the vehicle to issue a charging start failure message, wherein the charging start failure message includes a reason for failure.

[0011] According to one embodiment of the present invention, before the charging port of the vehicle is connected to the charging gun, the method further includes: receiving a voice command containing charging demand information; navigating the vehicle to a charging station in the charging demand information; identifying an available charging spot in the charging station; and parking the vehicle at an available charging spot in the charging station.

[0012] According to one embodiment of the present invention, the method further includes: receiving charging payment information sent by the charging pile after charging is completed; and paying the charging fee according to the charging payment information.

[0013] To achieve the above objectives, a second aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-described vehicle charging control method.

[0014] To achieve the above objectives, a third aspect of the present invention provides a vehicle charging control device, the device comprising: a charging controller, configured to trigger a camera on the vehicle to capture an image of the charging pile after determining that the charging port of the vehicle is connected to the charging gun of the charging pile; and a cockpit controller, connected to the camera, configured to perform QR code recognition on the charging pile image to obtain a charging QR code, verify the charging QR code, and send verification information to the charging pile after successful verification, so that the charging pile begins charging the vehicle.

[0015] To achieve the above objectives, a fourth aspect of the present invention provides a vehicle, including a camera and the aforementioned vehicle charging control device.

[0016] The vehicle, its charging control method, charging control device, and storage medium of this invention can realize the function of automatically starting the vehicle to charge, which can cover most of the current public charging stations. Furthermore, the method reuses the vehicle's own camera, which optimizes the user experience and improves the intelligence level of the vehicle without increasing costs. Attached Figure Description

[0017] Figure 1 This is a flowchart of a vehicle charging control method according to the first embodiment of the present invention;

[0018] Figure 2 This is a schematic diagram of a vehicle and a charging pile according to an embodiment of the present invention;

[0019] Figure 3 This is a flowchart of a vehicle charging control system according to an embodiment of the present invention;

[0020] Figure 4 This is a flowchart of a vehicle charging control method according to the second embodiment of the present invention;

[0021] Figure 5 This is a flowchart of a vehicle charging control method according to the third embodiment of the present invention;

[0022] Figure 6 This is a flowchart of a vehicle charging control method according to the fourth embodiment of the present invention;

[0023] Figure 7 This is a flowchart of a vehicle charging control method according to the fifth embodiment of the present invention;

[0024] Figure 8 This is a structural block diagram of a vehicle charging control device according to an embodiment of the present invention;

[0025] Figure 9 This is a structural block diagram of a vehicle according to an embodiment of the present invention. Detailed Implementation

[0026] Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.

[0027] The following description, with reference to the accompanying drawings, describes a vehicle and its charging control method, charging control device, and storage medium according to embodiments of the present invention.

[0028] Figure 1 This is a flowchart of a vehicle charging control method according to an embodiment of the present invention.

[0029] like Figure 1 As shown, the method includes:

[0030] S11: After the vehicle's charging port is connected to the charging gun of the charging station, the vehicle's camera captures an image of the charging station.

[0031] After the vehicle's charging port is connected to the charging gun of the charging station, the vehicle confirms whether the charging gun connection is normal. If it is normal, the process continues. If it is not normal, the vehicle can display images and text prompts and make a prompt sound on the cockpit screen.

[0032] S12, perform QR code recognition on the charging pile image to obtain the charging QR code.

[0033] Specifically, such as Figure 2 As shown, public charging stations affix corresponding charging QR code stickers in prominent locations on their physical surfaces. If the charging station has a screen, the charging QR code will be displayed on the screen after the charging gun is connected. The vehicle's camera then automatically recognizes and scans the QR code, which can be either the QR code on the sticker or the QR code on the screen. When both QR codes are present, the recognition process can stop upon recognizing either one, or it can recognize all QR codes in the image.

[0034] S13 verifies the charging QR code and begins charging the vehicle after successful verification.

[0035] In this embodiment, the vehicle's charging control system is as follows: Figure 3 As shown, after the charging gun is connected to the vehicle via a charging pile, the vehicle's charging management system recognizes the connection confirmation signal. At this time, the charging management system notifies the vision perception system and the cockpit controller. The vision perception system identifies the location of the charging pile (it can make a rough judgment based on the AC / DC type of the connected charging pile and the location of the charging port on the vehicle body, or it can be judged through point cloud data), and calls the corresponding camera to capture a high-definition image of the charging pile. After capturing the image, the vision perception system identifies the charging QR code information in the image. After successful identification, it transmits the data to the cockpit controller. The cockpit controller sends the charging QR code information to the cockpit charging application. The cockpit charging application parses the received charging QR code information and confirms the charging operation, and sends the confirmation signal to the charging pile management system via the network. The charging pile management system starts charging and synchronizes the data with the vehicle's charging management system during the charging process.

[0036] When multiple charging QR codes are detected, they can be verified one by one. Once any one of them is verified, charging will begin.

[0037] The vehicle charging control method of this invention can realize the function of automatic vehicle charging, can cover most of the current public charging stations, and reuse the vehicle's own camera. Without increasing costs, it optimizes the user experience and improves the intelligence level of the car.

[0038] In some embodiments, such as Figure 4 As shown, there are multiple cameras, and the method also includes:

[0039] S41 acquires point cloud data of the vehicle's surroundings using radar on the vehicle.

[0040] S42, based on point cloud data, determines the location of the charging station connected to the vehicle's charging port.

[0041] S43 identifies the target camera from multiple cameras based on the location of the charging station.

[0042] Among these, acquiring images of charging piles through cameras on the vehicle includes: acquiring images of charging piles through target cameras; the radar may include millimeter-wave radar, deployed around the vehicle.

[0043] Specifically, after connecting the charging gun of the charging station to the vehicle's charging port and confirming that the connection is normal, the above method is executed. When the radar acquires point cloud data around the vehicle, the area where the vehicle is connected to the charging gun is prioritized.

[0044] In some embodiments, such as Figure 5 As shown, the location of the charging station connected to the vehicle's charging port is obtained based on point cloud data, including:

[0045] S51, the location of the charging gun connection cable is obtained based on point cloud data.

[0046] S52, create an image map of the charging gun connection line to the charging pile based on the location of the charging gun connection line.

[0047] S53 identifies the direction and area of ​​the charging pile relative to the vehicle from the image and obtains the location of the charging pile.

[0048] Specifically, after executing the above method, the camera in the corresponding area of ​​the vehicle is activated according to the direction and area of ​​the confirmed charging pile location relative to the vehicle, and the overall image including the charging pile is obtained.

[0049] In some embodiments, such as Figure 6 As shown, the charging QR code is obtained by performing QR code recognition on the charging pile image, including:

[0050] S61, the charging pile image is divided into multiple grid images.

[0051] S62, each grid cell is parsed once to obtain a grid cell containing the QR code, which is denoted as the target grid cell.

[0052] Specifically, each segment of the image is parsed for QR codes, and the target segment contains all the QR codes in the charging pile image.

[0053] S63, perform secondary analysis on each target grid image in sequence, and use the QR code that is successfully analyzed for the first time as the charging QR code.

[0054] Specifically, the secondary parsing process of the cabin charging application may include: the program establishes a queue in the storage space, stores each target grid image into the queue, the program sequentially parses the target grid images obtained from the queue using QR codes, uses the QR code that is successfully parsed for the first time as the charging QR code, and then releases the storage space.

[0055] In some embodiments, the method further includes:

[0056] After the charging QR code verification is successful, the vehicle is controlled to send a charging start success message; if the charging QR code verification fails, the vehicle is controlled to send a charging start failure message, which includes the reason for the failure.

[0057] In some embodiments, such as Figure 7 As shown, the method further includes: before connecting the vehicle's charging port to the charging gun, the method further includes:

[0058] S71 receives voice commands containing charging demand information.

[0059] S72 will navigate the vehicle to a charging station listed in the charging demand information.

[0060] S73 identifies available charging spots in charging stations and parks the vehicle in an available charging spot at the charging station.

[0061] In some embodiments, the method further includes: receiving charging payment information sent by the charging pile after charging is completed; and paying the charging fee according to the charging payment information.

[0062] In this embodiment, the user can spend most of the time waiting inside the vehicle during the charging process. When the vehicle needs charging, the user can automatically trigger the in-vehicle navigation function by searching and selecting a charging station via voice commands. After arriving at the charging station according to the navigation, the user parks the car in an available charging spot, gets out of the car, selects a charging station, connects the charging gun to the car, and can then leave or return to the car to rest. At this time, the vehicle automatically identifies the charging station and the charging QR code on the charging station using the aforementioned charging control method. After successful identification, the charging operation is parsed and confirmed through the charging application installed in the cabin. After receiving the confirmation signal from the charging application in the cabin, the charging station begins charging. After charging is completed, if the charging application in the cabin has been set up with an automatic payment function, the payment will be completed automatically.

[0063] In summary, the vehicle charging control method of this invention determines the direction of the charging pile through point cloud data and activates the camera in that direction to identify the QR code, and starts charging the vehicle after verifying the QR code. This method can realize the function of automatically starting the vehicle to charge, can cover most of the current public charging stations, and reuses the vehicle's own camera, thus optimizing the user experience and improving the intelligence level of the car without increasing costs.

[0064] Based on the vehicle charging control method of the above embodiments, the present invention also proposes a computer-readable storage medium.

[0065] In this embodiment, a computer program is stored on a computer-readable storage medium, and when the computer program is executed by a processor, it implements the above-described vehicle charging control method.

[0066] Figure 8 This is a structural block diagram of a vehicle charging control device according to an embodiment of the present invention.

[0067] like Figure 8 As shown, the vehicle's charging control device 800 includes:

[0068] The charging controller 801 is used to trigger the camera 802 on the vehicle to capture images of the charging pile after determining that the charging port of the vehicle is connected to the charging gun of the charging pile.

[0069] The cockpit controller 803, connected to the camera 802, is used to recognize the QR code in the image of the charging pile, obtain the charging QR code, verify the charging QR code, and send the verification information to the charging pile after successful verification so that the charging pile can start charging the vehicle.

[0070] Figure 9 This is a structural block diagram of a vehicle according to an embodiment of the present invention.

[0071] like Figure 9As shown, vehicle 900 includes camera 802 and the aforementioned vehicle charging control device 800.

[0072] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0073] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," and "circumferential" indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0074] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0075] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise explicitly limited. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0076] In this invention, unless otherwise explicitly specified and limited, "above" or "below" the second feature can mean that the first feature is in direct contact with the second feature, or that the first feature is in indirect contact with the second feature through an intermediate medium. Furthermore, "above," "over," and "on top" of the second feature can mean that the first feature is directly above or diagonally above the second feature, or simply that the first feature is at a higher horizontal level than the second feature. "Below," "below," and "under" the second feature can mean that the first feature is directly below or diagonally below the second feature, or simply that the first feature is at a lower horizontal level than the second feature.

[0077] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A charging control method for a vehicle, characterized in that, The method includes: After the vehicle's charging port is connected to the charging gun of the charging station, the image of the charging station is acquired through the camera on the vehicle. The charging pile image is subjected to QR code recognition to obtain a charging QR code; Verify the charging QR code, and start charging the vehicle after successful verification; The number of cameras is multiple, and the method further includes: Point cloud data of the area surrounding the vehicle is acquired using radar on the vehicle. The location of the charging pile connected to the vehicle's charging port is obtained based on the point cloud data. The target camera is determined from among the multiple cameras based on the location of the charging pile; Wherein, acquiring the charging pile image through the camera on the vehicle includes: acquiring the charging pile image through the target camera; The step of determining the location of the charging pile connected to the vehicle's charging port based on the point cloud data includes: The location of the charging gun connection cable is obtained based on the point cloud data; Create an image of the charging gun connection line to the charging pile based on the location of the charging gun connection line; The location of the charging pile is obtained by identifying the direction and area of ​​the charging pile relative to the vehicle from the imaging image.

2. The vehicle charging control method according to claim 1, characterized in that, The step of obtaining a charging QR code by performing QR code recognition on the charging pile image includes: The charging pile image is divided into multiple grid images. Each of the aforementioned grid images is parsed once to obtain a grid image containing a QR code, which is denoted as the target grid image; Each target grid image is parsed twice in sequence, and the QR code that is successfully parsed the first time is used as the charging QR code.

3. The vehicle charging control method according to claim 1, characterized in that, The method further includes: After the charging QR code is verified, the vehicle is controlled to send a charging start success message. After the charging QR code verification fails, the vehicle is controlled to issue a charging start failure message, which includes the reason for the failure.

4. The vehicle charging control method according to claim 1, characterized in that, Before the vehicle's charging port is connected to the charging gun, the method further includes: Receive voice commands containing charging requirements; Navigate the vehicle to the charging station listed in the charging demand information; Identify available charging spots in the charging station and park the vehicle at an available charging spot in the charging station.

5. The vehicle charging control method according to claim 1, characterized in that, The method further includes: After charging is complete, receive the charging payment information sent by the charging pile; Pay the charging fee according to the charging payment information.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the charging control method for the vehicle according to any one of claims 1-5.

7. A vehicle charging control device, characterized in that, The device includes: A charging controller is used to trigger the camera on the vehicle to capture images of the charging pile after determining that the charging port of the vehicle is connected to the charging gun of the charging pile. The cockpit controller, connected to the camera, is used to recognize the QR code in the image of the charging pile, obtain the charging QR code, verify the charging QR code, and send the verification information to the charging pile after successful verification so that the charging pile can start charging the vehicle. The number of cameras is multiple, and the method includes: Point cloud data of the area surrounding the vehicle is acquired using radar on the vehicle. The location of the charging pile connected to the vehicle's charging port is obtained based on the point cloud data. The target camera is determined from among the multiple cameras based on the location of the charging pile; Wherein, acquiring the charging pile image through the camera on the vehicle includes: acquiring the charging pile image through the target camera; The step of determining the location of the charging pile connected to the vehicle's charging port based on the point cloud data includes: The location of the charging gun connection cable is obtained based on the point cloud data; Create an image of the charging gun connection line to the charging pile based on the location of the charging gun connection line; The location of the charging pile is obtained by identifying the direction and area of ​​the charging pile relative to the vehicle from the imaging image.

8. A vehicle, characterized in that, include: The camera and the charging control device for the vehicle according to claim 7.