Implementation method and equipment for vehicle charging, medium and program product
By using augmented reality technology to acquire and display charging station information, the problems of unintuitive charging station navigation and cumbersome operation have been solved, enabling an efficient and convenient vehicle charging process.
Patent Information
- Application Number
- CN202511502512.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-21
- Publication Date
- 2026-01-27
AI Technical Summary
Existing vehicle charging methods suffer from unintuitive charging station navigation and cumbersome operation processes, resulting in low charging efficiency and negatively impacting user experience.
By acquiring environmental images and location information through augmented reality terminals, augmented reality navigation images are generated to guide users to charging stations, and the status of charging stations is displayed in the environmental images, simplifying the operation process and enabling vehicle charging.
It improves the intuitiveness of charging station navigation and charging efficiency, simplifies the operation process, and enhances the user experience.
Smart Images

Figure CN121404064A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of computer technology, and in particular to a method, device, medium, and program product for implementing vehicle charging. Background Technology
[0002] With the increasing popularity of new energy vehicles, the number of public charging stations and charging facilities in industrial parks has surged. Improving vehicle charging efficiency is of great significance for enhancing user experience.
[0003] Currently, existing methods for vehicle charging typically require users to locate charging stations via mobile apps or in-vehicle navigation systems. Even after reaching the general location, time is still needed to find the specific charging station. During the charging initiation phase, users need to get out of the vehicle to read the charging station's instructions and verify their identity by scanning a QR code or swiping a card. Existing technologies suffer from unintuitive station location navigation and cumbersome procedures, resulting in low charging efficiency and severely impacting user experience. Summary of the Invention
[0004] This invention provides a method, device, medium, and program product for vehicle charging, which can improve the intuitiveness of charging station navigation, simplify the operation process, improve the efficiency of vehicle charging, and enhance the user experience.
[0005] According to one aspect of the present invention, a method for implementing vehicle charging is provided, comprising:
[0006] The system uses augmented reality to obtain images of the current environment and current location information, and then identifies the target charging station.
[0007] Based on the current environmental image, current location information, and the installation location information of the target charging station, an augmented reality navigation image is generated, and the augmented reality navigation image is displayed to the user through the augmented reality terminal to guide the user to the target charging station;
[0008] If the target charging pile is detected in the current environment image, a virtual charging pile status identifier is generated based on the status information of the target charging pile, and an augmented reality status image is generated based on the current environment image and the virtual charging pile status identifier. The augmented reality status image is then displayed to the user through the augmented reality terminal.
[0009] When the augmented reality terminal detects that the user has started charging the vehicle, it controls the target charging station to charge the vehicle.
[0010] According to another aspect of the present invention, a vehicle charging implementation apparatus is provided, comprising:
[0011] The target charging station acquisition module is used to acquire the current environment image and current location information through the augmented reality terminal, and to acquire the target charging station;
[0012] The augmented reality navigation image generation module is used to generate an augmented reality navigation image based on the current environment image, current location information and the installation location information of the target charging pile, and to display the augmented reality navigation image to the user through the augmented reality terminal to guide the user to the target charging pile;
[0013] An augmented reality status image generation module is used to generate a virtual charging pile status identifier based on the status information of the target charging pile if the target charging pile is detected in the current environment image, and to generate an augmented reality status image based on the current environment image and the virtual charging pile status identifier, and to display the augmented reality status image to the user through the augmented reality terminal.
[0014] The vehicle charging control module is used to control the target charging pile to charge the vehicle when the augmented reality terminal detects that the user has started the vehicle charging operation.
[0015] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:
[0016] At least one processor; and
[0017] A memory communicatively connected to the at least one processor; wherein,
[0018] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the vehicle charging implementation method according to any embodiment of the present invention.
[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing a computer program configured to cause a processor to execute and implement the vehicle charging method according to any embodiment of the present invention.
[0020] According to another aspect of the present invention, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the vehicle charging method described in any embodiment of the present invention.
[0021] The technical solution of this invention involves acquiring the current environmental image and current location information through an augmented reality terminal, and then identifying the target charging pile. Based on the current environmental image, current location information, and the installation location information of the target charging pile, an augmented reality navigation image is generated and displayed to the user through the augmented reality terminal to guide the user to the target charging pile. If the target charging pile is detected in the current environmental image, a virtual charging pile status identifier is generated based on the target charging pile's status information. An augmented reality status image is then generated based on the current environmental image and the virtual charging pile status identifier, and displayed to the user through the augmented reality terminal. When the user's vehicle charging start operation is detected through the augmented reality terminal, the target charging pile is controlled to begin charging the vehicle. By introducing an augmented reality terminal and augmented reality technology, the intuitiveness of charging pile navigation can be improved, the operation process can be simplified, the vehicle charging efficiency can be improved, and the user experience can be enhanced.
[0022] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description
[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This is a schematic diagram of the architecture of a vehicle charging system provided by the present invention;
[0025] Figure 2 This is a flowchart of a vehicle charging implementation method according to Embodiment 1 of the present invention;
[0026] Figure 3 This is a flowchart of a vehicle charging implementation method according to Embodiment 2 of the present invention;
[0027] Figure 4 This is a schematic diagram of a status display interface provided according to Embodiment 2 of the present invention;
[0028] Figure 5 This is a schematic diagram of a vehicle charging implementation device according to Embodiment 3 of the present invention;
[0029] Figure 6 This is a schematic diagram of the structure of an electronic device that implements the vehicle charging method of the present invention. Detailed Implementation
[0030] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.
[0031] It should be noted that the terms "first," "second," "modification," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0032] To facilitate understanding of the technical solution of this invention, the vehicle charging system upon which the vehicle charging implementation method provided by this invention is based is first introduced. The architecture of the vehicle charging system can be as follows: Figure 1 As shown, the system includes an Augmented Reality (AR) terminal, a cloud platform, and charging piles / charging terminals. The AR terminal and charging piles are respectively connected to the cloud platform. The AR terminal can be AR glasses, smartphones, etc., equipped with AR applications. It is mainly used to initiate charging pile / charging requests, capture real-time video streams, send interactive commands (such as gestures, voice, eye tracking, etc.), present an AR navigation interface, and receive and overlay virtual information (such as paths, interfaces, status, advertisements, etc.).
[0033] The cloud platform comprises an AR service engine, a charging management platform, and a big data and algorithm platform. The AR service engine can invoke the charging management platform and the big data and algorithm platform to perform AR demonstrations and make charging decisions. Typically, the AR service engine can request charging strategies and report status from the charging management platform. The charging management platform can query the charging pile / charging terminal's status, issue control commands, and issue commands to start / stop charging and reduce power. Simultaneously, it can push orders and user profiles to the big data and algorithm platform. Charging piles / charging terminals can upload heart rate, status, and charging data to the charging management platform in real time. The big data and algorithm platform can return ordered charging strategies to the charging management platform and navigation and service strategies to the AR service engine. The big data and algorithm platform can include pre-trained deep learning models for charging pile identification, service recommendation, etc.
[0034] Example 1
[0035] Figure 2 This is a flowchart illustrating a vehicle charging implementation method according to Embodiment 1 of the present invention. This embodiment is applicable to situations where vehicle charging control is achieved through interaction between a cloud platform and an augmented reality terminal. The method can be executed by a vehicle charging implementation device, which can be implemented in hardware and / or software. Typically, this vehicle charging implementation device can be configured in an electronic device, such as a computer or server. Figure 2 As shown, the method includes:
[0036] S110. Obtain the current environment image and current location information through the augmented reality terminal, and obtain the target charging pile.
[0037] It should be noted that, in this embodiment, the information collected is information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data all comply with the relevant laws, regulations and standards of the relevant countries and regions, necessary confidentiality measures have been taken, and they do not violate public order and good morals. Corresponding operation entry points are provided for users to choose to authorize or refuse.
[0038] In this embodiment, when a user needs to charge a new energy vehicle, they can first initiate a charging station search request to the cloud platform through the vehicle's infotainment system or mobile app, then activate the AR terminal, open the camera, and establish a communication connection between the AR terminal and the cloud platform. After establishing the communication connection, the AR terminal can capture real-time environmental images through the camera and obtain the terminal's real-time location information through the GPS module and Bluetooth / UWB positioning module, and then send the real-time environmental images and real-time location information to the cloud platform.
[0039] After receiving a charging station search request, along with the current environment image and location information sent by the AR terminal, the cloud platform can calculate the distance between the AR terminal and each charging station based on the current location information and the pre-stored installation location information of each charging station. Based on the calculated distance, it then filters charging stations within a preset distance range as target charging stations and records their feature codes or identifiers. Optionally, when multiple qualified charging stations exist, the AR terminal can simultaneously provide information on multiple charging stations to the user, allowing the user to select the final target charging station.
[0040] Optionally, acquiring the target charging station may include:
[0041] Obtain the installation location information of each initial charging pile, and obtain each candidate charging pile based on the current location information and the installation location information of each initial charging pile;
[0042] Obtain the status information of each of the candidate charging piles, and based on the status information of each of the candidate charging piles, obtain the target charging pile from among the candidate charging piles.
[0043] In an optional example, when determining the target charging station, the cloud platform first reads the pre-stored installation location information of each initial charging station from a designated database, and calculates the distance between the AR terminal and each initial charging station based on the current location information and the installation location information of each initial charging station. Then, initial charging stations whose distance to the AR terminal is less than or equal to a preset distance threshold are identified as candidate charging stations, and the status information of each candidate charging station is retrieved. Further, the parameter values corresponding to each preset parameter item are extracted from the status information, and based on the extracted parameter values and the correspondence between preset parameter ranges and weight values, the weight value matching each preset parameter item for each candidate charging station is obtained. Finally, the weight values matching each preset parameter item can be directly added or weighted summed to obtain the sum as the score for the candidate charging station, and the candidate charging station with the highest score is selected as the final target charging station. Preset parameter items may include availability, charging power, electricity price, etc.
[0044] The benefits of the above settings are that they can improve the availability and cost-effectiveness of the target charging stations and further enhance the user experience.
[0045] S120. Based on the current environment image, current location information, and installation location information of the target charging pile, generate an augmented reality navigation image, and display the augmented reality navigation image to the user through the augmented reality terminal to guide the user to the target charging pile.
[0046] In this embodiment, the cloud platform can autonomously plan a navigation path based on the current location information and the installation location information of the target charging station using synchronous positioning and mapping technology. Based on the planned navigation path and the real-time location information of the AR terminal, it generates a virtual real-time navigation path arrow. Then, the cloud platform can overlay the virtual real-time navigation path arrow onto a real-time environmental image to generate a real-time AR navigation image. Finally, the cloud platform can send the AR navigation image to the AR terminal, which then visualizes it on its screen. Users can then directly reach the target charging station guided by the AR navigation image.
[0047] Optionally, an augmented reality navigation image can be generated based on the current environmental image, current location information, and the installation location information of the target charging station. This may include:
[0048] Based on the current location information and the installation location information of the target charging pile, a virtual navigation landmark is generated, and based on the current environmental image and the virtual navigation landmark, the augmented reality navigation image is generated.
[0049] In one optional example, the cloud platform can automatically plan a navigation path based on the current location information, the installation location information of the target charging station, and map information, and then model and render the navigation path to obtain virtual navigation landmarks. Alternatively, it can generate navigation arrows based on the planned navigation path and the real-time location information of the AR terminal, and then model and render these navigation arrows to obtain virtual navigation landmarks. Finally, the current environment image can be overlaid with the virtual navigation landmarks to generate an AR navigation image.
[0050] It should be noted that traditional 2D map navigation can only guide users to a general area and cannot provide visual guidance for the "last mile." Users still find it difficult to quickly and accurately locate the target charging station in complex parking environments, especially in unfamiliar locations. The solution in this embodiment can provide users with intuitive and real-time visual navigation, achieving seamless guidance from the parking space to the charging station.
[0051] S130. If the target charging pile is detected in the current environment image, a virtual charging pile status identifier is generated based on the status information of the target charging pile, and an augmented reality status image is generated based on the current environment image and the virtual charging pile status identifier. The augmented reality status image is then displayed to the user through the augmented reality terminal.
[0052] In this embodiment, if the cloud platform identifies a charging pile in the current environmental image, it can further extract the charging pile's feature code or identifier from the current environmental image and perform a matching detection with the recorded feature code or identifier of the target charging pile to determine whether the current charging pile is the target charging pile. If a successful match is detected, it can be determined that the target charging pile has been successfully detected, indicating that the user has successfully arrived at the target charging pile. Then, the cloud platform can query the status of the target charging pile to obtain real-time status information, such as idle, occupied, faulty, power, electricity price, etc., and generate a virtual charging pile status identifier corresponding to the status information. This virtual charging pile status identifier is then superimposed onto the current environmental image (e.g., on the charging pile screen or in the adjacent virtual space) to generate an AR status image. Finally, the AR status image can be sent to an AR terminal for visualization on its screen.
[0053] In this embodiment, 3D modeling and rendering technology can be used to generate corresponding virtual identifiers, such as models and animations. Furthermore, this embodiment does not impose specific limitations on the method of overlaying the real environment with the virtual identifiers. For example, the virtual identifiers can be projected directly onto the user's eyes via an AR terminal to achieve visual fusion with the real world.
[0054] Optionally, in this embodiment, when overlaying the virtual charging pile status indicator onto the current environmental image, a virtual control interface can also be generated and overlaid onto the current environmental image to generate the final AR status image. Users can control the target charging pile to start, pause, and stop vehicle charging through the virtual control interface.
[0055] S140. When the augmented reality terminal detects that the user has started charging the vehicle, it controls the target charging pile to charge the vehicle.
[0056] In this embodiment, after connecting the vehicle to the target charging station, the user can interact with the AR interface of the AR terminal through gesture recognition, eye tracking, or voice commands to complete the vehicle charging start operation. The vehicle charging start operation may include scanning a code for authentication, starting charging, and setting the charging amount. The AR terminal can generate a corresponding charging request based on the user's vehicle charging start operation and send it to the cloud platform.
[0057] When the cloud platform detects a charging request from an AR terminal, it can automatically control the target charging station to start charging the vehicle. During this process, the user can control the charging without touching their phone or the charging station screen.
[0058] It should be noted that in existing technologies, users need to get out of the vehicle to read the operating instructions, manually scan the code, and enter the amount, which is not a very intelligent process, especially in inclement weather such as rain or snow, resulting in a poor user experience. Furthermore, the charging station screens are mostly at a fixed angle and height, leading to a poor human-computer interaction experience. The solution in this embodiment simplifies the charging operation process by utilizing an AR interface, achieving convenient "what you see is what you control" interaction. Users can directly complete operations such as scanning codes, starting the system, and setting up through the AR interface.
[0059] The technical solution of this invention involves acquiring the current environmental image and current location information through an augmented reality terminal, and then identifying the target charging pile. Based on the current environmental image, current location information, and the installation location information of the target charging pile, an augmented reality navigation image is generated and displayed to the user through the augmented reality terminal to guide the user to the target charging pile. If the target charging pile is detected in the current environmental image, a virtual charging pile status identifier is generated based on the target charging pile's status information. An augmented reality status image is then generated based on the current environmental image and the virtual charging pile status identifier, and displayed to the user through the augmented reality terminal. When the user's vehicle charging start operation is detected through the augmented reality terminal, the target charging pile is controlled to begin charging the vehicle. By introducing an augmented reality terminal and augmented reality technology, the intuitiveness of charging pile navigation can be improved, the operation process can be simplified, the vehicle charging efficiency can be improved, and the user experience can be enhanced.
[0060] Example 2
[0061] Figure 3 This is a flowchart illustrating a vehicle charging method according to Embodiment 2 of the present invention. This embodiment is a further refinement of the above technical solution, and the technical solution in this embodiment can be combined with one or more of the above implementation methods. Figure 3 As shown, the method includes:
[0062] S210. Obtain the current environment image and current location information through the augmented reality terminal, and obtain the target charging pile.
[0063] S220. Based on the current environmental image, current location information, and installation location information of the target charging pile, generate an augmented reality navigation image, and display the augmented reality navigation image to the user through the augmented reality terminal to guide the user to the target charging pile.
[0064] S230. If the target charging pile is detected in the current environment image, a virtual charging pile indicator is generated, and an augmented reality charging pile indicator image is generated based on the current environment image and the virtual charging pile indicator. The augmented reality charging pile indicator image is then displayed to the user through the augmented reality terminal.
[0065] In this embodiment, when a target charging station is successfully identified in the current environmental image—that is, when the target charging station enters the user's line of sight—the cloud platform can generate a virtual charging station indicator, such as a highlighted 3D arrow. Then, the virtual charging station indicator can be overlaid on top of the target charging station in the current environmental image to generate an AR charging station indicator image. Finally, this AR charging station indicator image can be visualized on the AR terminal's screen to guide the user in finding the charging station.
[0066] S240. Based on the status information of the target charging pile, generate a virtual charging pile status identifier, and based on the current environment image and the virtual charging pile status identifier, generate an augmented reality status image, and display the augmented reality status image to the user through the augmented reality terminal.
[0067] S250. When the augmented reality terminal detects that the user has started charging the vehicle, it controls the target charging pile to charge the vehicle.
[0068] S260. Obtain charging status information and generate a virtual charging status identifier based on the charging status information.
[0069] In this embodiment, after vehicle charging starts, the cloud platform can continuously query the real-time charging status information of the target charging pile, such as battery level, remaining time, and cost, and convert the charging status information into virtual visualization elements through the AR service engine, such as a progress bar surrounding the charging pile, a floating battery icon, and a percentage, as a virtual charging status identifier.
[0070] S270. Based on the current environment image and the virtual charging status identifier, generate an augmented reality charging status image, and display the augmented reality charging status image to the user through the augmented reality terminal.
[0071] Specifically, the cloud platform can overlay a virtual charging status indicator onto the target charging station in the current environmental image to generate an AR charging status image, which is then sent to the AR terminal for user display. For example, the AR terminal's status display interface could be as follows: Figure 4 As shown, real-world charging piles are recognized by AR terminals and overlaid with virtual information layers. The virtual information layers include interactive guidance, virtual operation buttons, status information panels, charging progress, and other virtual information. Interactive guidance includes gesture operation prompts, virtual operation buttons include pause charging, end charging, etc., status information panels include pile number, status, battery level, estimated remaining time, current rate, and amount charged, and charging progress includes a circular progress bar.
[0072] In existing technologies, charging status and cost information mainly rely on users actively viewing software or the charging station screen, lacking proactive and immersive status notifications. Users cannot grasp the entire charging process in real time and intuitively, resulting in a lag in information perception. This embodiment provides users with an immersive status perception experience by virtually overlaying key information such as charging status and cost onto the real charging station in real time.
[0073] Optionally, after controlling the target charging station to charge the vehicle, the process may further include:
[0074] Obtain historical user profiles and generate recommendation service information based on the historical user profiles and current location information;
[0075] Based on the recommended service information, a virtual recommended service identifier is generated, and based on the current environment image and the virtual recommended service identifier, an augmented reality recommended service image is generated, which is then displayed to the user through the augmented reality terminal.
[0076] In this embodiment, after the vehicle charging starts, the cloud platform can also read historical user profiles from a designated database, including features such as service preferences, user behavior, and channel information. These historical user profiles are generated by extracting features from basic user information and historical user behavior. Then, based on the current location information and the location information of each service, candidate services within a preset distance range can be selected. Furthermore, based on the historical user profiles, target services that match the user's preferences can be selected from these candidate services, and the corresponding attribute information of the target service, such as service type, distance, and discount information, can be obtained as recommended service information. For example, recommended service information could be something like, "A coffee shop 50 meters ahead, enjoy 20% off with your charging order."
[0077] Furthermore, the cloud platform can convert recommendation service information into virtual recommendation service identifiers, such as virtual billboards or landmarks, and overlay these identifiers onto the current environment image to generate AR recommendation service images. Finally, the cloud platform can send these AR recommendation service images to AR terminals for visualization. Users can click on the virtual recommendation service identifiers to view details or navigate with a single click.
[0078] In existing technologies, information screens can only passively display content, lacking interactivity and unable to provide personalized services based on user preferences, thus failing to effectively improve the user experience during waiting periods. This embodiment, by integrating AR with platform data, pushes and overlays personalized service information (such as restaurants, rest areas, coupons, etc.) to users while they are waiting for charging, transforming passive waiting into active exploration and improving the user experience.
[0079] Optionally, after controlling the target charging station to charge the vehicle, the process may further include:
[0080] When the charging status information is detected to meet the preset stop conditions, a virtual charging completion indicator and a virtual payment guidance indicator are generated.
[0081] Based on the current environment image, the virtual charging completion icon, and the virtual payment guidance icon, an augmented reality charging completion image is generated, and the augmented reality charging completion image is displayed to the user through the augmented reality terminal.
[0082] If the augmented reality terminal detects a user's payment confirmation, it controls the target charging station to stop charging the vehicle.
[0083] The preset stop conditions can be pre-defined conditions for notifying the user when charging is complete, such as charging is about to finish or charging is complete. In an optional example, if the cloud platform detects that charging is about to finish or has finished based on the charging status information, it can generate a virtual charging completion icon and a virtual payment guidance icon. These icons are then overlaid onto the current environment image to generate an AR charging completion image. The AR terminal then visualizes this image, guiding the user to complete AR seamless payment or end the order with a single click using a pre-linked payment method. When the AR terminal detects the user's payment confirmation, it can send a stop charging request to the cloud platform. Based on this request, the cloud platform controls the target charging station to stop charging the vehicle. Optionally, after charging is complete, the cloud platform can also provide return route navigation via the AR terminal to guide the user back to the starting point or the parking lot exit.
[0084] The advantages of the above settings are that they can promptly push notifications of charging completion and payment information, simplify the payment process, and improve vehicle charging efficiency.
[0085] The technical solution of this invention, if a target charging pile is detected in the current environmental image, generates a virtual charging pile indicator, and generates an augmented reality charging pile indicator image based on the current environmental image and the virtual charging pile indicator. This augmented reality charging pile indicator image is then displayed to the user via an augmented reality terminal. By overlaying virtual indicators onto the real charging pile, full-process charging pile navigation can be achieved, improving the user's success rate in finding the charging pile. Charging status information is acquired, and a virtual charging status indicator is generated based on this information. An augmented reality charging status image is then generated based on the current environmental image and the virtual charging status indicator, and displayed to the user via an augmented reality terminal. Through proactive charging status push notifications, users can obtain real-time and intuitive charging progress information, further enhancing the user experience.
[0086] In one specific implementation of this embodiment, the entire charging process from finding a charging station to ending the charging session can include: First, the user initiates a charging station search request, and the cloud platform allocates a charging station and generates navigation data. Then, the AR terminal activates its camera to capture real-time environmental footage. If the target charging station is successfully identified in the real-time environmental footage, a real-time navigation path and a highlighted marker are overlaid on the AR interface to guide the user. Furthermore, if the user arrives at the target charging station and the AR interface successfully identifies the station, a virtual operation panel, such as status, rate, and operation buttons, is overlaid on the AR interface. If the user confirms the start of charging via gestures, voice, or other means, the cloud platform sends a start command to the target charging station to control the target charging station to begin supplying power.
[0087] Next, the charging monitoring cycle begins. The charging pile uploads real-time status data to the cloud platform, which then pushes the data to the AR terminal, updating the AR interface's status, such as progress bars, battery level, and amount. When it detects the need to push nearby value-added services, the AR interface overlays virtual information such as coupons and service navigation. The cloud platform determines whether the charging is nearing completion or has been interrupted by the user based on the charging status. If so, it sends a notification that the charging is about to complete, prompts the AR interface for confirmation, and executes contactless payment or one-click payment via the AR interface. After payment is completed, the cloud platform controls the charging pile to stop supplying power and generates an order invoice. Finally, the AR interface provides return navigation, and the user leaves after charging is complete.
[0088] This embodiment employs a deep coupling of cloud platform and AR, going beyond simple AR display. It deeply integrates real-time data from the charging management platform (such as charging station location, status, orders, and service information) with the dynamic rendering capabilities of the AR service engine, creating a completely new dimension of information presentation and interaction. It utilizes environment-understanding-based AR registration and display, leveraging computer vision, real-time positioning, and mapping technologies to accurately and stably "register" virtual information (such as navigation arrows, user interfaces, and status prompts) into the real-world charging stations and environment, achieving seamless integration of virtual and reality. Employing multimodal interaction, it breaks through the traditional touch-based interaction modes of mobile software or charging station screens, combining gestures, voice, eye tracking, and other methods for natural interaction with the AR interface, greatly enhancing the convenience and enjoyment of operation. By pushing scenario-based value-added services, it transforms charging wait time into business opportunities, using the highly attractive AR method to achieve online and offline service traffic redirection and closed-loop, constructing a new "charging + service" ecosystem.
[0089] Compared to existing technologies, this invention offers an exceptional charging station locator experience, reducing search time from minutes to seconds, significantly lowering user search costs and anxiety, especially in large, complex parking lots. Secondly, its revolutionary human-computer interaction simplifies the charging process, enabling convenient "anywhere you look, you can operate" operation, improving interaction efficiency and technological sophistication while reducing learning costs. Furthermore, it provides immersive status awareness, transforming abstract charging data into intuitive visual elements, making the charging process clearer and more engaging for users than ever before. Moreover, it offers effective commercial value, creating new advertising and service recommendation channels for operators, increasing user stickiness and non-electricity revenue for charging stations, transforming charging stations from simple energy replenishment points into comprehensive service hubs. Finally, it enhances safety, eliminating the need for users to frequently check mobile maps while driving and allowing them to focus more on their surroundings when walking to find charging stations, reducing safety hazards.
[0090] Example 3
[0091] Figure 5 This is a schematic diagram of a vehicle charging implementation device provided in Embodiment 3 of the present invention. Figure 5 As shown, the device includes: a target charging station acquisition module 310, an augmented reality navigation image generation module 320, an augmented reality status image generation module 330, and a vehicle charging control module 340; wherein,
[0092] The target charging pile acquisition module 310 is used to acquire the current environment image and current location information through the augmented reality terminal, and to acquire the target charging pile;
[0093] The augmented reality navigation image generation module 320 is used to generate an augmented reality navigation image based on the current environment image, current location information and the installation location information of the target charging pile, and to display the augmented reality navigation image to the user through the augmented reality terminal to guide the user to the target charging pile;
[0094] The augmented reality status image generation module 330 is used to generate a virtual charging pile status identifier based on the status information of the target charging pile if the target charging pile is detected in the current environment image, and to generate an augmented reality status image based on the current environment image and the virtual charging pile status identifier, and to display the augmented reality status image to the user through the augmented reality terminal.
[0095] The vehicle charging control module 340 is used to control the target charging pile to charge the vehicle when the augmented reality terminal detects that the user has started the vehicle charging operation.
[0096] The technical solution of this invention involves acquiring the current environmental image and current location information through an augmented reality terminal, and then identifying the target charging pile. Based on the current environmental image, current location information, and the installation location information of the target charging pile, an augmented reality navigation image is generated and displayed to the user through the augmented reality terminal to guide the user to the target charging pile. If the target charging pile is detected in the current environmental image, a virtual charging pile status identifier is generated based on the target charging pile's status information. An augmented reality status image is then generated based on the current environmental image and the virtual charging pile status identifier, and displayed to the user through the augmented reality terminal. When the user's vehicle charging start operation is detected through the augmented reality terminal, the target charging pile is controlled to begin charging the vehicle. By introducing an augmented reality terminal and augmented reality technology, the intuitiveness of charging pile navigation can be improved, the operation process can be simplified, the vehicle charging efficiency can be improved, and the user experience can be enhanced.
[0097] Optionally, the target charging pile acquisition module 310 is specifically used to acquire the installation location information of each initial charging pile, and acquire each candidate charging pile based on the current location information and the installation location information of each initial charging pile.
[0098] Obtain the status information of each of the candidate charging piles, and based on the status information of each of the candidate charging piles, obtain the target charging pile from among the candidate charging piles.
[0099] Optionally, the augmented reality navigation image generation module 320 is specifically used to generate virtual navigation landmarks based on the current location information and the installation location information of the target charging pile, and to generate the augmented reality navigation image based on the current environment image and the virtual navigation landmarks.
[0100] Optionally, the vehicle charging device also includes:
[0101] A virtual charging status identifier generation module is used to acquire charging status information and generate a virtual charging status identifier based on the charging status information.
[0102] An augmented reality charging status image generation module is used to generate an augmented reality charging status image based on the current environment image and the virtual charging status identifier, and to display the augmented reality charging status image to the user through the augmented reality terminal.
[0103] Optionally, the vehicle charging device also includes:
[0104] The recommendation service information generation module is used to obtain historical user profiles and generate recommendation service information based on the historical user profiles and current location information.
[0105] The augmented reality recommendation service image generation module is used to generate a virtual recommendation service identifier based on the recommendation service information, generate an augmented reality recommendation service image based on the current environment image and the virtual recommendation service identifier, and display the augmented reality recommendation service image to the user through the augmented reality terminal.
[0106] Optionally, the vehicle charging device also includes:
[0107] The virtual charging completion identifier generation module is used to generate a virtual charging completion identifier and a virtual payment guidance identifier when the charging status information is detected to meet the preset stop conditions.
[0108] The augmented reality charging completion image generation module is used to generate an augmented reality charging completion image based on the current environment image, the virtual charging completion icon, and the virtual payment guidance icon, and to display the augmented reality charging completion image to the user through the augmented reality terminal;
[0109] The charging stop control module is used to control the target charging pile to stop charging the vehicle if the user's payment confirmation operation is detected through the augmented reality terminal.
[0110] Optionally, the vehicle charging device also includes:
[0111] The augmented reality charging station indicator image generation module is used to generate virtual charging station indicator signs, and generate augmented reality charging station indicator images based on the current environment image and the virtual charging station indicator signs, and display the augmented reality charging station indicator images to the user through the augmented reality terminal.
[0112] The vehicle charging implementation apparatus provided in this embodiment of the invention can execute the vehicle charging implementation method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method.
[0113] The collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0114] Example 4
[0115] Figure 6A schematic diagram of an electronic device 40 that can be used to implement embodiments of the present invention is shown. The electronic device 40 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.
[0116] like Figure 6 As shown, the electronic device 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42 or a random access memory (RAM) 43, communicatively connected to the at least one processor 41. The memory stores computer programs executable by the at least one processor. The processor 41 can perform various appropriate actions and processes based on the computer program stored in the read-only memory 42 or loaded from the storage unit 48 into the random access memory 43. The RAM 43 can also store various programs and data required for the operation of the electronic device 40. The processor 41, ROM 42, and RAM 43 are interconnected via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.
[0117] Multiple components in electronic device 40 are connected to I / O interface 45, including: input unit 46, such as keyboard, mouse, etc.; output unit 47, such as various types of monitors, speakers, etc.; storage unit 48, such as disk, optical disk, etc.; and communication unit 49, such as network card, modem, wireless transceiver, etc. Communication unit 49 allows electronic device 40 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0118] Processor 41 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, central processing units, graphics processing units, various special-purpose artificial intelligence computing chips, various processors running machine learning model algorithms, digital signal processors, and any suitable processor, controller, microcontroller, etc. Processor 41 performs the various methods and processes described above, such as methods for implementing vehicle charging.
[0119] In some embodiments, the vehicle charging implementation method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 48. In some embodiments, part or all of the computer program may be loaded into and / or installed on electronic device 40 via ROM 42 and / or communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the vehicle charging implementation method described above may be performed. Alternatively, in other embodiments, processor 41 may be configured to perform the vehicle charging implementation method by any other suitable means (e.g., by means of firmware).
[0120] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays, application-specific integrated circuits (ASICs), application-specific standard products (ASICs), system-on-a-chip (SoCs), complex programmable logic devices, computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0121] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0122] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory, read-only memory, erasable programmable read-only memory, optical fibers, portable compact disk read-only memory, optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0123] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device 40, which includes: a display device (e.g., a cathode ray tube or liquid crystal display) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device 40. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0124] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.
[0125] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact via a communication network. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server.
[0126] This embodiment may also include a computer program product, which includes a computer program that, when executed by a processor, implements the vehicle charging method provided in any embodiment of the present invention.
[0127] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.
[0128] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.
Claims
1. A method for implementing vehicle charging, characterized in that, include: The system uses augmented reality to obtain images of the current environment and current location information, and then identifies the target charging station. Based on the current environmental image, current location information, and the installation location information of the target charging station, an augmented reality navigation image is generated, and the augmented reality navigation image is displayed to the user through the augmented reality terminal to guide the user to the target charging station; If the target charging pile is detected in the current environment image, a virtual charging pile status identifier is generated based on the status information of the target charging pile, and an augmented reality status image is generated based on the current environment image and the virtual charging pile status identifier. The augmented reality status image is then displayed to the user through the augmented reality terminal. When the augmented reality terminal detects that the user has started charging the vehicle, it controls the target charging station to charge the vehicle.
2. The method according to claim 1, characterized in that, Acquiring the target charging station includes: Obtain the installation location information of each initial charging pile, and obtain each candidate charging pile based on the current location information and the installation location information of each initial charging pile; Obtain the status information of each of the candidate charging piles, and based on the status information of each of the candidate charging piles, obtain the target charging pile from among the candidate charging piles.
3. The method according to claim 1, characterized in that, Based on the current environmental image, current location information, and the installation location information of the target charging station, an augmented reality navigation image is generated, including: Based on the current location information and the installation location information of the target charging pile, a virtual navigation landmark is generated, and based on the current environmental image and the virtual navigation landmark, the augmented reality navigation image is generated.
4. The method according to claim 1, characterized in that, After controlling the target charging station to charge the vehicle, the process also includes: Obtain charging status information and generate a virtual charging status identifier based on the charging status information; Based on the current environment image and the virtual charging status indicator, an augmented reality charging status image is generated and displayed to the user through the augmented reality terminal.
5. The method according to claim 1, characterized in that, After controlling the target charging station to charge the vehicle, the process also includes: Obtain historical user profiles and generate recommendation service information based on the historical user profiles and current location information; Based on the recommended service information, a virtual recommended service identifier is generated, and based on the current environment image and the virtual recommended service identifier, an augmented reality recommended service image is generated, which is then displayed to the user through the augmented reality terminal.
6. The method according to claim 1, characterized in that, After controlling the target charging station to charge the vehicle, the process also includes: When the charging status information is detected to meet the preset stop conditions, a virtual charging completion indicator and a virtual payment guidance indicator are generated. Based on the current environment image, the virtual charging completion icon, and the virtual payment guidance icon, an augmented reality charging completion image is generated, and the augmented reality charging completion image is displayed to the user through the augmented reality terminal. If the augmented reality terminal detects a user's payment confirmation, it controls the target charging station to stop charging the vehicle.
7. The method according to claim 1, characterized in that, After detecting the target charging station in the current environmental image, the process further includes: A virtual charging station indicator is generated, and an augmented reality charging station indicator image is generated based on the current environment image and the virtual charging station indicator. The augmented reality charging station indicator image is then displayed to the user through the augmented reality terminal.
8. An electronic device, characterized in that, The electronic device includes: At least one processor, and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the vehicle charging implementation method according to any one of claims 1-7.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method for charging the vehicle as described in any one of claims 1-7.
10. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the vehicle charging method according to any one of claims 1-7.