Service Area Video Data Processing Methods and Systems

Abstract

This invention provides a service area video data processing method and system, relating to the field of data processing technology. It involves acquiring a side image of a target vehicle and identifying the target orientation of a target component. Based on the occupancy status of the refueling station and the target orientation, the target parking position is determined. A first guiding animation is generated and updated to the main guiding interface for display. When the target vehicle meets the conditions for pipe-around correction, the pipe-around correction distance is calculated based on the actual parking distance, and a second guiding animation is generated and sent to a sub-guidance screen for display. This invention achieves automated allocation between the target vehicle and the refueling station by identifying the target orientation and matching the refueling station orientation. When the orientation of the target component does not match the orientation of the refueling station, the pipe-around correction distance is calculated using a first distance, the vehicle width, and a second distance, and a second guiding animation is generated for guidance, thus achieving correction when the vehicle's orientation is mismatched after parking.

Description

Technical Field

[0001] This invention relates to data processing technology, and more particularly to a service area video data processing method and system. Background Technology

[0002] With the continuous advancement of intelligent transportation infrastructure, service area gas stations, as key refueling nodes during vehicle journeys, significantly impact the driving experience through their operational efficiency and service quality. Gas stations typically have multiple refueling pump positions, each with a fixed nozzle orientation. However, the location of the refueling nozzle varies depending on the vehicle model; it may be located on the left or right side of the vehicle. Drivers must park their vehicles at pump positions where the nozzle orientation matches their vehicle's to complete the refueling process.

[0003] Currently, vehicle guidance at service area gas stations mainly relies on manual direction or simple license plate recognition followed by static text prompts displayed on a screen, such as instructing a license plate to go to a specific pump station. However, existing technology lacks the ability to automatically recognize the orientation of the vehicle's refueling nozzle. The allocation of pump stations does not consider the matching relationship between the refueling nozzle and the nozzle's orientation, and the judgment of the parking direction depends entirely on the driver's personal experience. Furthermore, when the refueling nozzle and nozzle are not on the same side of the vehicle after the driver stops, it can easily lead to the vehicle needing to repeatedly reverse to adjust or rely on manual force to pull the fuel nozzle hose, affecting the service area's traffic efficiency.

[0004] Therefore, how to match the refueling pump position according to the orientation of the vehicle's refueling port, and how to provide targeted remedial measures based on the distance between the vehicle and the pump position after discrepancies occur during parking, has become a critical issue that urgently needs to be addressed. Summary of the Invention

[0005] This invention provides a service area video data processing method and system that can match the refueling pump position according to the orientation of the vehicle's refueling nozzle when the vehicle enters the gas station, and provide targeted remedial measures based on the distance between the vehicle and the pump position if a discrepancy occurs during parking.

[0006] A first aspect of the present invention provides a service area video data processing method, comprising: The side image of the target vehicle is acquired by the acquisition equipment in the vehicle guidance channel, and the target orientation of the target component is obtained by recognizing the side image. Based on the occupancy status of the parking space and the target orientation, the target parking position of the target vehicle is determined, and a first guide animation is generated according to the target parking position and updated to the main guide interface for display. When the target vehicle meets the conditions for pipe-around repair, the pipe-around repair distance is calculated based on the actual parking distance, and a second guiding animation is generated based on the pipe-around repair distance and sent to the sub-guidance screen for display.

[0007] Optionally, in one possible implementation of the first aspect, the step of acquiring a side image of the target vehicle using an acquisition device within the vehicle guidance channel, and identifying the side image to obtain the target orientation of the target component, includes: The side images of the target vehicle on the left and right sides are collected by the acquisition equipment in the vehicle guidance channel. Extract the outline boundary lines of each body component in the side image, and count the number of outline lines in each side image; The orientation of the side image with the most contour lines is taken as the target orientation of the target component.

[0008] Optionally, in one possible implementation of the first aspect, determining the target parking position of the target vehicle based on the occupancy status of the parking space and the target orientation includes: Obtain the orientation of the currently available camera positions and determine whether there are camera positions with orientations opposite to the target orientation; If it exists, the parking area corresponding to the currently available parking space will be determined as the target parking location for the target vehicle.

[0009] Optionally, in one possible implementation of the first aspect, generating a first guiding animation based on the target docking location and updating it to the main guiding interface for display includes: Obtain the license plate identifier of the target vehicle and control the main guide interface to display the license plate identifier for a preset duration; Based on the current location and target parking location of the target vehicle, a vehicle guidance path is generated. The license plate is controlled to move from the current location to the target parking location along the vehicle guidance path. A first guidance animation is generated and updated to the main guidance interface for display.

[0010] Optionally, in one possible implementation of the first aspect, before calculating the reversal distance based on the actual stopping distance when it is determined that the target vehicle meets the reversal conditions, the following steps are included: Upon receiving the docking completion information, the system uses the verification camera at the parking position to identify the orientation of the target vehicle's components and obtain the verification orientation.

[0011] Optionally, in one possible implementation of the first aspect, when determining that the target vehicle meets the pipe-circumvention remediation conditions, calculating the pipe-circumvention remediation distance based on the actual parking position includes: Obtain the first distance from the gun outlet at the actual parking position to the rear of the target vehicle, and obtain the second distance from the target component at the target vehicle to the rear of the vehicle, as well as the vehicle width; The required distance is obtained by summing the first distance, the vehicle width, the second distance, and the preset margin distance, and the hose length of the oil gun hose at the nozzle is obtained. When the verification orientation matches the orientation of the machine position at the actual parking location and the hose length is less than the required distance, the target vehicle is deemed to meet the hose bypass remediation conditions; or... If it is determined that there is no machine position orientation opposite to the target orientation and the hose length is less than the required distance, the target vehicle is deemed to meet the hose bypass remediation conditions. The tube-reversal repair distance is calculated based on the actual stopping distance between the gun outlet and the target vehicle.

[0012] Optionally, in one possible implementation of the first aspect, calculating the bypass repair distance based on the actual stopping distance between the gun muzzle and the target vehicle includes: The straight-line distance between the gun muzzle and the target vehicle is used as the actual stopping distance; The limiting distance is obtained by summing the actual parking distance, vehicle width, second distance, and preset margin distance; When the hose length is determined to be greater than or equal to the limiting distance, the maximum forward distance is calculated based on the first distance and the actual stopping distance and used as the hose reversal compensation distance.

[0013] Optionally, in one possible implementation of the first aspect, it also includes: When the hose length is determined to be less than the limiting distance, the lateral translation distance is obtained based on the difference between the limiting distance and the hose length.

[0014] Optionally, in one possible implementation of the first aspect, it also includes: When it is determined that the length of the hose is less than the limit distance, the docking area of ​​the currently available machine position corresponding to the machine position orientation opposite to the verification orientation is obtained as the translation position; Obtain the translation center point of the translation position and the target center point of the target vehicle; Connect the target center point with the translation center point to obtain the predicted translation line; When it is determined that the predicted translation line passes through an obstruction, the corresponding predicted translation line is taken as the first translation line, and the remaining predicted translation lines are taken as the second translation lines. The second translation line is sorted in ascending order based on the distance of the predicted translation line to obtain the first sequence; Obtain the number of obstructions in the first translation line, and sort the first translation line in ascending order based on the number of obstructions to obtain the subsequent sequence; The preceding sequence is spliced ​​to the front of the following sequence to obtain a candidate sequence. The translation position corresponding to the first predicted translation line of the candidate sequence is selected as the supplementary movement position.

[0015] A second aspect of the present invention provides a service area video data processing system, comprising: The identification module is used to acquire a side image of the target vehicle from the acquisition device in the vehicle guidance channel, identify the side image, and obtain the target orientation of the target component. The determination module is used to determine the target parking position of the target vehicle based on the occupancy status of the machine position and the target orientation, generate a first guide animation based on the target parking position, and update it to the main guide interface for display. The adjustment module is used to determine when the target vehicle meets the conditions for pipe-around repair, calculate the pipe-around repair distance based on the actual parking distance, and generate a second guidance animation based on the pipe-around repair distance and send it to the sub-guidance screen for display.

[0016] The beneficial effects of this invention are as follows: 1. This invention collects side images of the target vehicle using acquisition devices within the vehicle guidance channel, identifies the target orientation of the target component from the side images, determines the target parking position of the target vehicle based on the occupancy status of the acquisition device and the target orientation, generates a first guidance animation based on the target parking position, and updates it to the main guidance interface for display, thereby achieving automated guidance of the target vehicle.

[0017] 2. When the present invention determines that the target vehicle meets the conditions for hose reversal repair, it obtains the first distance from the nozzle to the rear of the vehicle body at the actual parking position, the second distance from the target component to the rear of the vehicle body, and the vehicle body width. The required distance is obtained by summing the first distance, the vehicle body width, the second distance, and the preset margin distance. The hose length is compared with the required distance to determine whether the conditions for hose reversal repair are met. The hose reversal repair distance is calculated based on the actual parking distance between the nozzle and the target vehicle. A second guiding animation is generated based on the hose reversal repair distance and sent to the sub-guidance screen for display. This avoids the traditional method of staff judging whether the oil gun hose is long enough based on experience. The vehicle position is adjusted according to the actual situation.

[0018] 3. When the hose length is less than the limit distance, this invention obtains the parking area of ​​the currently available machine position corresponding to the machine position facing the opposite direction to the verification direction as the translation position. The target center point and the translation center point are connected to obtain the predicted translation line. The predicted translation line is divided into the first translation line and the second translation line according to whether it passes through the obstruction. The second translation line is sorted in ascending order based on the distance to obtain the front sequence. The first translation line is sorted in ascending order based on the number of obstructions to obtain the rear sequence. The front sequence is spliced ​​to the front of the rear sequence to obtain the candidate sequence. The translation position corresponding to the first predicted translation line is selected as the supplementary movement position. This realizes the automatic recommendation of an alternative machine position with a smooth path and a short distance when the hose of the oil gun at the current machine position is not enough to wrap around the hose, avoiding the driver blindly choosing among multiple currently available machine positions. Attached Figure Description

[0019] Figure 1A flowchart of a service area video data processing method provided by the present invention; Figure 2 This is a schematic diagram of the machine position orientation and target orientation in this invention; Figure 3 This is a schematic diagram of the first distance, the second distance, and the vehicle width in this invention; Figure 4 This is a schematic diagram showing that the rear of the vehicle body is flush with the gun nozzle in this invention; Figure 5 This is a schematic diagram of the tube-wrapping compensation distance in this invention; Figure 6 This is a schematic diagram of the structure of a service area video data processing system provided by the present invention. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0021] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein.

[0022] It should be understood that in the various embodiments of the present invention, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0023] It should be understood that in this invention, "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product, or device.

[0024] It should be understood that in this invention, "multiple" refers to two or more. "And / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "Contains A, B, and C", "Contains A, B, and C" means that all three A, B, and C are contained; "Contains A, B, or C" means that one of A, B, and C is contained; "Contains A, B, and / or C" means that any one, two, or three of A, B, and C are contained.

[0025] It should be understood that in this invention, "B corresponding to A", "B corresponding to A", "A and B correspond", or "B and A correspond" means that B is associated with A, and B can be determined based on A. Determining B based on A does not mean determining B solely based on A; B can also be determined based on A and / or other information. Matching A and B is defined as a similarity between A and B that is greater than or equal to a preset threshold.

[0026] Depending on the context, "if" as used here can be interpreted as "when," "when," "in response to determination," or "in response to detection."

[0027] The technical solution of the present invention will be described in detail below with reference to specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0028] This invention provides a service area video data processing method, such as... Figure 1 As shown, it includes: S1. Acquire a side image of the target vehicle using the acquisition device in the vehicle guidance channel, identify the side image, and obtain the target orientation of the target component.

[0029] It should be noted that service area gas stations experience high traffic volume. Without timely guidance, drivers entering the service area must independently observe which refueling pumps are available and determine which side their vehicle's refueling nozzle should face. This can easily lead to multiple vehicles vying for the same pump, or drivers discovering after parking that the refueling nozzle and nozzle are not on the same side and need to adjust their positions, causing congestion in the refueling lanes and reduced refueling efficiency. This invention, when a vehicle enters the vehicle guidance lane, acquires a side image of the target vehicle using a data acquisition device and identifies the direction of the refueling nozzle. Based on the nozzle's orientation, it automatically allocates a suitable refueling pump, achieving timely guidance after vehicle entry, reducing congestion within the gas station, and improving refueling efficiency.

[0030] Among them, the vehicle guidance lane refers to the dedicated passageway set up at the entrance of the service area gas station to guide target vehicles into the refueling area. For example, there is one lane for gasoline and one lane for diesel, and each refueling station has a corresponding fuel type; the acquisition equipment refers to the image sensor or camera device deployed in the vehicle guidance lane to acquire side images of the target vehicle; the side image refers to the image of the vehicle's side taken by the acquisition equipment from the left or right side of the target vehicle; the target component refers to the fuel filler neck on the target vehicle; and the target orientation refers to the orientation of the target component, that is, pointing from the target component to the outside of the vehicle body.

[0031] In some embodiments, step S1 (acquiring a side image of the target vehicle using the acquisition device in the vehicle guidance channel, identifying the side image, and obtaining the target orientation of the target component) includes S11-S13: S11, Collect side images of the target vehicle on the left and right sides using the acquisition equipment in the vehicle guidance channel.

[0032] Understandably, data acquisition devices are deployed on the left and right sides of the vehicle guidance lane. When a target vehicle enters the vehicle guidance lane, the data acquisition device on the left side acquires a side image of the target vehicle on the left, and the data acquisition device on the right side acquires a side image of the target vehicle on the right, thus obtaining side images of the target vehicle on the left and right sides respectively.

[0033] S12, extract the outline boundary lines of each body component in the side image, and count the number of outline lines in each side image.

[0034] It should be noted that the side of the vehicle where the fuel filler is located usually has more body parts such as a fuel filler cap than the other side. These extra body parts appear as more outlines in the side view.

[0035] Understandably, the outlines of the vehicle body parts in each side image are extracted, and the number of outlines in the left side image and the right side image are calculated respectively.

[0036] Among them, body parts refer to structural components with independent contour features on the outer surface of the target vehicle body, including doors, windows, rearview mirrors, door handles, and fuel filler caps, etc.; contour boundary lines refer to the contour lines of body parts extracted from the side image; the number of contour lines refers to the number of contour boundary lines contained in a single side image.

[0037] S13, take the orientation of the side image with the most contour lines as the target orientation of the target component.

[0038] Understandably, by comparing the number of outlines in the side images on the left and right sides, the orientation corresponding to the side image with more outlines is taken as the target orientation of the target component.

[0039] S2, based on the occupancy status of the machine position and the target orientation, determine the target parking position of the target vehicle, generate a first guide animation according to the target parking position, and update it to the main guide interface for display.

[0040] It should be noted that gas stations typically have multiple pump positions, each with a nozzle that serves a fixed direction. For example... Figure 2 As shown, the target orientation is the direction from the vehicle body towards the target component, and the nozzle orientation is the service direction of the nozzle. When the target vehicle is parked at a location where the nozzle orientation is opposite to the target orientation, the nozzle and the target component are on the same side of the vehicle body, allowing the fuel nozzle to directly target the component for refueling. If the target orientation and nozzle orientation are not considered and currently available nozzles are assigned arbitrarily, the target orientation and nozzle orientation may match, preventing the fuel nozzle from directly reaching the target component after the vehicle parks. Therefore, this step uses the occupancy status of the nozzle and the target orientation of the target component as allocation conditions to select a currently available nozzle with a matching orientation for the target vehicle as the target parking position, and guides the driver there via animation through the main guidance interface.

[0041] Among them, "vehicle stand" refers to a fixed parking area within a gas station equipped with a fuel dispenser; "occupancy status" refers to the status information of whether the vehicle stand is currently occupied by other vehicles; "target parking location" refers to the parking area corresponding to the fuel dispenser stand assigned to the target vehicle based on the target orientation and vehicle stand occupancy status; "first guidance animation" refers to a dynamic screen generated on the main guidance interface to guide the target vehicle from its current location to the target parking location; and "main guidance interface" refers to the display screen set at the entrance or passageway area of ​​the service area gas station.

[0042] In some embodiments, step S2 (determining the target parking position of the target vehicle based on the occupancy status of the parking space and the target orientation) includes S21-S22: S21, obtain the orientation of the currently available camera position, and determine whether there is a camera position orientation opposite to the target orientation.

[0043] Among them, "dispenser orientation" refers to the orientation of the nozzle on the refueling pump, that is, the service direction of the nozzle; "currently available pump" refers to a refueling pump that is not currently occupied by a vehicle.

[0044] It should be noted that gas station refueling stations are divided into lanes according to fuel type. For example, there is one lane for gasoline and another for diesel. Each refueling station within each lane is equipped with a nozzle corresponding to the fuel type, and the service direction of the nozzle nozzle for each station is fixed during installation. This step first excludes stations already occupied by other vehicles. Then, among the currently available stations, it searches for stations with a nozzle facing the opposite direction to the target component, meaning the nozzle's service direction can directly align with the target component.

[0045] Understandably, the process involves obtaining the occupancy status of all camera positions, filtering out those currently idle (i.e., the currently available camera positions), obtaining the orientation of each currently available camera position, and comparing each orientation with the target orientation to determine if there is a camera position with the opposite orientation.

[0046] S22, if it exists, then the parking area corresponding to the currently available parking space is determined as the target parking location of the target vehicle.

[0047] Understandably, when it is determined that there is a parking position with the opposite orientation to the target orientation, the parking area of ​​the currently available parking position corresponding to that orientation is taken as the target parking position of the target vehicle.

[0048] It's worth noting that when multiple available camera positions face the opposite direction to the target vehicle, the parking area corresponding to the available camera position furthest from the target vehicle's current location is selected as the target parking location. This is done to ensure the target vehicle parks at a position further away from the aisle, leaving closer positions for later-arriving vehicles. This avoids situations where nearby positions are occupied by earlier-arriving vehicles, forcing subsequent vehicles to traverse longer aisles to reach more distant available positions.

[0049] In some embodiments, step S2 (generating a first guiding animation based on the target docking location and updating it to the main guiding interface for display) includes S23-S24: S23, obtain the license plate identifier of the target vehicle, and control the main guide interface to display the license plate identifier for a preset duration.

[0050] Understandably, the system obtains the license plate information of the target vehicle, sends it to the main guidance interface for centered display, and maintains it for a preset duration so that the main guidance interface can display and guide the target vehicle when it enters the vehicle guidance channel.

[0051] Among them, the license plate identifier refers to the license plate number information of the target vehicle; the preset duration refers to the pre-set length of time that the license plate identifier will be continuously displayed on the main guide interface.

[0052] S24. Based on the current position and target parking position of the target vehicle, a vehicle guidance path is generated, and the license plate is controlled to move from the current position to the target parking position along the vehicle guidance path. A first guidance animation is generated and updated to the main guidance interface for display.

[0053] The process involves obtaining the target parking location and the target vehicle's current position within the vehicle guidance lane. Based on the lane's layout and available routes, a vehicle guidance path is planned from the current location to the target parking location. On the main guidance interface, the displayed license plate icon is smoothly moved along the guidance path from its current location to the target parking location, creating the first guidance animation, which is then updated and displayed on the main guidance interface. Drivers can see the animation of their license plate icon moving along the guidance path to the target parking location on the main guidance interface; following the animation's direction will lead them to the target parking location.

[0054] Among them, the vehicle guidance path refers to the route that guides the target vehicle from its current location to its target parking location.

[0055] S3, when it is determined that the target vehicle meets the conditions for pipe bypass repair, calculate the pipe bypass repair distance based on the actual parking distance, and generate a second guide animation based on the pipe bypass repair distance and send it to the sub-guide screen for display.

[0056] It should be noted that even if a target parking position with a matching orientation is assigned to the target vehicle in step S2, there are still two situations that can lead to a mismatch between the target orientation and the camera position orientation when the target vehicle actually parks. The first situation is that in step S21, it is determined that there is a camera position orientation opposite to the target orientation, a target parking position is assigned to the target vehicle, and guidance is provided. However, during actual driving, the driver does not park at the target parking position as guided, but instead parks at a different camera position with a different orientation. This results in the target orientation being the same as, rather than opposite to, the orientation of the camera position after parking, and the muzzle cannot be directly aimed at the target component. For example, the target vehicle is assigned camera position 3, whose orientation is opposite to the target orientation. However, the driver parks at the adjacent camera position 4, whose orientation is the same as the target orientation, and the service direction of the muzzle is not opposite to the target component. The second scenario is that in step S21, it is determined that there is no camera position orientation opposite to the target orientation, that is, the orientation of all currently available camera positions is consistent with the target orientation, and there is no currently available camera position that meets the condition to be allocated. In this invention, no target parking position is set, and the driver selects a camera position to park on his own without guidance. Since there is no camera position orientation opposite to the target orientation, the target orientation and the camera position orientation will inevitably be consistent after parking, and the gun muzzle cannot be directly aimed at the target component.

[0057] In both of the above situations, if the fuel nozzle cannot directly reach the target component, the fuel nozzle hose can be routed around the rear of the vehicle for remedial purposes. This step, upon determining that the target vehicle meets the remedial conditions, calculates the remedial distance required for the fuel nozzle hose to route around the rear of the vehicle to the target component, and generates a second guiding animation displayed on the sub-guide screen. This top-down diagram guides the driver to adjust the vehicle's position so that the fuel nozzle hose can smoothly route around the rear of the vehicle to the target component to complete refueling.

[0058] Among them, the pipe-around recovery condition refers to the judgment condition that is met when the target vehicle stops and the target orientation is consistent with the machine position orientation, and the length of the fuel nozzle hose is insufficient to go around from the rear of the vehicle to the target component; the actual stopping distance refers to the straight-line distance between the nozzle and the target vehicle; the pipe-around recovery distance refers to the distance that the target vehicle needs to move forward; the second guidance animation refers to the dynamic picture generated on the sub-guidance screen that shows the fuel nozzle hose around trajectory from a top-down perspective and guides the driver to adjust the vehicle position; the sub-guidance screen refers to the display screen set next to each refueling machine position.

[0059] In some embodiments, before calculating the pipe-looping rescue distance based on the actual parking distance when it is determined that the target vehicle meets the pipe-looping rescue conditions, S31 is included: S31, in response to the docking completion information, performs orientation recognition of the target components of the target vehicle based on the verification camera at the station, and obtains the verification orientation.

[0060] It should be noted that after the target vehicle has parked, this step involves re-identifying the target vehicle using the verification camera at the machine location to confirm the actual orientation of the target components.

[0061] Understandably, when the sensor at the refueling pump detects that the target vehicle has completed parking, it generates parking completion information. In response to this parking completion information, the verification camera at the corresponding pump position is controlled to acquire images of the target vehicle and identify the orientation of the target components to obtain the verification orientation.

[0062] Among them, "parking completion information" refers to the signal emitted by the sensor at the pump station after the target vehicle has completed parking; "verification camera" refers to the camera device deployed at each refueling pump station to identify the orientation of the target components of the parked target vehicle; "verification orientation" refers to the actual orientation of the target components determined after the verification camera identifies the orientation of the target vehicle.

[0063] In some embodiments, step S3 (when determining that the target vehicle meets the pipe-circling rescue conditions, calculating the pipe-circling rescue distance based on the actual parking position) includes S32-S36: S32, obtain the first distance from the gun muzzle of the actual parking position to the rear of the target vehicle, and obtain the second distance from the target component at the target vehicle to the rear of the vehicle, as well as the vehicle width.

[0064] It should be noted that the present invention needs to determine whether the oil gun hose can go from the nozzle through the rear of the vehicle body to the target component, therefore it is necessary to obtain the distance between each node position on the hose's detour path.

[0065] It is understandable that, such as Figure 3 As shown, an overhead camera deployed at the camera position captures an overhead view image of the actual parking location. The distance from the camera's nozzle at the actual parking location to the rear of the target vehicle is calculated from the overhead view image as the first distance, which refers to the rear of the target vehicle on the side closest to the nozzle. Then, by querying the vehicle model information or through image recognition, the distance from the target component to the rear of the vehicle is obtained as the second distance, which refers to the rear of the target vehicle on the same side as the target component. Finally, the width of the target vehicle is extracted.

[0066] Among them, the actual parking position refers to the parking area corresponding to the refueling pump position where the target vehicle is actually parked; the first distance refers to the distance from the nozzle of the nozzle at the actual parking position to the rear of the target vehicle; the second distance refers to the distance from the target component on the target vehicle to the rear of the vehicle; and the vehicle width refers to the lateral width of the target vehicle.

[0067] S33, based on the sum of the first distance, vehicle width, second distance and preset margin distance, the required distance is obtained, and the hose length of the oil gun hose at the nozzle is obtained.

[0068] It should be noted that the hose of the oil gun needs to follow three paths from the nozzle to the target component: the first path runs diagonally from the nozzle to the rear of the vehicle; the second path crosses from one side of the rear of the vehicle to the other; and the third path extends from the rear of the vehicle to the target component. The sum of these three paths, plus a preset allowance distance, is the total length of the hose required to reach the target component, i.e., the required distance.

[0069] Understandably, the required distance is obtained by summing the first distance, vehicle width, second distance, and preset margin distance. Simultaneously, the hose length of the fuel nozzle at the target vehicle's current parking position is retrieved.

[0070] Among them, the preset margin distance refers to the distance that is pre-set to compensate for the slack of the oil gun hose; the required distance refers to the minimum total length required for the oil gun hose to go from the nozzle, through the rear of the vehicle body, to the target component; and the hose length refers to the actual total length of the oil gun hose installed at the nozzle.

[0071] S34, when the verification orientation matches the orientation of the machine position at the actual parking location and the hose length is less than the required distance, it is determined that the target vehicle meets the hose bypass remediation conditions; or... It should be noted that this step corresponds to the situation in step S21 where the camera position orientation is opposite to the target orientation, the present invention has set a target parking position for the target vehicle and provided guidance, but the driver does not park according to the guidance. After the target vehicle parks, the verification camera confirms that the verification orientation is consistent with the camera position orientation at the actual parking position, indicating that the target vehicle did not park at the target parking position, but rather at another position with a different camera position orientation, causing the nozzle to be unable to directly aim at the target component. In this case, if the hose length is less than the required distance, the oil gun hose cannot go around from the rear of the vehicle to the target component at the current position, and hose rerouting is required as a remedy.

[0072] Understandably, the orientation of the camera position at the actual parking location of the target vehicle is obtained, and the verification orientation is compared with the camera position orientation. When the verification orientation matches the camera position orientation, it indicates that the nozzle cannot be directly aimed at the target component. Then, the hose length obtained in step S33 is compared with the required distance. When the hose length is less than the required distance, it is determined that the target vehicle meets the hose bypass compensation condition.

[0073] S35, when it is determined that there is no machine position orientation opposite to the target orientation and the hose length is less than the required distance, it is determined that the target vehicle meets the hose reversal conditions.

[0074] It should be noted that there is another situation that also meets the pipe-winding compensation condition: this step corresponds to the case in step S21 where there is no camera position orientation opposite to the target orientation. When it is determined that there is no camera position orientation opposite to the target orientation, since the orientation of all currently available camera positions is consistent with the target orientation, the nozzle of any currently available camera position can directly aim at the target component, making it impossible to set a target parking position for the target vehicle. In this case, the driver chooses a camera position to park, and regardless of which currently available camera position is chosen, the target orientation and the camera position orientation are consistent, and the nozzle cannot directly aim at the target component. Therefore, after the target vehicle parks, if the hose length is less than the required distance, pipe-winding compensation is also triggered.

[0075] Understandably, when it is determined that there is no machine position orientation opposite to the target orientation, the hose length is further compared with the required distance. When the hose length is less than the required distance, it is determined that the target vehicle meets the conditions for hose bypass repair.

[0076] S36, calculate the tube-circuiting compensation distance based on the actual stopping distance between the gun muzzle and the target vehicle.

[0077] Understandably, after determining that the target vehicle meets the conditions for pipe bypass repair, the actual stopping distance between the nozzle and the target vehicle is obtained, and the pipe bypass repair distance is calculated based on the actual stopping distance.

[0078] In some embodiments, step S36 (calculating the tube-circling compensation distance based on the actual stopping distance between the gun muzzle and the target vehicle) includes S361-S363: S361, obtain the straight-line distance between the gun muzzle and the target vehicle as the actual stopping distance.

[0079] Understandably, the horizontal straight-line distance between the gun muzzle and the target vehicle is identified based on the overhead view of the actual parking location and used as the actual parking distance.

[0080] The actual stopping distance refers to the horizontal straight-line distance between the muzzle of the gun and the body of the target vehicle.

[0081] S362, the limiting distance is obtained based on the sum of the actual parking distance, vehicle width, second distance and preset margin distance.

[0082] It should be noted that the limiting distance represents the minimum detour length of the fuel nozzle hose. The shortest distance is when the rear of the target vehicle is on the same horizontal line as the nozzle outlet, resulting in the minimum hose extension length. The limiting distance is calculated by adding the actual parking distance, the vehicle width, a second distance, and a preset allowance distance, assuming the rear of the target vehicle is on the same horizontal line as the nozzle outlet. Figure 4 As shown, if the hose length is greater than or equal to the limit distance, it means that as long as the target vehicle moves to a position where the rear of the vehicle is level with the nozzle, the hose will be long enough to reach the target component.

[0083] Understandably, the limiting distance is obtained by summing the actual parking distance, vehicle width, second distance, and preset margin distance.

[0084] The limiting distance refers to the minimum total length required for the oil gun hose to travel from the outlet, through the rear of the vehicle, to the target component when the rear of the target vehicle and the nozzle are on the same horizontal line.

[0085] S363, when it is determined that the length of the hose is greater than or equal to the limiting distance, the maximum forward distance is calculated based on the first distance and the actual stopping distance as the hose reversal compensation distance.

[0086] It should be noted that after obtaining the distance limit, the position of the target vehicle can be adjusted according to the distance limit, so that the target vehicle moves forward and the rear of the vehicle is level with the muzzle of the gun.

[0087] It is understandable that, such as Figure 5As shown, when the hose length is greater than or equal to the limit distance, the nozzle can be used as the vertex, and a right-angled side can be constructed from the nozzle to the side of the vehicle body, and a hypotenuse can be constructed from the nozzle to the rear of the vehicle body. This right-angled side, the hypotenuse, and the side of the vehicle body form a right-angled triangle. According to the Pythagorean theorem, the length of the right-angled side of the right-angled triangle located on the side of the vehicle body can be calculated to obtain the maximum forward distance, which is the hose-wrapping compensation distance of the target vehicle. The calculation of the side length of the right-angled triangle is existing technology and will not be elaborated here.

[0088] The maximum forward distance refers to the distance the target vehicle needs to travel from its actual parking position until the rear of the vehicle is level with the muzzle of the gun.

[0089] It is worth mentioning that if the target vehicle continues to move forward and passes this position, the rear of the vehicle will move in front of the muzzle, and the distance from the muzzle to the rear of the vehicle will become a diagonal line and gradually increase. The hose consumption will actually increase. Therefore, the position where the rear of the vehicle is level with the muzzle is not only the position where the hose is stretched the shortest, but also the position where the target vehicle can move the farthest.

[0090] In some embodiments, S364 is also included: S364, when it is determined that the length of the hose is less than the limiting distance, the lateral translation distance is obtained based on the difference between the limiting distance and the hose length.

[0091] The lateral translation distance refers to the distance the target vehicle needs to move closer to the side where the gun barrel is pointed.

[0092] It should be noted that when the hose length is less than the limit distance, even if the target vehicle moves forward to a position where the rear of the vehicle is level with the nozzle, the hose is still not long enough to go around the rear of the vehicle to reach the target component. In this case, the target vehicle can be moved laterally to shorten the distance between the nozzle and the vehicle body, so that the hose can go around the vehicle.

[0093] Understandably, the lateral displacement distance is obtained by subtracting the hose length from the restricted distance. For example, if the restricted distance is 8 meters and the hose length is 7.5 meters, the lateral displacement distance is 0.5 meters, meaning the target vehicle needs to move 0.5 meters laterally closer to the nozzle.

[0094] In some embodiments, S365-S371 are also included: S365, when it is determined that the length of the hose is less than the limit distance, the docking area of ​​the currently available machine position corresponding to the machine position orientation opposite to the verification orientation is obtained as the translation position.

[0095] It should be noted that when the hose length is less than the limit distance, it may be impossible to complete the hose detour regardless of the target vehicle's adjustment, as some vehicles are quite large. This step provides an alternative solution: re-find an available pumping station with the opposite orientation to the verification direction. If a pumping station with the opposite orientation exists, guide the target vehicle to the corresponding station without needing to detour the hose again. Previously, there might not have been a matching pumping station; it may have been found now because other vehicles may have finished refueling and left, freeing up the station.

[0096] Understandably, the occupancy status of all camera positions is rescanned to obtain the currently available camera positions whose orientation is opposite to the verification orientation, and the corresponding parking area of ​​the currently available camera position is used as the translation position.

[0097] The translation position refers to the parking area corresponding to the currently available machine stand that is opposite to the verification orientation.

[0098] S366, Obtain the translation center point of the translation position and the target center point of the target vehicle.

[0099] It is understandable that the geometric center of the parking area where each translation position is located is obtained as the translation center point, and the geometric center of the target vehicle is obtained as the target center point.

[0100] S367, Connect the target center point and the translation center point to obtain the predicted translation line.

[0101] Understandably, by connecting the target center point to each translation center point, multiple predicted translation lines can be obtained.

[0102] The predicted translation line refers to the line connecting the target center point and the translation center point.

[0103] S368, when it is determined that the predicted translation line passes through an obstruction, the corresponding predicted translation line is taken as the first translation line, and the remaining predicted translation lines are taken as the second translation lines.

[0104] It should be noted that there may be various obstacles between gas station pump positions, such as other refueling equipment, pillars, etc. If the predicted translation line passes through an obstruction, it means that the target vehicle will be hindered when translating along the path corresponding to that predicted translation line. This step categorizes predicted translation lines that pass through obstructions separately from those that do not.

[0105] Understandably, the process involves obtaining the position and outline of each obstruction within the gas station, and comparing whether each predicted translation line passes through an obstruction. Predicted translation lines that pass through obstructions are designated as the first translation line, and those that do not are designated as the second translation line.

[0106] Among them, obstructions refer to obstacles located inside the gas station that hinder the movement of the target vehicle, including refueling equipment, pillars, etc.

[0107] S369, sort the second translation line in ascending order based on the distance of the predicted translation line to obtain the first sequence.

[0108] Understandably, the distances of each second translation line are calculated, and the second translation lines are sorted in ascending order of length to obtain the first sequence. The earlier the translation position in the first sequence, the shorter the distance the target vehicle travels.

[0109] The front sequence refers to the ordered set formed by arranging the second translation lines that do not pass through obstructions in ascending order of distance.

[0110] S370, obtain the number of obstructions in the first translation line, sort the first translation line in ascending order based on the number of obstructions, and obtain the subsequent sequence.

[0111] Understandably, the number of obstacles encountered by each first translation line is counted as the number of obstacles. The first translation lines are then sorted in ascending order of the number of obstacles, from fewest to most, to obtain the subsequent sequence. The earlier a translation position appears in the subsequent sequence, the fewer obstacles the target vehicle encounters during its movement.

[0112] Here, the number of obstructions refers to the number of obstructions that a single first translation line passes through; the subsequent sequence refers to the ordered set formed by arranging the first translation lines that pass through obstructions in ascending order according to the number of obstructions.

[0113] S371, the preceding sequence is spliced ​​to the front of the following sequence to obtain a candidate sequence, and the translation position corresponding to the first predicted translation line of the candidate sequence is selected as the supplementary movement position.

[0114] It should be noted that by splicing the preceding sequence before the following sequence, the translation position that does not pass through the obstruction takes precedence over the translation position that passes through the obstruction.

[0115] Understandably, the preceding sequence is concatenated to the beginning of the following sequence to generate a candidate sequence. The first predicted translation line in the candidate sequence is then read, and its corresponding translation position is used as the supplementary movement position. It's worth noting that if the translation position corresponding to the first predicted translation line is occupied by another vehicle, it can be sequentially extended.

[0116] Among them, the candidate sequence refers to the ordered set formed by splicing the preceding sequence to the front of the following sequence; the supplementary movement position refers to the translation position corresponding to the first predicted translation line selected from the candidate sequence, which is used as the recommended target for the translation of the target vehicle.

[0117] See Figure 6 This is a schematic diagram of a service area video data processing system provided in an embodiment of the present invention. The system includes: The identification module is used to acquire a side image of the target vehicle from the acquisition device in the vehicle guidance channel, identify the side image, and obtain the target orientation of the target component. The determination module is used to determine the target parking position of the target vehicle based on the occupancy status of the machine position and the target orientation, generate a first guide animation based on the target parking position, and update it to the main guide interface for display. The adjustment module is used to determine when the target vehicle meets the conditions for pipe-around repair, calculate the pipe-around repair distance based on the actual parking distance, and generate a second guidance animation based on the pipe-around repair distance and send it to the sub-guidance screen for display.

[0118] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A service area video data processing method, characterized by, include: The side image of the target vehicle is acquired by the acquisition equipment in the vehicle guidance channel, and the target orientation of the target component is obtained by recognizing the side image. Based on the occupancy status of the parking space and the target orientation, the target parking position of the target vehicle is determined, and a first guide animation is generated based on the target parking position and updated to the main guide interface for display. When the target vehicle meets the conditions for pipe-around repair, the pipe-around repair distance is calculated based on the actual parking distance, and a second guidance animation is generated based on the pipe-around repair distance and sent to the sub-guidance screen for display.

2. The method according to claim 1, characterized in that, The step of acquiring a side image of the target vehicle using the acquisition device within the vehicle guidance channel, identifying the side image, and obtaining the target orientation of the target component includes: The side images of the target vehicle on the left and right sides are collected by the acquisition equipment in the vehicle guidance channel. Extract the outline boundary lines of each body component in the side image, and count the number of outline lines in each side image; The orientation of the side image with the most contour lines is taken as the target orientation of the target component.

3. The method according to claim 1, characterized in that, The determination of the target vehicle's target parking position based on the occupancy status of the parking space and the target orientation includes: Obtain the orientation of the currently available camera positions and determine whether there are camera positions with orientations opposite to the target orientation; If it exists, the parking area corresponding to the currently available parking space will be determined as the target parking location for the target vehicle.

4. The method according to claim 1, characterized in that, The step of generating a first guiding animation based on the target docking location and updating it to the main guiding interface for display includes: Obtain the license plate identifier of the target vehicle and control the main guide interface to display the license plate identifier for a preset duration; Based on the current location and target parking location of the target vehicle, a vehicle guidance path is generated. The license plate is controlled to move from the current location to the target parking location along the vehicle guidance path. A first guidance animation is generated and updated to the main guidance interface for display.

5. The method according to claim 3, characterized in that, Before calculating the reversal distance based on the actual parking distance after determining that the target vehicle meets the conditions for pipe bypass remediation, the following steps are included: Upon receiving the docking completion information, the system performs orientation recognition of the target components of the target vehicle based on the verification camera at the camera position to obtain the verification orientation.

6. The method according to claim 5, characterized in that, When the target vehicle is determined to meet the conditions for pipe-around repair, the pipe-around repair distance is calculated based on the actual parking position, including: Obtain the first distance from the gun outlet at the actual parking position to the rear of the target vehicle, and obtain the second distance from the target component at the target vehicle to the rear of the vehicle, as well as the vehicle width; The required distance is obtained by summing the first distance, the vehicle width, the second distance, and the preset margin distance, and the hose length of the oil gun hose at the nozzle is obtained. When the verification orientation matches the orientation of the machine position at the actual parking location and the hose length is less than the required distance, the target vehicle is deemed to meet the hose bypass remediation conditions; or... If it is determined that there is no machine position orientation opposite to the target orientation and the hose length is less than the required distance, the target vehicle is deemed to meet the hose bypass remediation conditions. The tube-reversal repair distance is calculated based on the actual stopping distance between the gun outlet and the target vehicle.

7. The method according to claim 6, characterized in that, The calculation of the bypass repair distance based on the actual stopping distance between the gun outlet and the target vehicle includes: The straight-line distance between the gun muzzle and the target vehicle is used as the actual stopping distance; The limiting distance is obtained by summing the actual parking distance, vehicle width, second distance, and preset margin distance; When the hose length is determined to be greater than or equal to the limiting distance, the maximum forward distance is calculated based on the first distance and the actual stopping distance and used as the hose reversal compensation distance.

8. The method of claim 7, wherein, Also includes: When the hose length is determined to be less than the limiting distance, the lateral translation distance is obtained based on the difference between the limiting distance and the hose length.

9. The method according to claim 7, characterized in that, Also includes: When it is determined that the length of the hose is less than the limit distance, the docking area of ​​the currently available machine position corresponding to the machine position orientation opposite to the verification orientation is obtained as the translation position; Obtain the translation center point of the translation position and the target center point of the target vehicle; Connect the target center point with the translation center point to obtain the predicted translation line; When it is determined that the predicted translation line passes through an obstruction, the corresponding predicted translation line is taken as the first translation line, and the remaining predicted translation lines are taken as the second translation lines. The second translation line is sorted in ascending order based on the distance of the predicted translation line to obtain the first sequence; Obtain the number of obstructions in the first translation line, and sort the first translation line in ascending order based on the number of obstructions to obtain the subsequent sequence; The preceding sequence is spliced ​​to the front of the following sequence to obtain a candidate sequence. The translation position corresponding to the first predicted translation line of the candidate sequence is selected as the supplementary movement position.

10. A service area video data processing system, characterized in that, include: The identification module is used to acquire a side image of the target vehicle from the acquisition device in the vehicle guidance channel, identify the side image, and obtain the target orientation of the target component. The determination module is used to determine the target parking position of the target vehicle based on the occupancy status of the machine position and the target orientation, generate a first guide animation based on the target parking position, and update it to the main guide interface for display. The adjustment module is used to determine when the target vehicle meets the conditions for pipe-around repair, calculate the pipe-around repair distance based on the actual parking distance, and generate a second guidance animation based on the pipe-around repair distance and send it to the sub-guidance screen for display.

Images