Fueling system, fueling method, and fueling program

Abstract

This enables proper fuel supply control. [Solution] The refueling system is a first refueling lane among multiple refueling lanes that stops at the first refueling lane. A first image acquisition unit acquires first image information in which at least a part of the vehicle is photographed, and the first image Second image information is obtained in which at least a portion of the first vehicle is photographed within a different shooting range than the information provided. The second image acquisition unit and, based on the first image information, determine the refueling process in the first refueling lane. A first determination unit performs a determination, and based on the second image information, determines the first vehicle in the first refueling lane. A second determination unit makes a determination regarding refueling, and the result of the determination by the first determination unit and the second determination unit Based on the result of the determination, the first refueling of the first vehicle in the first refueling lane is carried out. It includes an execution information output unit that outputs refueling execution information.

Description

Technical Field

[0001] The present invention relates to a fuel supply system, a fuel supply method, and a fuel supply program.

Background Art

[0002] In self-service gas stations and service stations (hereinafter collectively referred to as "SS"), staff with the qualification to handle dangerous goods are constantly monitored to prevent dangerous acts such as smoking by users and illegal acts such as fueling portable cans other than vehicles. For example, an image taken by a monitoring camera near a fueling device (meter) is monitored in real time by staff from inside a building or the like using a monitor, and a user can fuel only when fueling is permitted. Such a mechanism is common.

[0003] In recent years, in order to reduce the burden on staff monitoring fueling devices or eliminate the need to constantly deploy such staff at SS, etc., self-service fueling systems that monitor dangerous acts of users and judge whether to permit fueling have been considered. For example, Patent Document 1 discloses a system that determines whether a predetermined condition for permitting fueling by a fueling device is satisfied based on the analysis result of the acquired video and permits fueling by the fueling device. <000-0021>

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In such a determination, for example, the fuel nozzle is detected, and the fuel nozzle is correctly positioned in the fuel filler. It is assumed that the condition for permission to refuel will be that it is inserted into the device. However, the location of the user and Depending on the vehicle's position, the fuel nozzle may not be detected, or it may not be properly inserted into the fuel filler opening. Because it may not be able to detect that you are refueling, refueling may start even if you are not engaging in any dangerous behavior. A situation may arise where this is not possible.

[0006] This invention has been made in view of the above problems, and aims to enable appropriate fuel supply control. This is the purpose. [Means for solving the problem]

[0007] A fueling system according to one aspect of the present invention is a system that stops at the first fueling lane among a plurality of fueling lanes. A first image acquisition unit acquires first image information in which at least a part of the first vehicle being driven is photographed. , the second image information shows at least a portion of the first vehicle taken within a different shooting range than the first image information. A second image acquisition unit acquires information, and based on the first image information, refueling in the first refueling lane... A first determination unit makes a determination regarding the first refueling lane, and based on the second image information, the first determination unit makes a determination regarding the first refueling lane. A second determination unit that makes a determination regarding refueling of a vehicle, and the result of the determination by the first determination unit and the second Based on the determination result by the determination unit, the refueling of the first vehicle in the first refueling lane will be performed. It includes an execution information output unit that outputs first refueling execution information relating to the above. [Effects of the Invention]

[0008] According to the present invention, appropriate fuel supply control becomes possible. [Brief explanation of the drawing]

[0009] [Figure 1] It is a diagram showing an outline of a configuration example of a fueling system 1 which is an embodiment of the present invention. [Figure 2] It is a diagram showing an example of arrangement of devices in SS2. [Figure 3] It is a flowchart showing an example of processing in the fueling system 1. [Figure 4] It is a flowchart showing an example of processing in the fueling system 1.

Mode for Carrying Out the Invention

[0010] FIG. 1 is a diagram showing an outline of a configuration example of a fueling system 1 which is an embodiment of the present invention. The fueling system 1 of the present embodiment may include an information processing device 10, a fueling device 20, and a camera 30 in SS2, and may be connected via a network to a terminal 41 installed in a monitoring room 40 as necessary. SS2 is, for example, a facility where a vehicle user conducts fueling of a vehicle, and may be a so-called self-service gas station. Here, the fueling device 20 is a device that receives information on the type of fueling such as premium gasoline or regular gasoline and the amount of fueling by the operation of the user, and executes fueling to the user's vehicle. The fueling device 20 may be called a fuel dispenser. The fueling device 20 may include, for example, an input / output device and each fueling nozzle for fueling premium gasoline, regular gasoline, or light oil. Examples of the input / output device include an image input / output device such as a touch panel that receives the operation of the user and presents information to the user, and a voice input / output device such as a microphone that collects the voice of the user and a speaker that conveys information to the user by voice.

[0011]

[0012] For example, the user inputs information about the type of fuel and the amount of fuel to the fueling device 20, and the nozzle Remove the fuel nozzle from the fuel container, insert the fuel nozzle into the vehicle's fuel filler opening, and then the lever of the fuel nozzle Fueling can be performed by pulling the lever. Furthermore, the fueling device 20 is, for example, an information processing device. Based on the results of the determinations made by the first determination unit 13 and the second determination unit 14, the execution information output unit 15 of 10 After receiving the refueling start information, the user pulls the lever on the refueling nozzle that has been removed from the nozzle holder. When doing so, you may release high-octane gasoline or similar from the nozzle tip. Perform this type of refueling. The series of actions that users perform for this purpose is also called the "refueling process."

[0013] The fueling device 20 will either reach the predetermined fueling amount specified by the user, or the tip of the fueling nozzle will reach the sensor. When the system detects that the vehicle's tank is full, refueling can be stopped. Yes, it is possible. In addition, separately from this, the execution information output unit 15, the first determination unit 13 and the second determination unit 1 Based on the result of the determination in step 4, refueling stop information is output to the refueling device 20, and the refueling device 20 executes. Fueling can also be stopped when fueling stop information is received from the information output unit 15. At that time, the input / output device of the refueling device 20 outputs information indicating the reason for stopping or the conditions for restarting refueling. You may inform the users.

[0014] Camera 30 captures at least a portion of a user's vehicle parked in a refueling lane. To take a photograph. Camera 30, when taking a photograph of at least a part of the vehicle, also captures the user's The system will capture images of actions, situations, vehicle conditions, and refueling lane conditions. SS2 will have multiple cameras. Camera 0 is installed. Each of the multiple cameras 30 is positioned at each of the multiple refueling lanes. It may be installed to photograph at least a portion of the vehicle being photographed.

[0015] The monitoring room 40 is equipped with a terminal 41 for use by a monitor who monitors refueling at the refueling device 20. The monitor, for example, monitors SS2 from the monitoring room via terminal 41. Monitoring room 40 It may be installed within the premises of SS2, or at a different location (remote location) from SS2. It may be installed in the refueling lane. The monitor uses terminal 41 to operate the refueling device 20 and in the refueling lane. The operator may perform an operation to permit or deny refueling.

[0016] Figure 2 illustrates an example of the equipment layout in SS2. This diagram shows an example of the arrangement. SS2 has a first refueling lane 210 and a second refueling lane 220. There are multiple refueling lanes, each including, for example, a refueling device 20( For example, first refueling device 211, second refueling device 221), camera 30 (for example, first camera Each refueling lane is equipped with a second camera (212, 222). Vehicle 1 (213) and vehicle 2 (223) may stop.

[0017] The first camera 212 is located on at least a part of the first vehicle 213, for example, the first camera 212 of the first vehicle 213. Surface 1 214, and at least a portion of the second vehicle 223, for example, the third surface 224 of the second vehicle. The camera captures images and generates first image information. The second camera 222 captures at least the first vehicle 213. For example, the second surface 215 of the first vehicle 213, and at least a portion of the second vehicle 223. For example, the fourth side 225 of the second vehicle is photographed, and second image information is generated. Image 2 shows at least a portion of vehicle 213 in a different shooting range than image 1. This is shadowed image information.

[0018] On the other hand, the first camera 212 captures the parts that are in the shadow of the first vehicle 213 and the second vehicle 223, for example If so, it is possible to photograph the second side 215 of the first car 213 and the fourth side 225 of the second car 223. It is not possible. Also, the second camera 222 is obscured by the first vehicle 213 and the second vehicle 223. For example, photograph the first side 214 of the first vehicle 213 and the third side 224 of the second vehicle 223. It is not possible.

[0019] When granting permission for refueling in refueling system 1, for example, a refueling device installed in the refueling lane The condition of the refueling lane, the surrounding environment, and the low activity of users using the refueling lane. If it is confirmed that refueling the vehicle is safe based on any of the above, then refueling will be performed. Permission granted. This verification will be performed by an automated system based on the results of analyzing the image information, or by a human monitor. This includes manual verification by the child, or verification combining the child verification and manual verification. The state of the oil device 20 is, for example, whether or not the fuel nozzle is securely inserted into the vehicle's fuel filler port. This includes the state of the surrounding environment of the refueling lane, for example, whether a fuel can is placed there. This includes conditions related to whether or not there is a fire source (cigarette, etc.). The user's behavior, for example, whether or not the user is behaving inappropriately, in particular, for example, Regarding the status of whether or not a portable fuel can is being held, and whether or not a source of fire (cigarettes, etc.) is being held. This includes the state of doing so.

[0020] In this regard, if a fuel filler is provided on one side of the vehicle, the fuel filler in the first vehicle 213 Depending on the positional relationship between the surface on which the first lubrication device 211 is located, the first camera 212 may be positioned as follows: It may not be possible to photograph the fuel filler cap of vehicle 213. In such cases, the fuel filler cap is not visible. Since it is not possible to confirm whether the lubricant has been properly inserted, the first determination unit 13, described later, It is not possible to make a judgment regarding refueling in the first refueling lane. Also, the first vehicle 2 The environmental conditions in the shaded area of ​​13 cannot be captured by the first camera 212. Furthermore, if a user is in the shadow of the first vehicle 213, the first camera 212 will monitor the user's actions. It is not possible to photograph the image. In these cases, the first determination unit 13, described later, determines the first image information ( For example, based on the image information captured by the first camera 212, the first refueling lane 210 It is not possible to make a determination regarding refueling the first vehicle 213 in the following case. The determination unit 14 determines based on the second image information (for example, image information captured by the second camera 222). Next, a determination is made regarding the refueling of the first vehicle 213 in the first refueling lane 210. As a result, the refueling system 1 receives first image information (for example, images taken by the first camera 212). Based on the image information, a determination is made regarding the refueling of the first vehicle 213 in the first refueling lane 210. Even if it is not possible to do so, second image information (for example, captured by the second camera 222) Based on the provided image information, refueling of the first vehicle 213 in the first refueling lane 210 It is possible to make a determination regarding this.

[0021] In Figure 2, the first refueling lane 210 and the second refueling lane 220 are adjacent to each other. Although indicated as a refueling lane, the first refueling lane 210 and the second refueling lane 220 These may be refueling lanes that are not adjacent to each other.

[0022] The information processing device 10 is implemented, for example, by a dedicated or general-purpose information processing terminal such as a PC. Furthermore, the HDD (Hard Disk Drive) is controlled by a CPU (Central Processing Unit) which is not shown in the diagram. The OS (Operating System) deployed onto memory from a storage device such as an SSD (Solid State Drive) middleware such as ystem and DBMS (Database Management System), and running on top of them. The software may be configured to perform various functions by executing the software.

[0023] As shown in Figure 1, this information processing device 10 comprises a first image acquisition unit 11, a second image acquisition unit 1 2. It has a first determination unit 13, a second determination unit 14, an execution information output unit 15, and a notification unit 16. These parts may, for example, use a memory or other storage area, or store in a memory area. This is achieved by the processor executing a pre-programmed script.

[0024] The first image acquisition unit 11 captures the first refueling lane 210 of the multiple refueling lanes. First image information is obtained in which at least a portion of vehicle 213 is photographed.

[0025] The first image information includes, for example, image information of the first surface 214 of the first vehicle 213. .

[0026] The image information may be a video or a still image. For example, the first image acquisition unit 11, The recorder, which works in conjunction with camera 30 to continuously record image data, records information such as the arrival of users. You could also set it up so that the necessary image data is extracted when a specific event occurs. Alternatively, the image data sent from camera 30 may be acquired directly. 11 The camera 30's orientation, magnification, shooting range, etc., can be controlled by staff such as security personnel. It may also have a function to change it dynamically.

[0027] The second image acquisition unit 12 captures images of the first vehicle 213 in a shooting range different from that of the first image information. We also obtain second image information, which includes a portion of the captured image.

[0028] The second image information includes, for example, a photograph of the second side 215 of the first vehicle 213, which is different from the first side 214. Includes shadowed image information.

[0029] Furthermore, the second image information includes, for example, the second refueling lane 22 which is different from the first refueling lane 210. Image of 0 (for example, the second refueling lane 220 adjacent to the first refueling lane 210) It may include information. Also, in this case, the second image information is that the vehicle is stopped in the second refueling lane 220. This could also be image information showing at least a portion of the second vehicle 223.

[0030] In the first image information, the location where at least a portion of the first vehicle 213 was photographed is shown in the second image. In the information, at least a portion of the first vehicle 213 was in the center of the image rather than the position where it was photographed. This may also be the case. In other words, the first image information is, for example, the first vehicle 213 in the first refueling lane. This may also be image information captured by the first camera 212, which is installed to take pictures. The second image information is captured by the second camera installed to photograph the second vehicle 223 in the second refueling lane. The image information may be captured by camera 222, and may also be from locations other than the refueling lane (for example). The second camera 222, which was installed to photograph the entrances and exits of SS2 and the exterior of the monitoring room, Image data from a photograph is also acceptable.

[0031] Furthermore, in the second image information, the second refueling lane 220 is more image-wise than the first refueling lane 210. This could also be image information captured in the center. In other words, the second image information is the second refueling. Image information captured by the second camera 222, which was positioned to photograph the second vehicle 223 in the lane. It may be reported.

[0032] Thus, in relation to the first refueling lane 210, for example, the first image information relates to refueling. The first image is essentially the main image used when making a determination, while the second image information is essentially a sub-image. Furthermore, in relation to the second refueling lane 220, for example, the first image information is used for determining refueling. The first image is essentially a sub-image used in this process, while the second image information is essentially the main image.

[0033] The first determination unit 13 determines, based on the first image information, the refueling in the first refueling lane 210. A determination (first determination) is made, and first determination result information regarding the result of that determination is generated. The result may be, for example, permission to refuel, denial of refueling, or inability to determine.

[0034] The first determination unit 13 is installed in the first refueling lane 210 in the first image information. The status of the first refueling device 211, the status of the surrounding environment of the first refueling lane 210, the first refueling lane Based on at least one of the actions of users using 210, the first refueling lane 210 A determination can be made regarding the refueling of the first vehicle 213 in the above. Specifically, the first determination The fixed part 13, for example, when it is confirmed that the fuel nozzle is securely inserted, fuel The approval decision result may be output, and it may also be confirmed that the fuel nozzle is not securely inserted. If confirmed, a result of refueling denial may be output, and the refueling nozzle must be securely inserted. If it cannot be confirmed that the item is present, a result of "undeterminable" may be output. The first determination unit 13, for example, if it confirms that there are no fuel cans or open flames nearby, will proceed with refueling. The approval decision result may be output, and if a fuel can or flame is confirmed, refueling may be permitted. It is acceptable to output a result indicating that permission is denied, and it is also confirmed that there are no fuel cans or open flames nearby. If it is not possible, the determination result of "undeterminable" may be output. Also, the first determination unit 13 may use If it is confirmed that the person has not engaged in inappropriate behavior, the refueling permission decision will be output. In addition, if it is confirmed that a user is behaving inappropriately, refusal of refueling may occur. The judgment result may be output, and it is not possible to confirm whether or not the user is behaving inappropriately. In some cases, an "undetermined" result may be output.

[0035] When the first determination unit 13 outputs a determination result of "cannot determine", in the first refueling lane 210 Output "Unable to determine" information indicating that a determination cannot be made regarding refueling of vehicle 213 (No. 1). This is possible. For example, the first determination unit 13 captures the state of the first refueling device 211 in the first image information. If the image is not captured, for example, if the fuel nozzle of the first fueling device 211 is not photographed. In this case, a determination cannot be made regarding refueling the first vehicle 213 in the first refueling lane 210. It can output information indicating that a determination is not possible.

[0036] The first determination unit 13 analyzes the first image information using an image determination model or algorithm, The state of the first refueling device 211 installed in the first refueling lane 210, the state of the first refueling lane 210 The condition of the surrounding environment and at least one of the behaviors of users using the first refueling lane 210 The system will be evaluated, and based on the results of the evaluation, the first vehicle 213 in the first refueling lane 210 will be supplied. A determination is made regarding refueling. Here, the image determination model or algorithm used by the first determination unit 13 The term "zum" is not particularly limited, and any publicly available term may be used as appropriate.

[0037] Furthermore, the first determination unit 13 determines, based on the second image information, the second refueling lane 220 The system can make a determination (third determination) regarding refueling of vehicle 223. Therefore, the processing of the third determination based on the second image information is the same as the first determination processing based on the first image information. It appears that way.

[0038] The second determination unit 14, based on the second image information, determines whether to supply fuel to the first vehicle in the first refueling lane. A determination regarding oil (second determination) is made, and first determination result information related to the result of that determination is generated. The result of the determination may be, for example, refueling permitted, refueling not permitted, or inability to determine.

[0039] The second determination unit 14 is installed in the first refueling lane 210 in the second image information. The status of the first refueling device 211, the status of the surrounding environment of the first refueling lane 210, the first refueling lane Based on at least one of the actions of users using 210, the first refueling lane 210 A determination can be made regarding the refueling of the first vehicle 213 in the following case. Specifically, the second determination The fixed part 14, for example, when it is confirmed that the fuel nozzle is securely inserted, fuel The approval decision result may be output, and it may also be confirmed that the fuel nozzle is not securely inserted. If confirmed, a result of refueling denial may be output, and the refueling nozzle must be securely inserted. If it cannot be confirmed that the item is present, a result of "undeterminable" may be output. The second determination unit 14, for example, if it confirms that there are no fuel cans or open flames nearby, will proceed with refueling. The approval decision result may be output, and if a fuel can or flame is confirmed, refueling may be permitted. It is acceptable to output a result indicating that permission is denied, and it is also confirmed that there are no fuel cans or open flames nearby. If it is not possible, a determination result of "undeterminable" may be output. Also, the second determination unit 14 may use If it is confirmed that the person has not engaged in inappropriate behavior, the refueling permission decision will be output. In addition, if it is confirmed that a user is behaving inappropriately, refusal of refueling may occur. The judgment result may be output, and it is not possible to confirm whether or not the user is behaving inappropriately. In some cases, an "undetermined" result may be output.

[0040] When the second determination unit 14 outputs a determination result of "undeterminable", in the first refueling lane 210 Output "Unable to determine" information indicating that a determination cannot be made regarding refueling of vehicle 213 (No. 1). This is possible. For example, the second determination unit 14 captures the state of the first refueling device 211 in the second image information. If the image is not captured, for example, if the fuel nozzle of the first fueling device 211 is not photographed. In this case, a determination cannot be made regarding refueling the first vehicle 213 in the first refueling lane 210. It can output information indicating that a determination is not possible.

[0041] Specifically, the second determination unit 14 uses an image determination model or algorithm to determine the second image information By analyzing the data, the state of the first refueling device 211 installed in the first refueling lane 210, and the first refueling lane The surrounding environment of lane 210, and the behavior of users using the first refueling lane 210, The first vehicle in the first refueling lane 210 will be evaluated based on the results of the evaluation. A determination is made regarding refueling of both 213s. Here, the second determination unit 14 uses an image determination model. Alternatively, the algorithm is not particularly limited, and any publicly known algorithm may be used as appropriate.

[0042] The second determination unit 14, in accordance with the undeterminable information output by the first determination unit 13, applies the second image information to the second image information. Based on this, a determination is made regarding the refueling of the first vehicle 213 in the first refueling lane 210. This allows the second determination unit 14 to make a determination if the first determination unit 13 determines that a determination is not possible. This allows for a second judgment process to be performed, reducing the processing load.

[0043] Furthermore, the second determination unit 14 determines, based on the first image information, the first refueling lane 210 A determination (fourth determination) regarding refueling of vehicle 213 can be made in the second determination unit 14. Therefore, the processing of the fourth determination based on the first image information is the same as the second determination processing based on the second image information. It appears that way.

[0044] The execution information output unit 15 outputs the result of the first determination by the first determination unit 13 (i.e., for example, the first 1) Judgment result information) and the result of the second judgment by the second judgment unit 14 (i.e., for example, the second judgment Based on at least one of the (fixed result information), the first vehicle in the first refueling lane 210 Outputs the first refueling execution information regarding the refueling of vehicle 213.

[0045] Specifically, the execution information output unit 15 determines whether the first determination unit 13 grants permission for refueling based on the first image information. If deemed acceptable, refueling of the first vehicle 213 in the first refueling lane 210 will be initiated. The system can output refueling start information as the first refueling execution information.

[0046] Furthermore, the execution information output unit 15 determines that the second determination unit 14 has given permission for refueling based on the second image information. If this is determined, in order to start refueling the first vehicle 213 in the first refueling lane 210, The refueling start information can be output as the first refueling execution information. At this time, the execution information The output unit 15 is used when the first determination unit 13 determines that it is impossible to determine based on the first image information, and If the second determination unit 14 determines that refueling is permitted based on the second image information, the first refueling lane will be opened. The refueling start information for initiating refueling of the first vehicle 213 at 210 is provided to the first refueling operation The output may be as line information. This allows the refueling system 1 to perform the operation based on the first image information. In cases where a determination cannot be made regarding refueling the first vehicle 213 in the first refueling lane 210. Even if present, based on the second image information, to the first vehicle 213 in the first refueling lane 210 It can make decisions regarding refueling.

[0047] Furthermore, the execution information output unit 15 determines that the first determination unit 13 has decided to deny refueling based on the first image information. If a determination is made, the refueling of the first vehicle 213 in the first refueling lane 210 will be stopped. It can output information indicating when refueling should be stopped. In this embodiment, the refueling stop is... Transitioning from a refueling state to a non-refueling state, and maintaining the non-refueling state. This includes holding.

[0048] Furthermore, the execution information output unit 15 indicates that the second determination unit 14 has determined that refueling is not permitted based on the second image information. If a determination is made, the refueling of the first vehicle 213 in the first refueling lane 210 will be stopped. It can output information to stop refueling. At this time, the execution information output unit 15 performs a first determination. If unit 13 determines that it is impossible to determine based on the first image information, and the second determination unit 14 determines that the second If it is determined that refueling is not permitted based on the image information, the first vehicle in the first refueling lane 210 The system may output fuel stop information to stop fuel supply to both 213 units. System 1, based on the first image information, determines the first vehicle 213 in the first refueling lane 210. Even if a determination regarding refueling to the first fuel level cannot be made, the second image information can be used to determine the first refueling level. A determination can be made regarding refueling the first vehicle 213 in the line 210.

[0049] Furthermore, the execution information output unit 15 outputs the result of the third determination by the first determination unit 13 and the second determination unit 1 Based on the result of the fourth determination by 4, the second vehicle 223 in the second refueling lane 220 Second refueling execution information regarding the execution of refueling can be output. Therefore, the processing related to the second refueling execution information is the same as the processing related to the first refueling execution information.

[0050] The execution information output unit 15 may, for example, output the first refueling execution information to the terminal 41. In this case, the monitoring officer using terminal 41 will refer to the first refueling execution information through terminal 41, and Authorization is given to the oiling device 20 to perform refueling of the first vehicle 213 in the first refueling lane 210. Then, the refueling device 20 refuels the first vehicle 213 in the first refueling lane 210. Start.

[0051] Furthermore, the execution information output unit 15 outputs, for example, refueling start information to initiate refueling, to the first The refueling execution information may also be output to the refueling device 20. In this case, the refueling device 20 will, for example, Based on the first refueling execution information, refueling of the first vehicle in the first refueling lane will begin.

[0052] Furthermore, the execution information output unit 15 outputs the result of the first determination by the first determination unit 13 and the second determination unit 1 Based on the result of the second determination by 4, the fuel supply stop information to stop fuel supply is sent to the fuel supply device. It may also be output to 20. In this case, the execution information output unit 15 outputs the result of the first determination and the second determination. If the system does not indicate permission to refuel, it may output information indicating that refueling has been stopped.

[0053] Furthermore, the execution information output unit 15 automatically determines the reason for stopping and opens the fuel supply to the fuel supply device 20. Instead of issuing an instruction to start or stop refueling, the execution information output unit 15 outputs the determined reason for stopping to the terminal. Even if a signal is sent to 41 and the supervisor manually instructs the refueling device 20 to start or stop refueling, Good. Also, if the rate of detecting dangerous behavior is high, the execution information output unit 15 will automatically dispense fuel. The vehicle 20 was instructed to start or stop refueling, and the rate of determination of dangerous behavior was moderate, so the decision was either to permit or deny. If such a judgment is possible, the supervisor will manually start or begin refueling the refueling device 20. Automatic and manual judgments may be combined as appropriate, such as issuing a stop command. If the success rate is high, for example, at least one of the results of the first and second judgments However, it may also be the case that refueling is not permitted. Also, if the rate of dangerous behavior is moderate. It is also possible that the result of the first determination and the result of the second determination are indeterminate.

[0054] The notification unit 16 makes a determination regarding refueling in the first refueling lane 210 made by the second determination unit 14. If this is not possible, the monitor monitoring the first refueling lane 210 will be notified. For example, unit 16 provides a terminal 41 used by a supervisor, with a first determination unit 13 and a second determination unit 14. The system outputs a notification indicating that it is not possible to make a determination regarding refueling in the first refueling lane 210. This is also good. This allows the monitor to perform an automatic judgment by the first judgment unit 13 and the second judgment unit 14. It becomes possible to understand what cannot be determined, for example, the status of the refueling lane through the monitor. This can be confirmed.

[0055] Furthermore, if the second determination unit 14 does not determine that refueling is permitted, the notification unit 16 will notify the supervisor. This may be done. This allows the supervisor to, for example, check the status of the refueling lane through a monitor. It is possible.

[0056] Figure 3 is a flowchart showing an example of the process in refueling system 1. The flowchart shows an example of the process for refueling the first vehicle in the first refueling lane.

[0057] First, the first image acquisition unit 11 acquires the first image information (S301). First determination unit 13 However, based on the first image information, a determination is made regarding refueling in the first refueling lane 210. S302). If the first determination unit 13 determines that refueling is permitted (S302: YES), execution information The output unit 15 outputs the first unit relating to the execution of refueling the first vehicle 213 in the first refueling lane 210. 1. Output refueling execution information (S303).

[0058] If the first determination unit 13 does not determine that refueling is permitted (S302: NO), the second image acquisition unit 12 The second image information is acquired (S304). The second determination unit 14 determines, based on the second image information, A determination is made regarding refueling in the first refueling lane 210 (S305). The second determination unit 14 If it is determined that refueling is permitted (S305: YES), the execution information output unit 15 will output the first refueling lane. Output first refueling execution information regarding the execution of refueling the first vehicle 213 in 210 (S 303).

[0059] If the second determination unit 14 does not determine that refueling is permitted (S305: NO), the notification unit 16 will indicate the first Output a notification that a determination regarding refueling in refueling lane 210 cannot be made (S30 6).

[0060] Figure 4 is a flowchart showing an example of the process in refueling system 1. The flowchart shows the process for refueling the second vehicle 223 in the second refueling lane 220. Here is an example.

[0061] First, the second image acquisition unit 12 acquires the second image information (S401). First determination unit 13 However, based on the second image information, a determination is made regarding refueling in the second refueling lane 220. S402). If the first determination unit 13 determines that refueling is permitted (S402: YES), execution information The output unit 15 outputs the second unit relating to the execution of refueling the second vehicle 223 in the second refueling lane 220. 2. Output refueling execution information (S403).

[0062] If the first determination unit 13 does not determine that refueling is permitted (S402: NO), the first image acquisition unit 11 The first image information is acquired (S404). The second determination unit 14 determines, based on the first image information, A determination is made regarding refueling in the second refueling lane 220 (S405). The second determination unit 14 If it is determined that refueling is permitted (S405: YES), the execution information output unit 15 will output the second refueling lane. Output second refueling execution information regarding the execution of refueling the second vehicle 223 in 220 (S 403).

[0063] If the second determination unit 14 does not determine that refueling is permitted (S405: NO), the notification unit 16 will indicate the second Output a notification that a determination regarding refueling in refueling lane 220 cannot be made (S40 6).

[0064] An embodiment of the present invention has been specifically described above. The refueling system 1 receives the first image information Acquire the first image information, acquire the second image information, and based on the first image information, in the first refueling lane 210 A first determination is made regarding refueling the first vehicle 213, and based on the second image information, the first refueling is performed. A second determination is made regarding refueling of the first vehicle 213 in lane 210, and the result of the first determination is... Based on the results of the second determination, the first refueling execution information can be output. The refueling system 1, for example, when it is not possible to make a refueling determination based solely on the first image information. Even if there is a second image, a decision regarding refueling can be made based on that information, and appropriate It can control fuel supply.

[0065] Furthermore, the refueling system 1 captures at least a portion of the first vehicle 213 in the first image information. The shadowed location is where at least a portion of the first vehicle 213 was photographed in the second image information. It is possible to obtain first and second image information that is centered in the image rather than being placed in a specific location. As a result, the refueling system 1, in relation to the first refueling lane 210, can be considered a sub-image. Based on the corresponding second image information, a decision regarding refueling can be made, and appropriate refueling control can be implemented. It is possible.

[0066] Furthermore, the refueling system 1 receives first image information of the first surface 214 of the first vehicle 213 and Furthermore, we will acquire second image information of the first vehicle, specifically of the second side 215, which is different from the first side 214. This makes it possible. As a result, the refueling system 1 is in relation to the first refueling lane 210. Based on the second image information corresponding to the sub-image, a decision regarding refueling can be made, and It allows for precise fuel supply control.

[0067] Furthermore, the refueling system 1 is equipped with a second refueling lane 220 that is different from the first refueling lane 210. The second image information, which is shadowed, can be obtained.

[0068] Furthermore, the refueling system 1 is at least for the second vehicle 223 that stops in the second refueling lane 220. Second image information, which partially captures the scene, is acquired, and based on the second image information, the second refueling lane 2 A third determination is made regarding the refueling of the second vehicle 223 in 20, based on the first image information. , a fourth determination is made regarding the refueling of the second vehicle 223 in the second refueling lane 220, and the third Based on the results of the first and fourth judgments, the second vehicle 22 in the second refueling lane 220 Second refueling execution information regarding the refueling of unit 3 can be output. System 1 can make a determination regarding the execution of refueling in the second refueling lane 220. ru.

[0069] Furthermore, the refueling system 1 has a second refueling lane 220 that is more image-wise than the first refueling lane 210. Second image information captured in the center can be obtained. This allows the refueling system 1 This is based on the first image information, which is, so to speak, a sub-image in relation to the second refueling lane 220. This allows for the determination of refueling requirements and enables appropriate refueling control.

[0070] Furthermore, the refueling system 1 is installed in the first refueling lane 210 in the first image information. Status of the first refueling device 211, status of the surrounding environment of the first refueling lane 210, first refueling lane 2 Based on at least one of the actions of users using 10, the first refueling lane 210 A first determination is made regarding the refueling of the first vehicle 213 in the second image information, The state of the first refueling device 211 installed in the oil lane 210, and the surrounding area of ​​the first refueling lane 210. Based on the boundary conditions and at least one of the actions of users using the first refueling lane, A second determination can be made regarding the refueling of the first vehicle 213 in the first refueling lane 210. As a result, the refueling system 1 analyzes the first image information and the second image information to determine the refueling process. It is possible to make decisions regarding execution.

[0071] Furthermore, the refueling system 1 captures the state of the first refueling device 211 in the first image information. If not, the first determination regarding refueling the first vehicle 213 in the first refueling lane 210 is It outputs "cannot be determined" information indicating that it is not possible, and based on the "cannot be determined" information, it uses the second image information. Then, a second determination is made regarding the refueling of the first vehicle 213 in the first refueling lane 210. This makes it possible for the refueling system 1 to make a first determination based on the first image information. In some cases, a second determination can be made based on the second image information, thereby reducing the processing load. Cut.

[0072] Furthermore, the refueling system 1 can make a second determination regarding refueling in the first refueling lane 210. If not, the monitor watching the first refueling lane 210 can be notified. Furthermore, the refueling system 1 can request confirmation from a supervisor at an appropriate time.

[0073] This embodiment is provided to facilitate understanding of the present invention, and the present invention is not based on the above-mentioned practical aspects. It is not limited to the form of implementation, and various modifications are possible as long as they do not deviate from its essence. Needless to say, the above embodiments are described in detail in order to explain the present invention in an easy-to-understand manner. This is a detailed explanation and does not necessarily limit the system to those possessing all the described components. There is no such thing. Also, regarding some of the configurations of the above embodiments, the addition, deletion, and replacement of other configurations are not permitted. It is possible to do so.

[0074] Furthermore, each of the above-mentioned configurations, functions, processing units, processing means, etc. may be partially or entirely modified, for example. Alternatively, it may be implemented in hardware by designing it with an integrated circuit. Also, each of the above configurations, The functions and so on depend on the processor interpreting and executing the programs that implement each function. It could be implemented more effectively in software. Programs, tables, and files to implement each function. This information is stored on memory, hard disks, SSDs, or other storage devices, or on IC cards, SD cards, etc. It can be stored on recording media such as DVDs and other media.

[0075] Furthermore, in each of the above diagrams, control lines and information lines are shown only if they are deemed necessary for explanation. Therefore, it does not necessarily show all control lines and information lines in the actual implementation. In reality, almost none It can be assumed that all components are interconnected. [Industrial applicability]

[0076] This invention relates to a refueling system in self-service gas stations and service stations. It is available for use with the system. [Explanation of symbols]

[0077] 1 Fueling system, 10 Information processing device, 11 First image acquisition unit, 12 Second image acquisition unit , 13 First determination unit, 14 Second determination unit, 15 Execution information output unit, 16 Notification unit, 20 Fueling equipment, 30 cameras, 40 monitoring rooms, 41 terminals, 210 first fueling lane, 211 1st refueling device, 212 1st camera, 213 1st vehicle, 214 1st surface, 215 2nd side, 220 Second refueling lane, 221 Second refueling device, 222 Second camera, 223 Car No. 2, 224 (side 3), 225 (side 4)

Claims

1. At least a portion of the first vehicle, which was stopped in the first refueling lane of several refueling lanes, was photographed. A first image acquisition unit that acquires the first image information, The first image information is obtained by photographing at least a part of the first vehicle in a different shooting range than the first image information. A second image acquisition unit that acquires two image information, Based on the first image information, a determination is made regarding refueling in the first refueling lane.

1. Judgment unit, Based on the second image information, regarding the refueling of the first vehicle in the first refueling lane A second determination unit that makes a determination, Based on the result of the determination by the first determination unit and the result of the determination by the second determination unit, Output first refueling execution information regarding the execution of refueling the first vehicle in the first refueling lane. An execution information output unit, A refueling system equipped with the following features.

2. The position in which at least a part of the first vehicle is photographed in the first image information is the 2. In the image information, at least a part of the first vehicle is located in the center of the image, A refueling system according to claim 1.

3. The first image information includes image information of the first surface of the first vehicle, The second image information is an image of the first vehicle, taken from a second side that is different from the first side. Information included, The refueling system according to claim 1.

4. The second image information is an image taken of a second refueling lane that is different from the first refueling lane. A refueling system according to any one of claims 1 to 3, including information.

5. The second image information is captured by photographing at least a portion of the second vehicle parked in the second refueling lane. Includes the image information, Based on the second image information, the first determination unit determines the second refueling lane Further decisions will be made regarding refueling the two vehicles. The second determination unit determines, based on the first image information, the second refueling lane Further decisions will be made regarding refueling the two vehicles. The execution information output unit receives the result of the determination by the first determination unit and the determination by the second determination unit. Based on the results, the execution of refueling the second vehicle in the second refueling lane relates to Further output information on the second refueling operation. The refueling system according to claim 4.

6. The second image information indicates that the second refueling lane is centered in the image more than the first refueling lane. The refueling system according to claim 4, including captured image information.

7. Claim 4, wherein the second refueling lane is a refueling lane adjacent to the first refueling lane. The refueling system described.

8. The first determination unit determines the first image information which is installed in the first refueling lane. The status of the refueling equipment, the status of the surrounding environment of the first refueling lane, and the use of the first refueling lane Based on at least one of the user's actions, the first vehicle in the first refueling lane A decision will be made regarding refueling both vehicles. The second determination unit determines the first refueling lane installed in the second image information. The status of the refueling equipment, the status of the surrounding environment of the first refueling lane, and the use of the first refueling lane Based on at least one of the user's actions, the first vehicle in the first refueling lane To make a decision regarding refueling both vehicles, A refueling system according to any one of claims 1 to 3.

9. The first determination unit determines that the state of the first fueling device is not captured in the first image information. In such cases, it is not possible to make a determination regarding the refueling of the first vehicle in the first refueling lane. Outputs information indicating that the determination is not possible. The second determination unit, in accordance with the information that cannot be determined, determines the second image information, A determination is made regarding the refueling of the first vehicle in one refueling lane. The refueling system according to claim 8.

10. If the second determination unit is unable to make a determination regarding refueling in the first refueling lane Claims 1 to further include a notification unit for notifying a monitor who monitors the first refueling lane. A refueling system as described in any one of item 3.

11. Computers At least a portion of the first vehicle, which was stopped in the first refueling lane of several refueling lanes, was photographed. Then, the first image information is obtained, The first image information is obtained by photographing at least a part of the first vehicle in a different shooting range than the first image information.

2. Obtain image information, Based on the first image information, a determination is made regarding refueling in the first refueling lane. Based on the second image information, regarding the refueling of the first vehicle in the first refueling lane Perform the following determination: Based on the result of the determination based on the first image information and the result of the determination based on the second image information The first refueling execution information relating to the execution of refueling the first vehicle in the first refueling lane. Output a report. Refueling method.

12. On the computer, At least a portion of the first vehicle, which was stopped in the first refueling lane of several refueling lanes, was photographed. A first image acquisition unit that acquires the first image information, The first image information is obtained by photographing at least a part of the first vehicle in a different shooting range than the first image information. A second image acquisition unit that acquires two image information, Based on the first image information, a determination is made regarding refueling in the first refueling lane.

1. Judgment unit, Based on the second image information, a determination is made regarding refueling in the first refueling lane.

2. Judgment unit, Based on the result of the determination by the first determination unit and the result of the determination by the second determination unit, Output first refueling execution information regarding the execution of refueling the first vehicle in the first refueling lane. An execution information output unit, A refueling program designed to achieve this.

Images