Fueling system, fueling method, and program

Abstract

The objective is to provide a refueling system, refueling method, and program that enable appropriate refueling control. [Solution] A refueling system comprising: an acquisition unit that acquires image information of a user performing refueling; a control unit that stops refueling when the user's actions in the refueling process, based on the image information, correspond to a predetermined reason for stopping; and an output unit that outputs information to the user indicating the reason for stopping or the conditions for restarting refueling.

Description

Technical Field

[0001] The present invention relates to a fuel supply system, a fuel supply method, and a program.

Background Art

[0002] At self-service gasoline stations and service stations (hereinafter collectively referred to as "SS"), staff with the qualification of a hazardous material handler are required to constantly monitor to prevent dangerous behaviors such as smoking by users and illegal behaviors such as fueling portable cans other than vehicles. For example, it is common to have a mechanism where staff monitors in real time, from inside a building or the like, an image taken by a surveillance camera near a fuel dispenser, and the user can fuel only when fueling is permitted.

[0003] In recent years, for the purpose of reducing the burden on staff monitoring the fuel dispenser or eliminating the need to constantly place such staff at the SS, the introduction of a self-service fuel supply system that monitors dangerous behaviors of users and determines whether to permit fueling has been considered. For example, Patent Document 1 discloses a system that determines whether a predetermined condition for permitting fueling by a fuel dispenser is satisfied based on the analysis result of the acquired video and permits fueling by the fuel dispenser.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In such a decision, for example, it is conceivable that the fuel nozzle would be detected and that the fuel nozzle being correctly inserted into the fuel filler opening would be a condition for permitting refueling. However, depending on the user's position and posture, the fuel nozzle may not be detected, or it may not be possible to detect that the fuel nozzle is correctly inserted into the fuel filler opening, which could result in refueling not starting even if no dangerous behavior is being committed.

[0006] This invention has been made in view of the above-mentioned problems, and aims to provide a refueling system, refueling method, and program that enable appropriate refueling control. [Means for solving the problem]

[0007] A refueling system according to one aspect of the present invention includes an acquisition unit that acquires image information of a user performing refueling, a control unit that stops refueling when the user's actions in the refueling process, based on the image information, correspond to a predetermined reason for stopping, and an output unit that outputs information to the user indicating the reason for stopping or the conditions for restarting refueling.

[0008] A refueling method according to one aspect of the present invention involves a refueling system that performs an acquisition step of acquiring image information of a user performing refueling, a stop step of stopping refueling when the user's actions in the refueling process, based on the image information, fall under a predetermined stop reason, and an output step of outputting information indicating the stop reason or conditions for restarting refueling to the user.

[0009] A program according to one aspect of the present invention causes a refueling system to perform an acquisition step of acquiring image information of a user performing refueling; a stop step of stopping refueling when the user's actions in the refueling process, based on the image information, fall under a predetermined stop reason; and an output step of outputting information indicating the stop reason or conditions for restarting refueling to the user. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a refueling system, a refueling method, and a program that enable appropriate refueling control. [Brief explanation of the drawing]

[0011] [Figure 1] This is a diagram showing the configuration of a refueling system, which is one embodiment of the present invention. [Figure 2] This is a flowchart illustrating an example of processing in a refueling system. [Modes for carrying out the invention]

[0012] One embodiment of the present invention will be described in detail below. Note that the following embodiment is illustrative for explaining the present invention and is not intended to limit the present invention to this embodiment alone. Furthermore, the present invention can be modified in various ways without departing from its essence. Moreover, those skilled in the art can adopt embodiments in which each of the elements described below is replaced with equivalent ones, and such embodiments are also included within the scope of the present invention. In addition, for the sake of ease of understanding, an embodiment in which the present invention is realized using an information processing device will be described as an example, but as stated above, the present invention is not limited thereto.

[0013] <System Configuration> Figure 1 is a diagram illustrating an example configuration of a refueling system according to one embodiment of the present invention. The refueling system 1 of one embodiment of the present invention may include an information processing device 10, a measuring device 20, and an imaging device 30 at the SS2, and may be connected via a network to a terminal 41 installed in a remote monitoring room 40 as needed.

[0014] Here, the metering machine 20 is a device that receives information regarding the type of fuel to be dispensed, such as premium gasoline or regular gasoline, and the amount to be dispensed, based on the user's operation, and then dispenses fuel. The metering machine 20 may, for example, include an input / output device and fuel nozzles for dispensing premium gasoline, regular gasoline, or diesel fuel. Examples of input / output devices include image input / output devices such as touch panels that receive user operations and present information to the user, and audio input / output devices such as microphones that collect the user's voice and speakers that convey information to the user by voice.

[0015] For example, a user can input information about the type and amount of fuel to be dispensed into the metering machine 20, remove the fuel nozzle from the nozzle holder, insert the fuel nozzle into the vehicle's fuel filler, and dispense fuel by pulling the lever on the fuel nozzle. Alternatively, the metering machine 20 may, for example, receive a fuel dispensing permission signal from the control unit 12 of the information processing device 10, and then, when the user pulls the lever on the fuel nozzle that has been removed from the nozzle holder, dispense high-octane gasoline or the like from the nozzle tip. This series of actions performed by the user to dispense fuel is also called the "fueling process."

[0016] The fuel dispenser 20 can stop refueling when it reaches a predetermined amount of fuel specified by the user, or when it detects that the vehicle tank is full using a sensor at the tip of the fuel nozzle or the like. Separately, the fuel dispenser 20 can also stop refueling when the control unit 12 of the information processing device 10 detects that the user's actions in the refueling process correspond to a predetermined reason for stopping, and the fuel dispenser 20 receives a refueling stop signal from the control unit 12. At this time, the input / output device of the fuel dispenser 20 may output information indicating the reason for stopping or the conditions for restarting refueling to inform the user.

[0017] The imaging device 30 captures images of users performing refueling. From the perspective of acquiring image information regarding the user's actions and circumstances, one imaging device 30 may be installed so that the fuel dispenser 20, the vehicle, and the user performing the refueling are all within its field of view, or multiple imaging devices 30 may be installed so that the fuel dispenser 20, the vehicle, and the user performing the refueling are each within their field of view. Alternatively, the field of view of one imaging device 30 may include multiple fuel dispensers 20, multiple vehicles, and multiple users.

[0018] The information processing device 10 may be implemented, for example, as a dedicated or general-purpose information processing terminal such as a PC, and may be configured to realize various functions by executing middleware such as an OS (Operating System) and DBMS (Database Management System), or software running on them, which are loaded into memory from a storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive), using a CPU (Central Processing Unit) (not shown).

[0019] As shown in Figure 1, this information processing device 10 may have an acquisition unit 11, a control unit 12, an output unit 13, and a notification unit 14. Each of these units is implemented, for example, by using a storage area such as memory, or by a processor executing a program stored in the storage area.

[0020] The acquisition unit 11 acquires image information related to the actions and situations of users captured by one or more imaging devices 30 installed in the SS2. The image information may be a video or a still image. For example, the acquisition unit 11 may retrieve image data within a necessary range triggered by the occurrence of a predetermined event such as the arrival of a user from a recorder that constantly records image data in cooperation with the imaging device 30, or may directly acquire the image data sent from the imaging device 30. Note that it is desirable to install one or more imaging devices 30 so that the vicinity of each meter 20 installed in the SS2 is set as the imaging range individually or in a plurality. Further, the acquisition unit 11 may have a function of dynamically changing the orientation, imaging magnification, imaging range, etc. of the imaging device 30 by remote operation of the staff.

[0021] Based on the image information, the control unit 12 determines whether the actions of the user in the refueling process correspond to a predetermined stop reason. Then, when it does not correspond to the stop reason, the control unit 12 transmits a refueling permission signal to the meter 20, and when it corresponds to the stop reason, the control unit 12 transmits a refueling stop signal to the meter 20. Also, when it corresponds to the stop reason during refueling, the control unit 12 may transmit a refueling stop signal to the meter 20 to stop refueling, and when it no longer corresponds to the stop reason, the control unit 12 may transmit a refueling permission signal to the meter 20 to resume refueling. Thus, the control unit 12 can control the meter 20 according to the presence or absence of the stop reason.

[0022] Specifically, when the actions of the user in the refueling process cannot be correctly recognized by the image determination model or algorithm, or when there is a situation with a high probability of dangerous or illegal actions or leading to such actions in the user's refueling process, etc., the control unit 12 determines whether it corresponds to a predetermined stop reason. Here, the image determination model or algorithm used by the control unit 12 is not particularly limited, and known ones can be appropriately used.

[0023] Examples where the behavior in the user's refueling process cannot be correctly recognized include cases where the tip of the fuel nozzle or the state where the fuel nozzle is inserted into the fuel inlet cannot be recognized in the image information due to the blind spot of the imaging device 30 or the positional relationship between the user and the vehicle.

[0024] In addition, examples of actions that are targets for rejecting refueling include, for example, smoking and possession of other sources of fire, refueling objects other than the vehicle such as portable cans, and operations of the meter 20 that do not follow the predetermined procedures. Specifically, such actions may be determined by recognizing objects in the image that may be related to these actions, such as cigarettes and portable cans.

[0025] Instead of the control unit 12 automatically determining the reason for stopping and instructing the meter 20 to start or stop refueling, the control unit 12 may transmit the determined reason for stopping to the terminal of the staff at SS2, and the staff may manually instruct the meter 20 to start or stop refueling. Also, when the determination rate of dangerous actions is high, the control unit 12 automatically instructs the meter 20 to start or stop refueling, and when the determination rate of dangerous actions is moderate and either approval or rejection is possible, the staff may manually instruct the meter 20 to start or stop refueling. The automatic and manual determinations may be appropriately combined, for example.

[0026] At this time, the staff may be inside SS2 where the refueling system is installed, or may be at a location different from SS2 where the refueling system is installed. Also, the terminal (not shown) used by the staff may be configured to be able to instruct the meter 20 to start or stop refueling by manual operation of the staff.

[0027] When the control unit 12 stops refueling due to the reason for stopping, the output unit 13 outputs information indicating the reason for stopping or the condition for resuming refueling to the user. For example, the output unit 13 may display information indicating the reason for stopping or the condition for resuming refueling on the image input / output device of the meter 20, or may output information indicating the reason for stopping or the condition for resuming refueling as voice through the voice input / output device.

[0028] In this case, the output unit 13 may output restart conditions corresponding to the reason for stopping. For example, the output unit 13 may use video to display the action that caused the reason for stopping, or the action required to correct that action and satisfy the restart conditions, or it may overlay an object indicating the correct posture on the image information that caused the reason for stopping, or it may give instructions by voice.

[0029] More specifically, if the reason for stopping is that the refueling nozzle cannot be recognized in the image from the imaging device 30, the system may output an image or audio message saying, "Please move to a position where the refueling nozzle is visible," or it may instruct the user on a specific position or posture to move to so that the refueling nozzle is visible in the image, such as "Please move a little to the right." Alternatively, if a fuel can is recognized in the image, the system may output an image or audio message stating the reason for stopping, such as, "Refueling will be stopped because something that appears to be a fuel can is visible." Alternatively, the output unit 13 may specify the user's standing position using projection mapping or the like.

[0030] In addition, the output unit 13 may display objects that are factors causing the stoppage, such as a fuel can, by circling them in red.

[0031] Furthermore, if there is a device capable of outputting images or sound separately from the metering machine 20, that device may output information indicating the reason for the stoppage or the conditions for resuming refueling to inform the user. As a result, the user can know the reason for the refueling stoppage and the conditions for resuming refueling, and can start or resume refueling promptly.

[0032] The notification unit 14 notifies the supervisor when the control unit 12 stops refueling, or when the reason for the stop is not resolved or the conditions for restarting are not met for a predetermined period of time or longer. The supervisor may be the staff described above.

[0033] The supervisor may be located within the SS2 where the refueling system is installed, or in a remote monitoring room 40 at a different location from the SS2 where the refueling system is installed. The supervisor may use a terminal 41 to communicate remotely with the user via the input / output device of the fuel dispenser 20 to explain the reason for stopping refueling and the conditions for restarting refueling. If necessary, the terminal 41 may also, in response to the supervisor's operation, send an instruction to the information processing device 10 indicating that the reason for stopping has been resolved or that refueling is permitted. In this case, the control unit 12 may send a refueling start signal to the fuel dispenser 20 in response to the supervisor's instruction received by the notification unit 14.

[0034] Figure 2 is a flowchart showing an example of the process in refueling system 1.

[0035] As shown in Figure 2, the acquisition unit 11 of the refueling system 1 acquires image information of the user performing refueling (S1), and the control unit 12 determines, based on the image information, whether the user's actions in the refueling process correspond to a predetermined reason for stopping (S2).

[0036] When the control unit 12 determines that a reason for stopping has been met, the control unit 12 sends a fuel supply stop signal to the metering machine 20, and the metering machine 20 stops fuel supply (S3). The output unit 13 then outputs information indicating the reason for stopping or the conditions for restarting fuel supply to the user, for example, via the input / output device of the metering machine 20 (S4).

[0037] In this case, the notification unit 14 may notify the monitor's terminal that the control unit has stopped refueling, or it may notify the monitor's terminal if the reason for stopping or the conditions for restarting refueling are not resolved or the conditions for restarting refueling are not met for a predetermined period of time or longer, even after outputting information indicating the reason for stopping or the conditions for restarting refueling.

[0038] Furthermore, when the control unit 12 determines that there is no reason for stopping or that the reason for stopping has been resolved (S2), the control unit 12 sends a refueling start signal to the metering machine 20, and the metering machine 20 starts or resumes refueling (S5). Then, steps S1 to S5 are repeated until a predetermined amount of refueling is reached (S6), and when the predetermined amount of refueling is reached, refueling is stopped (S7).

[0039] Although embodiments of the present invention have been described with the above configuration and operation, the system may also output both an image corresponding to a predetermined reason for stopping and an image that does not correspond to the predetermined reason for stopping, determined at a previous timing. This allows the user to visually identify which of their actions corresponds to the reason for stopping by comparing the images. Furthermore, the system may process the image comparison itself and provide output support by highlighting the differences in the image comparison. In addition, videos may be processed with a similar configuration. A video is a collection of still images, and the image of the frame corresponding to the predetermined reason for stopping and the image of the frame that does not correspond to the predetermined reason for stopping from before it may be combined and displayed as a video. Specifically, if the frame image at time t begins to correspond to the predetermined reason for stopping, a video from a predetermined time prior to time t (a video from t-2 seconds to t seconds, or a video from t-2 seconds to t+2 seconds) may be output, with a indication of this for the frame that corresponds to the predetermined reason for stopping.

[0040] Although the present invention has been described in detail based on embodiments above, it goes without saying that the present invention is not limited to the above embodiments and can be modified in various ways without departing from its essence. Furthermore, the above embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner and are not necessarily limited to those having all the configurations described. In addition, it is possible to add, delete, or replace some of the configurations of the above embodiments with other configurations.

[0041] Furthermore, each of the above configurations, functions, processing units, and processing means may be implemented in hardware, in whole or in part, for example, by designing them as integrated circuits. Alternatively, each of the above configurations, functions, and means may be implemented in software by having the processor interpret and execute programs that implement each function. Information such as programs, tables, and files that implement each function can be stored in memory, hard disks, SSDs, or other recording devices, or in recording media such as IC cards, SD cards, or DVDs.

[0042] Furthermore, in the diagrams above, the control lines and information lines shown are those deemed necessary for explanation and do not necessarily represent all control lines and information lines that would be present in the actual implementation. In reality, it can be assumed that almost all components are interconnected. [Industrial applicability]

[0043] This invention can be used in refueling systems at self-service gas stations and service stations. [Explanation of Symbols]

[0044] 1... Fueling system, 2... SS (Service Station), 10... Information processing device, 11... Acquisition unit, 12... Control unit, 13... Output unit, 14... Notification unit, 20... Measuring machine, 30... Imaging device, 40... Remote monitoring room, 41... Terminal

Claims

1. An acquisition unit that acquires image information of the user refueling, A control unit that stops refueling when the user's actions in the refueling process, based on the image information, fall under a predetermined reason for stopping, It has an output unit that outputs information to the user indicating the reason for the stop or the conditions for resuming refueling, Fueling system.

2. The output unit outputs the restart condition corresponding to the reason for stopping. The refueling system according to claim 1.

3. The output unit displays the operation required to satisfy the restart condition using video. The refueling system according to claim 1.

4. The control unit further has a notification unit that notifies the supervisor when the control unit stops refueling. The refueling system according to claim 1.

5. The system further includes a notification unit that notifies the monitoring officer if the aforementioned reason for suspension is not resolved or the conditions for resumption are not met for a period exceeding a predetermined duration. The refueling system according to claim 1.

6. The refueling system The acquisition step involves obtaining image information of the user who is refueling, A stop step in which refueling is stopped when the user's actions in the refueling process, based on the aforementioned image information, fall under a predetermined stop reason, The following steps are performed: an output step that outputs information indicating the reason for the stop or the conditions for resuming refueling to the user; Refueling method.

7. In the refueling system, The acquisition step involves obtaining image information of the user who is refueling, A stop step in which refueling is stopped when the user's actions in the refueling process, based on the aforementioned image information, fall under a predetermined stop reason, An output step is performed which outputs information indicating the reason for the stop or the conditions for resuming refueling to the user. program.

Images