Fueling monitoring system

Abstract

To more accurately execute switching of an automatic fueling determination mode and a manual fueling determination mode.SOLUTION: A fueling monitoring system includes a control device 112 that controls switching between an automatic fueling determination mode in which AI decides to permit or stop self-fueling based on an event detected at a service station, and a manual fueling determination mode in which a worker of the service station decides to permit or stop self-fueling instead of the AI. The control device 112 determines a level of the event detected at the service station, and switches from the automatic fueling determination mode to the manual fueling determination mode when the level is equal to or more than a prescribed level.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a refueling monitoring system for monitoring self-service refueling at a gas station. [Background technology]

[0002] In conventional gas stations, workers (supervisors) in the gas station building would visually or via a surveillance monitor monitor the behavior of customers (fuelers) filling up their own tanks, and would operate a fuel management device such as a handheld terminal to issue permission to fill up the tank on the meter. In recent years, there has been progress in the development of systems that use AI (Artificial Intelligence) to analyze images from surveillance cameras, and these systems are beginning to be applied to the monitoring of self-service fuel stations.

[0003] Here, examples of conventional technologies in the technical field related to the present invention include the following: For example, Patent Document 1 discloses an invention that enables efficient collection of learning data for re-learning a learning model used for monitoring self-service refueling. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2023-007794 A Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, the operation of an automatic refueling judgment mode that uses AI to analyze camera footage and other data to decide whether to allow or stop self-refueling has been considered. Currently, AI judgments cannot be made completely, so when operating the automatic refueling judgment mode, it is necessary to add a TOR (Take Over Request) process for events that are difficult for AI to judge or inappropriate events. Here, TOR refers to the process in which the system takes over from automatic processing to direct processing by an operator when an event occurs that cannot be handled by AI judgment or the refueling system. In TOR, the automatic refueling judgment mode is usually immediately switched to a manual refueling judgment mode in which an operator decides whether to allow or stop self-refueling by visual inspection or camera footage. However, there is a problem that switching to the manual refueling judgment mode regardless of the type of event does not lead to labor saving.

[0006] The present invention has been made in consideration of the above-mentioned conventional circumstances, and has an object to make it possible to more accurately switch between an automatic refueling determination mode and a manual refueling determination mode. [Means for solving the problem]

[0007] In order to achieve the above object, a refueling monitoring system according to one embodiment of the present invention has the following technical features: That is, a refueling monitoring system for monitoring self-refueling at a gas station includes a control device that controls switching between an automatic refueling determination mode in which an AI determines whether to permit or stop self-refueling based on an event detected at the gas station, and a manual refueling determination mode in which a gas station worker determines whether to permit or stop self-refueling instead of the AI, and the control device determines the level of the event detected at the gas station, and when the level is equal to or higher than a predetermined level, switches from the automatic refueling determination mode to the manual refueling determination mode.

[0008] Here, in the refueling monitoring system of the present invention, the control device can be configured to switch from the manual refueling judgment mode to the automatic refueling judgment mode when a predetermined recovery condition is satisfied after switching from the automatic refueling judgment mode to the manual refueling judgment mode.

[0009] In addition, in the refueling monitoring system of the present invention, the control device may be configured to further perform control to notify the operator when switching from the automatic refueling judgment mode to the manual refueling judgment mode, or when switching from the manual refueling judgment mode to the automatic refueling judgment mode. Effect of the Invention

[0010] According to the present invention, it is possible to more accurately switch between the automatic refueling determination mode and the manual refueling determination mode. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing an example of the configuration of a refueling monitoring system according to an embodiment of the present invention; [Diagram 2] FIG. 13 is a diagram illustrating the relationship between events and TOR levels. [Diagram 3] FIG. 1 illustrates TOR processing by TOR level. [Figure 4] FIG. 11 is a diagram illustrating a processing flow when an event is detected. [Diagram 5] 11 is a diagram illustrating a switching sequence from an automatic refueling determination mode to a manual refueling determination mode. FIG. [Figure 6] 11 is a diagram illustrating a switching sequence from a manual refueling determination mode to an automatic refueling determination mode. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] An embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a configuration example of a refueling monitoring system 100 according to an embodiment of the present invention. The refueling monitoring system 100 includes a monitoring device 110, a terminal device 120, a refueling management device 130, a measuring machine 135, a monitoring camera 140, a sensor 150, and an external device 160. The refueling monitoring system 100 of this example has a manual refueling determination mode in which an operator decides whether to permit or stop self-refueling by visual inspection or camera footage, and an automatic refueling determination mode in which the camera footage is analyzed by AI to decide whether to permit or stop self-refueling. In addition, the automatic refueling determination mode is the basis, and the mode is switched to the manual refueling determination mode depending on the situation.

[0013] The surveillance camera 140 is installed at an arbitrary position in the gas station, captures the self-service refueling situation, and outputs the obtained captured data (camera video) to the monitoring device 110. The surveillance camera 140 is installed for each fueling lane (vehicle stopping area) adjacent to the weighing machine 135 so as to capture images of vehicles and fuelers (users) in the fueling lane (vehicle stopping area) adjacent to the weighing machine 135. The surveillance camera 140 is installed, for example, in such a position and orientation that it overlooks from above an area including the area between the weighing machine 135 and the vehicle.

[0014] The sensor 150 detects sound, heat, odor, light, oil leakage, or the like generated by the actions of the fuel dispenser, and outputs the detection results to the monitoring device 110. The sensor 150 also includes a sensor that detects when the fuel nozzle is removed from the metering machine 135. The sensor 150 is installed in the metering machine 135 or in its vicinity (for example, around the fueling lane, etc.).

[0015] The monitoring device 110 is installed at a location (for example, inside a building of a gas station) away from the weighing machine 135. The monitoring device 110 has an image analysis device 111, a control device 112, a wireless device 113, and a learning model storage unit 114. The learning model storage unit 114 stores a learning model prepared in advance for AI analysis of camera images. The image analysis device 111 executes an AI refueling judgment process based on the learning model in the learning model storage unit 114. That is, the image analysis device 111 performs a process of analyzing the camera images using AI and judging whether or not refueling of the vehicle in the camera images is permitted. The detection result by the sensor 150 is also taken into consideration in the AI ​​refueling judgment process. The wireless device 113 performs wireless communication with the terminal device 120. The control device 112 is interposed between the surveillance camera 140, the sensor 150, the fuel supply management device 130, the external device 160, the image analysis device 111, and the wireless device 113, and comprehensively controls the operations of these devices / equipment. The surveillance device 110 is, for example, a computer equipped with hardware resources such as a processor and a memory, and is configured such that the processor executes a program for realizing each function according to the present invention.

[0016] In the AI ​​refueling determination process, it is confirmed whether there are any problems with multiple check items based on the camera footage captured by the surveillance camera 140 and the detection results by the sensor 150. For example, it is confirmed that the fuel nozzle of the metering machine 135 is properly inserted (fully inserted) into the fuel filler opening of the vehicle, that there is no heat source such as a cigarette, that there is no portable fuel can, and that multiple people are not attempting to refuel. If it is confirmed from the camera footage or the like that there are no problems with all of these check items, it is determined that the state is such that refueling can be permitted (i.e., refueling permission possible state), and if not, it is determined that the state is such that refueling cannot be permitted (i.e., refueling permission prohibited state).

[0017] In the case of the automatic refueling judgment mode, the result of the AI ​​refueling judgment process is treated as a final decision on whether to permit or stop refueling, and is transmitted to the refueling management device 130. That is, the monitoring device 110 transmits a control signal indicating the result of the AI ​​refueling judgment process (e.g., a refueling permission signal or a refueling stop signal) to the refueling management device 130. The control signal is also accompanied by information identifying the target refueling lane (e.g., a lane number). Here, stopping refueling includes not only stopping (interrupting) refueling during refueling after refueling has been permitted, but also prohibiting refueling without permitting it. In addition, the result of the AI ​​refueling judgment process may also be transmitted to the terminal device 120 and displayed so that an operator can check it.

[0018] On the other hand, in the case of the manual refueling determination mode, the result of the AI ​​refueling determination process is displayed on the terminal device 120 as a reference (auxiliary information) when a gas station worker decides whether to permit or stop refueling. The worker decides whether to permit or stop refueling by visual inspection or camera footage while referring to the result of the AI ​​refueling determination process, and operates the terminal device 120. As a result, a control signal indicating the worker's final decision (for example, a refueling permission signal or a refueling stop signal) is transmitted to the refueling management device 130.

[0019] The terminal device 120 is a device used by a worker at a gas station. The terminal device 120 has a control unit 121, a communication unit 122, a display unit 123, and an operation unit 124. The control unit 121 comprehensively controls the operation of each unit of the terminal device 120. The communication unit 122 performs wireless communication with the monitoring device 110. The display unit 123 displays various information including the result of the AI ​​refueling judgment process by the monitoring device 110. The operation unit 124 accepts various operations including permission and stop of self-refueling. The display unit 123 and the operation unit 124 may be integrally configured as a touch panel. The terminal device 120 is, for example, a computer equipped with hardware resources such as a processor and a memory, and is configured so that the processor executes a program for realizing each function according to the present invention.

[0020] The terminal device 120 receives and displays the results of the AI ​​refueling judgment processing from the monitoring device 110. The terminal device 120 also displays camera footage along with the results of the AI ​​refueling judgment processing. In the manual refueling judgment mode, the worker considers whether to permit or prohibit (not permit) refueling with reference to the information displayed on the terminal device 120, and if the worker determines that refueling may be permitted, performs an operation corresponding to that on the terminal device 120. Furthermore, if the worker determines that refueling should be stopped (interrupted) during refueling after permitting it, the worker performs an operation corresponding to that on the terminal device 120.

[0021] When the terminal device 120 receives the above-mentioned operation, it transmits a control signal indicating that operation (for example, a refueling permission signal or a refueling stop signal) to the refueling management device 130. The control signal is accompanied by information identifying the target refueling lane (for example, a lane number). The control signal according to the operation of the terminal device 120 may be transmitted to the refueling management device 130 via the monitoring device 110, or may be transmitted directly to the refueling management device 130 without passing through the monitoring device 110. Here, an example will be described in which the terminal device 120 is a portable terminal such as a tablet (i.e., a handy terminal) that can be carried by an operator, but the terminal device 120 may also be a stationary terminal installed (fixed) at a predetermined position.

[0022] The refueling management device 130 is also referred to as a self-service controller (SSC), and is installed, for example, at a location away from the metering machine 135 (for example, inside a building of a gas station). The refueling management device 130 controls the operation of the metering machine 135 based on a control signal from the monitoring device 110 or the terminal device 120. For example, when the refueling management device 130 receives a refueling permission signal, it drives a pump inside the metering machine 135 corresponding to the refueling permission signal, thereby making the metering machine 135 ready to refuel. Also, for example, when the refueling management device 130 receives a refueling stop signal, it stops a pump inside the metering machine 135 corresponding to the refueling stop signal, thereby making the metering machine 135 unable to refuel.

[0023] The external device 160 is a device for notifying the current mode (automatic refueling determination mode or manual refueling determination mode) and notifying mode switching in accordance with a control signal from the monitoring device 110. One example of the external device 160 is a signal light installed on the top of the weighing machine 135. When a signal light is used as the external device 160, the type of light it lights may represent the operation mode or state of each refueling lane. For example, a lit green light may represent a refueling standby state in the automatic refueling determination mode, a flashing green light may represent a refueling state in the automatic refueling determination mode, a flashing yellow light may represent a refueling state in the manual refueling determination mode, a flashing red light may represent a refueling state while an alarm is being issued, and a flashing purple light may represent an alarm being issued and refueling has been stopped.

[0024] The refueling monitoring system 100 may include a monitor (not shown) that displays all or part of the information displayed on the display unit 123 of the terminal device 120 in a location other than the terminal device 120 .

[0025] The main feature of the refueling monitoring system 100 of this embodiment is that it is provided with a mechanism for automatically switching between an automatic refueling determination mode and a manual refueling determination mode. This mechanism will be specifically described below.

[0026] In the refueling monitoring system 100 of this example, the control device 112 in the monitoring device 110 judges the level of an event (phenomenon) detected at a refueling station, and when the level is equal to or higher than a predetermined level, controls to switch from the automatic refueling judgment mode to the manual refueling judgment mode. Furthermore, after switching from the automatic refueling judgment mode to the manual refueling judgment mode, the control device 112 controls to switch from the manual refueling judgment mode to the automatic refueling judgment mode in response to a predetermined recovery condition being satisfied. Furthermore, when switching from the automatic refueling judgment mode to the manual refueling judgment mode or when switching from the manual refueling judgment mode to the automatic refueling judgment mode, the control device 112 also performs control to notify an operator of that fact.

[0027] In order to perform the above control, the control device 112 has processing control data that previously associates multiple TOR levels into which multiple events that can be detected at a gas station are classified with TOR processing to be executed when an event corresponding to the TOR level is detected. In this example, multiple events that can be detected at a gas station are classified into four levels, "abnormal," "warning," "caution," and "information," in order of importance, urgency, danger, etc. "Abnormal" refers to a level that requires the suspension of refueling due to a fire, etc. "Warning" refers to a level that requires a warning, such as refueling with a portable can. "Caution" refers to a level that may affect the accuracy of AI judgment due to rain, snowfall, etc. "Information" refers to a level of simple information, such as the start of refueling, etc.

[0028] The relationship between events and TOR levels is illustrated in Figure 2. In the example in Figure 2, the "nozzle disconnected" event is classified as an "abnormal" level, the "nozzle not detected" event as a "warning" level, the "static electricity removal sheet not in contact" event as a "caution" level, and the "vehicle entering" event as an "information" level. The TOR level into which each event is classified is selected appropriately according to the operation. For example, a "nozzle off" event may be classified into the "warning" level, and a "nozzle not detected" event into the "abnormal" level. Events and TOR levels may also be added, deleted, or changed. For example, a "bike detected" event or a "timeout" event may be added, and the "caution" level may be deleted.

[0029] FIG. 3 illustrates an example of TOR processing to be executed when an event corresponding to each TOR level is detected. In the example of FIG. 3, when an event of the "abnormal" level is detected, the automatic refueling determination mode is switched to the manual refueling determination mode, and the refueling management device 130 (SSC) is instructed to stop refueling, the terminal device 120 is instructed to notify the contents of the event, to sound an alarm, and to vibrate, and the external device 160 (signal light) is instructed to flash a light (red). When an event of the "warning" level is detected, the automatic refueling determination mode is switched to the manual refueling determination mode, and the terminal device 120 is instructed to notify the contents of the event and to vibrate, and the external device 160 (signal light) is instructed to flash a light (yellow). When an event of the "caution" level is detected, the terminal device 120 is instructed to notify the contents of the event. When an event of the "information" level is detected, it is set that no particular instruction such as a notification of the contents of the event is given to the terminal device 120.

[0030] In addition, although not shown in the figures, the refueling monitoring system 100 also has preset recovery conditions for switching from the manual refueling determination mode to the automatic refueling determination mode during operation after switching from the automatic refueling determination mode to the manual refueling determination mode. For example, when the mode has been switched to the manual refueling determination mode due to detection of an "abnormal" level event, it is set to switch to the automatic refueling determination mode after a manual recovery operation is performed. Also, when the mode has been switched to the manual refueling determination mode due to detection of an "warning" level event, it is set to switch to the automatic refueling determination mode after the manual refueling determination is completed.

[0031] The data regarding the settings described above with reference to Figures 2 and 3 is stored in a storage device (not shown) such as a memory included in the monitoring device 110. Also, instead of the monitoring device 110 storing the data regarding the settings above, the data may be stored in an external storage device accessible by the monitoring device 110. Also, the data regarding the settings above may be changed by a gas station worker using the terminal device 120, or may be changed by an administrator of the system via another device or network.

[0032] 2 and 3 are merely simplified illustrations for the sake of simplicity, and needless to say, the present invention is not limited to these. For example, in the setting example of FIG. 3, when an event of "abnormal" or "warning" level is detected, the automatic refueling determination mode is set to be switched to the manual refueling determination mode. However, when the ODD (Operational Design Domain) check is NG, the automatic refueling determination mode may be switched to the manual refueling determination mode. Examples of cases when the ODD check is NG include when the nozzle is not detected, when the oil type is light oil, and when the vehicle type is a motorcycle. When the ODD check is NG and the manual refueling determination mode is switched to, the automatic refueling determination mode may be switched to on the condition that the ODD check is OK. In this case, since there is a possibility that the mode switching may occur frequently, in order to prevent this, when the mode switching occurs a predetermined number of times in a short period of time (for example, three times within 10 seconds), the automatic refueling determination mode may be fixed for a certain period of time (for example, 60 seconds) thereafter.

[0033] Next, the flow of processing in the refueling monitoring system 100 of this embodiment will be described with reference to FIGS. An example of a processing flow when an event is detected is shown in Fig. 4. The control device 112 in the monitoring device 110 identifies an event that has occurred at a gas station based on the camera image captured by the monitoring camera 140 and the detection result by the sensor 150 (step S101), and judges the level of the event (step S102).

[0034] In step S102, when it is determined that the event is of the "abnormal" level, the control device 112 switches from the automatic refueling determination mode to the manual refueling determination mode based on the setting as exemplified in FIG. 3 (step S111), and instructs the refueling management device 130 (SSC) to stop refueling (step S112). The control device 112 also instructs the terminal device 120 to display information indicating the occurrence of the mode switch and the stop of refueling (step S113). At this time, the control device 112 also instructs the terminal device 120 to notify the event, sound an alarm, and vibrate, and instructs the external device 160 to flash a light (red). Note that an "abnormal" level event may occur for all refueling lanes, or may occur only for a specific refueling lane. Therefore, the control device 112 also transmits information identifying the target refueling lane (for example, lane number) to the terminal device 120. The terminal device 120 and the external device 160 that have received such an instruction automatically execute an operation corresponding to the above instruction. This enables the operator to quickly understand that an "abnormal" level event has occurred and the mode has switched to the manual refueling determination mode.

[0035] Thereafter, when the "abnormal" level event is resolved and the worker performs an operation to cancel the refueling stop on the terminal device 120, the information is transmitted to the control device 112 in the monitoring device 110. Accordingly, the control device 112 instructs the refueling management device 130 (SSC) to cancel the refueling stop (step S114). Thereafter, the control device 112 judges whether or not a predetermined recovery condition is satisfied (step S115). In this case where the manual refueling determination mode is switched to due to the detection of the "abnormal" level event, the control device 112 judges that the recovery condition is satisfied by the manual recovery operation, and switches from the manual refueling determination mode to the automatic refueling determination mode (step S116). In addition, the control device 112 instructs the terminal device 120 to display information indicating the occurrence of the mode switch (step S117). The terminal device 120 that receives such an instruction automatically executes an operation corresponding to the above instruction. This enables the operator to quickly understand that the "abnormal" level event has been resolved and the automatic refueling determination mode has been restored.

[0036] In step S102, when it is determined that the event is of the "warning" level, the control device 112 switches from the automatic refueling determination mode to the manual refueling determination mode based on the setting as exemplified in FIG. 3 (step S121). The control device 112 also instructs the terminal device 120 to display information indicating the occurrence of the mode switching (step S122). At this time, the control device 112 also instructs the terminal device 120 to notify the event and vibrate, and instructs the external device 160 to blink the light (yellow). The control device 112 also transmits information identifying the target refueling lane (for example, lane number) to the terminal device 120. The terminal device 120 and the external device 160 that have received such an instruction automatically execute an operation corresponding to the above instruction. This enables the operator to quickly grasp that the event of the "warning" level has occurred and the mode has been switched to the manual refueling determination mode.

[0037] Thereafter, the control device 112 judges whether or not a predetermined recovery condition has been satisfied (step S123). In this case where the mode has been switched to the manual refueling judgment mode due to the detection of a "warning" level event, the control device 112 judges that the recovery condition has been satisfied upon completion of the manual refueling judgment (permission or stop), and switches from the manual refueling judgment mode to the automatic refueling judgment mode (step S124). The control device 112 also instructs the terminal device 120 to display information indicating the occurrence of mode switching (step S125). The terminal device 120 that has received such an instruction automatically executes an operation corresponding to the above instruction. This enables the operator to quickly grasp that the "warning" level event has been resolved and the mode has been restored to the automatic refueling judgment mode.

[0038] If it is determined in step S102 that the event is of a "caution" level, the control device 112 instructs the terminal device 120 to notify the contents of the event (step S131). The control device 112 also transmits information identifying the target refueling lane (e.g., lane number) to the terminal device 120. Upon receiving such an instruction, the terminal device 120 automatically executes an operation corresponding to the instruction. This enables the worker to quickly grasp that a "caution" level event has occurred.

[0039] If it is determined in step S102 that the event is of the "information" level, the control device 112 transmits information about the event content to the terminal device 120, but does not instruct the terminal device 120 to notify the event content (step S131). The control device 112 also transmits information identifying the target refueling lane (e.g., lane number) to the terminal device 120. The terminal device 120 stores the received event content information in memory, and reads and displays the event content information from the memory upon request from the operator. This allows the worker to understand that an "information" level event has occurred, as necessary.

[0040] 5 illustrates an example of a switching sequence from the automatic refueling determination mode to the manual refueling determination mode. When the control device 112 switches from the automatic refueling determination mode to the manual refueling determination mode (step S201), it transmits a control signal including information indicating the occurrence of mode switching and information instructing event notification, vibration, and icon display to the terminal device 120 and the refueling management device 130. The control device 112 also transmits a control signal including information instructing the external device 160 to start blinking light.

[0041] The terminal device 120 switches to a screen for the manual refueling judgment mode based on the control signal received from the control device 112 (step S202), and performs notification processing such as event notification, vibration, and icon display (step S203). For example, the terminal device 120 performs a mode display indicating whether the device is operating in the automatic refueling judgment mode or the manual refueling judgment mode for each lane number, and also displays an operation button for receiving an instruction to permit or stop refueling for a lane number in the manual refueling judgment mode. The mode display can be realized in various ways, such as display by an icon representing each mode, display by characters representing each mode, and display by a color representing each mode. In addition, these displays may be performed by a device other than the terminal device 120 (for example, a smart watch, a wireless phone, etc.).

[0042] The refueling management device 130 and the external device 160 also perform operations based on the control signal received from the control device 112. That is, the refueling management device 130 performs notification processing such as a screen display by an external device corresponding to the lane number based on the control signal received from the control device 112 (step S204). For example, when a user (fueler) orders gasoline, a message is displayed indicating that the device is operating in the manual refueling determination mode. Also, the external device 160 (for example, a signal light installed on the top of the metering machine 135) starts blinking based on the control signal received from the control device 112 (step S205). This allows not only the staff at the gas station but also the users to understand the situation.

[0043] 6 illustrates an example of a switching sequence from the manual refueling determination mode to the automatic refueling determination mode. The following describes an example in which the condition for returning to the automatic refueling determination mode is the end of refueling. When the refueling management device 130 detects that refueling has ended in a refueling lane to which the manual refueling determination mode is applied, it transmits a refueling end signal to the control device 112 in the monitoring device 110. The refueling end signal is also accompanied by information identifying the target refueling lane (e.g., lane number).

[0044] When the control device 112 receives a refueling end signal from the refueling management device 130, it determines that the condition for restoring to the automatic refueling determination mode has been satisfied, and switches from the manual refueling determination mode to the automatic refueling determination mode (step S301). After that, the control device 112 transmits a control signal including information indicating the occurrence of mode switching and information instructing the terminal device 120 and the refueling management device 130 to stop event notification, vibration, and icon display. The control device 112 also transmits a control signal including information instructing the external device 160 to stop flashing light.

[0045] The terminal device 120 switches to a screen for the automatic refueling determination mode based on the control signal received from the control device 112 (step S302), and stops notification processing such as event notification, vibration, and icon display (step S303). Also, the refueling management device 130 stops notification processing such as screen display by the external device corresponding to the lane number based on the control signal received from the control device 112 (step S304). Similarly, the external device 160 (for example, a signal light installed on the upper part of the weighing machine 135) stops blinking light based on the control signal received from the control device 112 (step S305).

[0046] As described above, the refueling monitoring system of this example includes a control device 112 that controls switching between an automatic refueling determination mode in which AI determines whether to permit or stop self-refueling based on an event detected at the gas station, and a manual refueling determination mode in which a gas station worker determines whether to permit or stop self-refueling instead of AI. The control device 112 determines the level of the event detected at the gas station, and when the level is equal to or higher than a predetermined level, controls to switch from the automatic refueling determination mode to the manual refueling determination mode.

[0047] In other words, multiple events that can be detected at a gas station are classified into levels according to importance, urgency, danger, etc., and when an event of a predetermined level or higher is detected, the automatic refueling determination mode is automatically switched to the manual refueling determination mode. Therefore, according to the refueling monitoring system of this example, it is possible to more accurately switch between the automatic refueling determination mode and the manual refueling determination mode.

[0048] Although the embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and modifications are included in the scope and gist of the invention described in this specification, etc., and are included in the scope of the invention described in the claims and their equivalents.

[0049] Furthermore, the present invention can be provided not only as devices such as those described above or as a system composed of these devices, but also as methods executed by these devices, programs for causing a processor to realize the functions of these devices, and storage media for storing such programs in a computer-readable format. [Industrial Applicability]

[0050] The present invention can be used in a fuel supply monitoring system for monitoring self-service fuel supply at a gas station. [Explanation of symbols]

[0051] 100: refueling monitoring system, 110: monitoring device, 111: image analysis device, 112: control device, 113: wireless device, 114: learning model storage unit, 120: terminal device, 121: control unit, 122: communication unit, 123: display unit, 124: operation unit, 130: refueling management device, 135: weighing machine, 140: surveillance camera, 150: sensor, 160: external device

Claims

1. A fuel supply monitoring system for monitoring self-service fuel supply at a gas station, comprising: The gas station is provided with a control device for controlling switching between an automatic refueling determination mode in which an AI determines whether to permit or stop self-refueling based on an event detected at the gas station, and a manual refueling determination mode in which an operator at the gas station determines whether to permit or stop self-refueling instead of the AI, A refueling monitoring system characterized in that the control device judges the level of the event detected at the gas station, and if the level is above a predetermined level, switches from the automatic refueling judgment mode to the manual refueling judgment mode.

2. 2. The refueling monitoring system according to claim 1, The control device is characterized in that after switching from the automatic refueling determination mode to the manual refueling determination mode, the control device switches from the manual refueling determination mode to the automatic refueling determination mode in response to a predetermined recovery condition being satisfied.

3. 3. The refueling monitoring system according to claim 1, The refueling monitoring system is characterized in that the control device further performs control to notify the operator when switching from the automatic refueling judgment mode to the manual refueling judgment mode, or when switching from the manual refueling judgment mode to the automatic refueling judgment mode.

Images