Camera installation support system, camera control device, and camera installation method

Abstract

To make it possible to easily perform work of adjusting a camera in a visual field range suitable for monitoring self oil supply at a service station.SOLUTION: A camera installation supporting system performs an installation process of installing a camera at a position right over a measuring machine at a service station or a position shifted in a direction of a vehicle stop position from the position right over the measuring machine and a subsequent adjustment process of adjusting a visual field range of the camera using an adjustment image containing a guide stipulating a position and size of the measuring machine in video. The adjustment process may include processing of detecting the measuring machine from video captured by the camera using a learned model for detecting the measuring machine from camera video, processing of adjusting panning and tilting of the camera so that center coordinates of the measuring machine contained in the video captured by the camera agree with center coordinates of the guide of the adjustment image, and processing of adjusting zooming of the camera so that the size of the measuring machine contained in the video captured by the camera agrees with a size of the guide of the adjustment image.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a technology for supporting the installation of cameras for capturing images of self-service refueling at gas stations. [Background technology]

[0002] In conventional self-service refueling, dangerous behavior at the station was detected by a person (employee) through visual inspection. Self-service refueling stations are equipped with a confirmation camera for the employee to confirm whether or not permission to refuel is to be granted. Such confirmation cameras are typically installed diagonally above the vehicle on the front or rear side relative to the weighing machine, and capture images of the refueling operation viewed diagonally from the front or rear of the vehicle. Figure 1 shows an example of the installation location of conventional cameras at a gas station. In the example of Figure 1, camera 10 is installed diagonally above the vehicle 30 on the rear side relative to weighing machine 20.

[0003] Here, the following are examples of prior art in the technical field related to the present invention. For example, Patent Document 1 discloses an invention in which information about each fueling point is associated with an image of each fueling point displayed on a monitoring monitor. Also, Patent Document 2 discloses an invention in which a monitoring device determines abnormal behavior of a user and controls fueling of a vehicle according to the user's operation. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2000-238899 [Patent Document 2] International Publication No. 2021 / 015256 Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, approaches that combine image processing and AI to detect dangerous behaviors have been studied. However, when capturing images of a weighing machine from an oblique angle, as shown in Figure 1, blind spots can occur and the expected detection results may not be obtained. Furthermore, because the layout of each gas station is different, it is difficult to commonly define the camera position, height, angle, field of view, etc. As a result, the accuracy of camera installation is based on the experience of the construction worker, and the camera installation position and field of view are not uniform. Furthermore, even if there is an ideal field of view and camera installation is strictly defined, it is extremely difficult for workers to faithfully install cameras on site while adhering to the definitions, given that different workers install cameras each time for different gas station layouts.

[0006] The present invention was made in consideration of the above-mentioned conventional circumstances, and aims to make it easy to adjust a camera to a field of view suitable for monitoring self-service refueling at a gas station. [Means for solving the problem]

[0007] In order to achieve the above object, a camera installation support system according to one aspect of the present invention is configured as follows. In other words, the camera installation support system of the present invention comprises a camera installed directly above a weighing machine at a gas station or at a position shifted from directly above the weighing machine toward the vehicle parking position, and a camera control device having the function of controlling the pan, tilt, and zoom of the camera, and the camera control device is characterized in that it uses guide information that specifies the position and size of the weighing machine to perform a process of controlling the pan and tilt of the camera so that the center coordinates of the weighing machine included in the image captured by the camera match the center coordinates of the weighing machine included in the guide information, and a process of controlling the zoom of the camera so that the size of the weighing machine included in the image captured by the camera matches the size of the weighing machine included in the guide information.

[0008] Here, the camera control device can be configured to execute a process of detecting weighing machines from video captured by the camera using a trained model for detecting weighing machines included in video.

[0009] The camera control device can also be configured to execute a process of outputting an image in which an image indicating the position and size of the weighing machine included in the guide information is superimposed on the image captured by the camera.

[0010] A camera control device according to one aspect of the present invention is configured as follows. In other words, the camera control device of the present invention is a camera control device having the function of controlling the pan, tilt, and zoom of a camera installed at a gas station, and the camera is installed at a position directly above a weighing machine at the gas station or at a position shifted from directly above the weighing machine in the direction of the vehicle parking position, and the camera control device is characterized in that it uses guide information that specifies the position and size of the weighing machine to perform a process of controlling the pan and tilt of the camera so that the center coordinates of the weighing machine included in the image captured by the camera match the center coordinates of the weighing machine included in the guide information, and a process of controlling the zoom of the camera so that the size of the weighing machine included in the image captured by the camera matches the size of the weighing machine included in the guide information.

[0011] A camera installation method according to one aspect of the present invention is configured as follows. In other words, the camera installation method of the present invention is characterized by having an installation step of installing a camera at a position directly above a weighing machine at a gas station or at a position shifted from directly above the weighing machine toward the vehicle stopping position, and an adjustment step of adjusting the field of view of the camera using an adjustment image including a guide that defines the position and size of the weighing machine within the image.

[0012] Here, the adjustment process may be configured to include a process of detecting the weighing machine from the image captured by the camera using a trained model for detecting the weighing machine from the camera image.

[0013] The adjustment process may also be configured to include a process of controlling the pan and tilt of the camera so that the center coordinates of the weighing machine included in the image captured by the camera match the center coordinates of the guide in the adjustment image, and a process of controlling the zoom of the camera so that the size of the weighing machine included in the image captured by the camera matches the size of the guide in the adjustment image.

[0014] The adjustment step may also be configured to include a process of superimposing an adjustment image on an image captured by a camera and displaying the image. [Effects of the Invention]

[0015] According to the present invention, it is possible to easily adjust the camera to a field of view suitable for monitoring self-service refueling at a gas station. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 1 is a front view showing an example of the installation position of a conventional camera. [Figure 2] FIG. 10 is a front view showing an example of a camera installation position suitable for monitoring self-service refueling stations. [Figure 3] FIG. 10 is a plan view showing an example of a camera installation position suitable for monitoring self-service gas stations. [Figure 4] FIG. 10 is a side view showing an example of a camera installation position suitable for monitoring self-service refueling stations. [Figure 5] FIG. 5 is a diagram showing an example of the field of view of the camera installed at the position shown in FIGS. 2 to 4. [Figure 6] 1 is a diagram illustrating an example of the configuration of a camera installation support system according to an embodiment of the present invention. [Figure 7A] 7A and 7B are diagrams showing examples of adjustment images used in the camera installation support system of FIG. 6. [Figure 7B] 7A and 7B are diagrams showing examples of adjustment images used in the camera installation support system of FIG. 6. [Figure 8] 7 is a diagram showing an example of a flowchart relating to automatic adjustment of the field of view range of the camera performed by the camera installation support system of FIG. 6. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, we discuss the optimal camera installation location for monitoring self-service refueling at gas stations. Camera location is an important factor when using image processing AI to detect dangerous behavior. However, because conventional inspection cameras at gas stations are designed for rough visual inspection by employees, camera position and field of view are not particularly important. As a result, camera positions and field of view are often inappropriate for detecting dangerous behavior using image processing AI. Furthermore, to maximize the effectiveness of image processing AI, precise adjustment of camera position, height, field of view, etc. is required. However, because gas stations have different layouts, there is no common definition of camera position, height, and field of view. For this reason, camera installation based on the experience of construction workers will not achieve consistent detection accuracy with image processing AI. Therefore, to determine the optimal camera installation location, we analyzed three factors: the vehicle stopping position, the refueler's posture, and the refueler's behavior during self-service refueling.

[0018] (1) Vehicle parking position Although it depends on the personal judgment of the person visiting the gas station, vehicles are naturally drawn to the rectangular parking areas marked on the road surface of the gas station, so vehicles are generally parked so that the fuel filler opening is directly in front of the meter. Also, the distance between the meter and the vehicle's fuel filler opening is generally kept close enough for the fuel hose to reach, and it is also sufficient to allow people to enter and exit smoothly without interfering with the refueling operation.

[0019] (2) Attitude of fuel supplier The person filling the tank generally holds the fuel nozzle with one hand and stands next to the vehicle while filling the tank. This position is generally maintained until the tank is fully filled. In conventional camera positions that capture the refueling operation from a diagonal downward view from the front or rear of the vehicle, the fuel nozzle can sometimes be hidden by the hand or arm holding the nozzle, making the fuel nozzle invisible. In rare cases, the person filling the tank holds the fuel nozzle with both hands, but the situation is similar.

[0020] The person filling up the fuel tank is often standing in front of or behind the fuel nozzle of the vehicle. For example, if the camera is positioned to take pictures from the rear of the vehicle and the person filling up the fuel tank is standing at the rear of the vehicle, the fuel tank opening and fuel nozzle will be hidden by the person filling up the fuel tank, making it impossible to observe the filling operation. Furthermore, for example, there are cases where the vehicle door is left open while filling up the fuel tank, and if the camera is positioned at the front of the vehicle, the filling operation will be hidden by the door and will be impossible to observe.

[0021] (3) Behavior of fuelers When refueling, the fueler must hold the fuel nozzle with his or her hand, which means that the fueler must maintain a standing posture, and as a result, the fueler rarely moves significantly while refueling. However, when refilling fuel, the fueler may look into the fuel filler neck while refueling. In this case, the fueler's head or upper body may cover the fuel filler neck or fuel filler nozzle, hiding them and making them impossible to capture on the camera.

[0022] The fuel filler cap of a vehicle is located on the side of the vehicle, and the fuel nozzle is inserted perpendicular to the vehicle. Therefore, when adding fuel, the fuel nozzle must be pulled back slightly and the driver must look into the fuel filler cap from the side or from the front. Due to the structure of the vehicle, the inside of the fuel tank cannot be seen from directly above the fuel filler cap, so it is difficult to look into the fuel filler cap from directly above.

[0023] The above analysis results show that although there are various detailed refueling actions taken by refuelers, the layout of gas stations and the shape of vehicles are patterned, so the camera's field of view can be fixed to a certain extent. Therefore, by patterning the camera position, height, and angle for detecting refueling actions using image processing AI, it becomes possible to standardize them for various gas station layouts, making it possible to detect dangerous behavior with high accuracy.

[0024] Next, we analyze the number of cameras. The pattern of camera positioning also depends on the number of cameras. For example, when taking pictures at an angle looking down from the front or rear of the vehicle, as in the past, a countermeasure against the possibility of the fuel pumper hiding or being obscured by the door could be to install two cameras per lane and take pictures from two directions. In this case, the number of cameras installed increases, which increases the costs of equipment and construction. In addition, the image processing AI must separately capture images from both cameras and perform inference processing, making the image processing AI cumbersome and complex. Furthermore, since the images from two cameras must be processed simultaneously, resource consumption is approximately twice that of a single camera. As a result, a high-performance computer must be used to perform the AI ​​inference processing, which also increases costs.

[0025] Meanwhile, confirmation cameras already installed at gas stations sometimes capture two lanes with a single camera. In this case, each lane is captured on the left and right sides of the camera's field of view. When these two lanes are captured simultaneously, the number of effective pixels per lane is at least half of the original number of pixels, halving the amount of information. Furthermore, when using image processing AI to monitor refueling operations, the camera's field of view includes a significant amount of areas unrelated to refueling operations (areas unnecessary for monitoring) because the two lanes are captured simultaneously. As a result, the camera's resolution cannot be used effectively, resulting in poor camera utilization efficiency. At the same time, this can also lead to false alarms.

[0026] These analysis results show that it is best to limit the number of cameras to one per lane and to set the field of view to one that excludes areas unnecessary for the image processing AI and includes as many areas as possible that are useful. Note that when capturing images of two lanes simultaneously with one camera, the original concerns may be alleviated by using a high-resolution camera such as a 4K camera. In practice, either operation is acceptable as long as the images can be captured with consistent and high accuracy.

[0027] Next, we will analyze the fixation of the camera installation position. From the analysis so far, the appropriate camera installation position when monitoring refueling operations using image processing AI can be narrowed down to a certain extent. In this embodiment, the standard is a position that allows continuous monitoring of the entire refueling operation, regardless of the movements of the refueler, as much as possible.

[0028] (1) Standard field of view The standard field of view that should be aimed for is centered on the weighing machine. For example, the field of view should be such that the weighing machine is positioned in the center of the top of the captured image. Analysis of the vehicle's stopping position shows that the location where the refueling operation takes place is the center of the weighing machine, so the position should be such that this part can be captured as large as possible. This improves the detection accuracy of the image processing AI. It also reduces the possibility that the refueling operation will be cut off from the field of view.

[0029] (2) Camera installation position In order to center the field of view on the weighing machine, the camera installation position is based on the positions shown in Figures 2 to 5. Figure 2 is a front view showing an example of the camera installation position. Figure 3 is a plan view showing an example of the camera installation position. Figure 4 is a side view showing an example of the camera installation position.

[0030] As shown in these figures, it is ideal to install the camera 10 at a position along an axis X that passes through the center of the weighing machine 20 and extends in the direction of the vehicle stopping position 40. Since a canopy (roof) is always installed at a gas station, the camera is basically mounted on the ceiling. In the example of Figure 3, two vehicle stopping positions 40A, 40B are set on either side of the weighing machine 20, and two cameras 10A, 10B are installed corresponding to these positions.

[0031] If the camera is installed directly above the weighing machine, there is a possibility that the fuel filler cap will be obscured by the person filling the tank. On the other hand, if the camera is installed too far away from directly above the weighing machine, the fuel filler cap will be obscured by the vehicle. Therefore, as shown in Figures 3 and 4, it is preferable to position the camera a certain distance (for example, about 1.5 meters) from directly above the weighing machine 20 toward the vehicle stopping position 40. However, when one camera is used to simultaneously photograph two lanes, the camera may be installed directly above the weighing machine 20, as shown by the dashed line 10' in Figure 3.

[0032] As described above, the camera is installed directly above the weighing machine (when one camera is used to capture two lanes) or at a position shifted from directly above the weighing machine toward the vehicle stopping position (when one camera is used to capture one lane). Here, "directly above the weighing machine" in this specification does not only mean vertically above the center of the weighing machine, but also includes the area above the weighing machine that corresponds to the installation range of the weighing machine when viewed from above. Therefore, "a position directly above the weighing machine or a position shifted from directly above the weighing machine toward the vehicle stopping position" includes the area above the weighing machine that corresponds to the width W of the weighing machine as seen from the vehicle side (see Figure 3). However, it goes without saying that the camera is preferably installed closer to the axis X (see Figure 3) that passes through the center of the weighing machine.

[0033] (3) Camera installation height The height of the canopy on which the camera is mounted varies depending on the gas station, generally ranging from 4 to 6 meters. Therefore, differences in camera installation height are accommodated by the zoom function of the camera lens. For example, the camera specifications are as follows: focal length = 2.8 to 8.5 mm, horizontal angle of view = 38 to 110°, vertical angle of view = 21 to 62°, resolution = Full HD (1920 x 1080), and aspect ratio = 16:9. It is desirable to select a camera that can be set to a certain degree of telephoto and wide-angle. For example, if the camera is installed at a height of 4 meters, it should be set to wide-angle, and if the camera is installed at a height of 6 meters, it should be set to telephoto. Furthermore, it is preferable for the camera to have automatic zoom adjustment, and it is even more preferable for it to be able to automatically adjust pan and tilt.

[0034] (4) Camera angle If the optical axis of the camera is pointed directly downward, the weighing machine itself will not be visible, making it impossible to check the operations in front of the machine. Also, part of the refueling operation may be hidden in the shadow of the vehicle. Therefore, it is ideal to angle the camera so that the optical axis is slightly tilted toward the weighing machine. Therefore, as shown in Figure 4, it is desirable to tilt the body of camera 10 slightly toward weighing machine 20. This makes it possible to capture an image of the weighing machine looking down from the front, as shown in Figure 5.

[0035] In the example of Fig. 5, an image 50 is captured that shows the space between the weighing machine 20 and the vehicle 30, i.e., the overall state of the refueling operation. Therefore, an image can be captured that shows the area around the vehicle's fuel filler opening and the state of the inserted fuel filler nozzle without being obscured by the person filling the fuel, so the situation in front of the weighing machine can be confirmed without any hindrance.

[0036] After the camera is installed at the position determined as described above, the camera's field of view must be adjusted so that it can capture images suitable for the image processing AI. FIG. 6 shows an example configuration of a camera installation support system used to adjust the camera's field of view according to one embodiment of the present invention. The camera installation support system shown in the figure includes a camera 10 and a camera control device 60. The camera control device 60 is realized, for example, by a computer equipped with hardware resources such as a processor and memory, and is configured so that the processor executes programs for implementing each function according to the present invention.

[0037] 6 has a memory 61, a control unit 62, a display unit 63, and an operation unit 64, and is communicably connected to the camera 10 via wired or wireless communication. The operation of the camera control unit 60 will be described below using three examples of the operation of the camera control unit 60: manual adjustment of the field of view range of the camera 10, semi-automatic adjustment, and fully automatic adjustment.

[0038] (1) Manual adjustment of field of view After fixing the camera in place, the field of view is determined by adjusting the angle and zoom of the camera body. If a bread-type camera or box-type camera is used that does not have the function to remotely control the pan and tilt, the angle must be adjusted manually. Also, if a varifocal lens is used for zoom adjustment, manual adjustment is required. Because camera installation is a manual task performed at a high altitude, accurate adjustments cannot be made based on instructions based on experience, and being done manually does not allow for strict precision.

[0039] To solve this problem, an adjustment image 70 including a guide 72 that defines the position and size of the weighing machine in the image, as shown in an example in Fig. 7A, is prepared in advance and stored in memory 61 of camera control device 60. Under the control of control unit 62, camera control device 60 superimposes adjustment image 70 on the image captured by camera 10 in real time and displays it on display unit 63. The worker directly operates camera 10 to adjust the field of view of camera 10 so that the position and size of the weighing machine in the image displayed on display unit 63 of camera control device 60 match the guide 72 of adjustment image 70. This improves the accuracy of manual adjustment of the field of view, making it possible for anyone to adjust the field of view uniformly.

[0040] As one example, the camera control device 60 is realized as a terminal (e.g., a tablet) carried by a worker who manually adjusts the camera 10. In this case, the worker can check the captured video on which the adjustment image is superimposed on the spot. As another example, the camera control device 60 is realized as a monitoring device installed inside a gas station building. In this case, personnel inside the building can give instructions to the worker while checking the captured video on which the adjustment image is superimposed. As yet another example, the camera control device 60 may be realized as a remote monitoring device installed at a separate location connected to the gas station equipment via a network line.

[0041] 7A shows an adjustment image 70 used when one camera is installed per lane, and is intended to capture an image in which the weighing machine is visible in the upper center. When capturing images of two lanes with one camera, as shown in another example in FIG. 7B, vehicles will be parked on both sides of the weighing machine, so an adjustment image 74 can be used that includes a guide 76 in the center that defines the position and size of the weighing machine in the image.

[0042] (2) Semi-automatic adjustment of field of view When a camera 10 capable of remotely controlling PTZ (pan-tilt-zoom) is used, it is possible to automate the field of view adjustment to some extent. That is, under the control of the control unit 62, the camera control device 60 superimposes an adjustment image 70 (or adjustment image 74) on the image captured by the camera 10 in real time and displays it on the display unit 63. The control unit 62 then remotely controls the pan-tilt-zoom of the camera 10 in accordance with operations received by the operation unit 64. The operator operates the operation unit 64 while viewing the display on the display unit 63 of the camera control device 60, and adjusts the orientation of the camera 10 in the vertical and horizontal directions by remotely controlling the pan and tilt. Similarly, the field of view of the camera 10 in the vertical direction is adjusted by remotely controlling the zoom.

[0043] In this way, if the field of view of camera 10 can be adjusted by remote control, manual adjustment of the field of view at a high altitude becomes unnecessary after the camera is installed. Camera control device 60 may be realized as a terminal (e.g., a tablet) carried by an operator, as a monitoring device installed inside the gas station building, or as a remote monitoring device installed at a separate location connected to the gas station equipment via a network line.

[0044] (3) Fully automatic adjustment of the field of view If the camera 10 is installed in a position where a weighing machine is visible somewhere in the captured image, the field of view adjustment process can be fully automated. Specifically, under the control of the control unit 62, the camera control device 60 detects the weighing machine from the captured image of the camera 10 and determines its position and size. The control unit 62 then remotely controls the pan, tilt, and zoom of the camera 10 so that the position and size match those indicated by the guide 72 in the adjustment image 70 (or the guide 76 in the adjustment image 74). Note that in this embodiment, predetermined numerical information indicating the position and size of the weighing machine may be used instead of the guide on the adjustment image. Hereinafter, information including the position and size of the weighing machine, which serves as the basis for the field of view of the camera 10, will be referred to as "guide information."

[0045] The fully automatic adjustment of the field of view range will be described below with reference to the flowchart of FIG. After the camera is installed, the camera control device 60 first detects the weighing machine from the video captured by the camera 10 (step S11). In this example, in order to enable the weighing machine to be detected from the captured video, video of the weighing machine captured by a camera whose field of view has been appropriately adjusted is collected in advance as training data, and a trained model for detecting the weighing machine from the captured video is generated based on this training data. A weighing machine detection AI using this trained model can detect the weighing machine included in the captured video and calculate the position and size of the weighing machine.

[0046] Next, the camera control device 60 automatically controls the pan, tilt, and zoom of the camera 10 so that the position and size of the weighing machine included in the captured video match the position and size of the weighing machine included in the guide information. As an example, first, the difference between the center coordinates of the weighing machine detected from the captured video and the center coordinates of the weighing machine in the guide information, i.e., the number of pixels (amount of deviation) in the horizontal direction (H) and vertical direction (V), is calculated (step S12). Then, it is determined whether or not there is a positional deviation of the weighing machine in the captured video (step S13). If the calculated amount of deviation is zero (or is less than a predetermined threshold), it is determined that there is no positional deviation; otherwise, it is determined that there is a positional deviation.

[0047] If it is determined that the weighing machine is misaligned in the captured image, the pan and tilt of camera 10 are adjusted so that the center coordinates of the weighing machine included in the captured image approach the center coordinates of the weighing machine in the guide information (i.e., so that the amount of misalignment becomes smaller) (step S14). The processes of steps S12 to S14 are repeated until the positional misalignment is eliminated. That is, each time the pan and tilt of camera 10 is adjusted, the misalignment between the center coordinates of the weighing machine included in the captured image and the center coordinates of the weighing machine in the guide information is calculated, and pan and tilt are adjusted again to correct the misalignment. In this way, camera control device 60 gradually corrects the orientation of camera 10 by controlling pan and tilt multiple times.

[0048] Next, the camera control device 60 adjusts the zoom of the camera 10 to adjust the field of view in the height direction. Here, when a weighing machine is detected from the captured video using AI, the size of the weighing machine in the captured video is calculated (step S15). The size of the weighing machine can be obtained, for example, by determining a rectangle that indicates the boundary of the weighing machine in the captured video and calculating the size of this rectangle. Next, it is determined whether the size of the weighing machine included in the captured video matches the size of the weighing machine in the guide information (step S16).

[0049] If it is determined that there is a size mismatch, the zoom of camera 10 is adjusted so that the size of the weighing device included in the captured video is approximately the same as the size of the weighing device in the guide information (step S17). That is, if the size of the weighing device included in the captured video is smaller than the size of the weighing device in the guide information, it is zoomed in, and if not, it is zoomed out. The processing of steps S15 to S17 is repeated until the size mismatch is resolved. That is, each time the zoom of camera 10 is adjusted, the size of the weighing device included in the captured video is calculated, and the zoom is adjusted again so that it matches the size of the weighing device in the guide information. In this way, camera control device 60 gradually corrects the field of view range in the height direction of the camera by controlling the zoom multiple times.

[0050] As described above, camera control device 60 performs a process of adjusting the pan and tilt of camera 10 so that the center coordinates of the weighing machine included in the image captured by camera 10 match the center coordinates of the weighing machine in the guide information, and a process of adjusting the zoom of camera 10 so that the size of the weighing machine included in the image captured by camera 10 matches the size of the weighing machine in the guide information, thereby making it possible to automatically adjust the field of view of camera 10. Camera control device 60 may be realized as a terminal (e.g., a tablet) carried by an operator, may be realized as a monitoring device installed in a gas station building, or may be realized as a remote monitoring device installed at a separate location connected to gas station equipment via a network line.

[0051] 8 is merely an example, and the field of view range of the camera may be automatically adjusted by other processes. Furthermore, an adjustment image may be superimposed on the image captured by the camera in real time so that the worker can understand the process of automatically adjusting the field of view range. The image captured by the camera along with the adjustment image may be displayed on the display unit 63 of the camera control device 60, or may be displayed on another device communicably connected to the camera control device 60.

[0052] As explained above, based on the analysis results of the stopping position of the vehicle performing refueling, the posture of the refueler, and the behavior of the refueler, it is considered effective to install the camera for the image processing AI in a position directly above the metering machine or in a position shifted from directly above the metering machine in the direction of the vehicle stopping position. Therefore, in this embodiment, an installation step is first carried out in which a camera is installed in a position directly above the metering machine installed at the gas station or in a position shifted from directly above the metering machine in the direction of the vehicle stopping position, and then an adjustment step is carried out in which the field of view of the camera is adjusted using an adjustment image including a guide that defines the position and size of the metering machine in the image.

[0053] By installing cameras in this way, it is possible to reduce blind spots when monitoring refueling operations. Therefore, whether employees visually check the camera footage or use image processing AI to detect dangerous behavior, it is possible to detect dangerous behavior with high accuracy. Furthermore, it is possible to check not only dangerous behavior but also normal behavior.

[0054] In addition, although gas stations have a variety of layouts, regardless of the layout of the gas station, it is possible to capture video that captures the entire refueling operation, thereby maintaining consistent accuracy in detecting dangerous behavior. Furthermore, it is now possible to seamlessly trace the refueling operation from the start to the end of refueling, which was not possible with conventional camera angles, contributing to the safe operation of gas stations even in visual confirmation. In addition, in terms of system processing, the number of cameras can be minimized, which reduces the processing load of the image processing AI and contributes to cost reduction.

[0055] In addition, because the field of view of camera footage can be standardized, it is less likely that the accuracy of AI inference will vary significantly from gas station to gas station due to differences in the angle of view. Furthermore, by standardizing the field of view, it is possible to build AI that can be used universally, regardless of the gas station. As a result, the field of view will be roughly the same for footage taken at any gas station, making it possible to standardize the rules for annotation work in generating training data. As a result, the same work can be done regardless of the footage taken at any gas station, making it possible to carry out efficient and highly accurate annotation work, and thereby providing highly accurate AI.

[0056] Here, although the above explanation does not specifically mention the type of weighing machine, since there are actually various types of weighing machines, it is preferable to prepare multiple pieces of guide information according to the type of weighing machine. Furthermore, since the same type of weighing machine can vary in size, different guide information may be prepared for each size of weighing machine. Alternatively, guide information may be prepared according to a reference size of weighing machine, and the size of the weighing machine in the guide information may be adjusted according to the difference between the actual size of the weighing machine and the size of the reference size of the weighing machine. In this case, there is no need to prepare different guide information for each size of weighing machine. Furthermore, depending on the settings of the image processing AI, it may be necessary to capture an image in which the weighing machine is shown in a different position (for example, the center on the left side, the center on the bottom side, or the center on the right side). In that case, guide information including the required position can be used.

[0057] In the above description, the field of view range is adjusted using the weighing machine itself in the camera image, but a different reference object may be used. For example, the reference object may be a square or rectangular mark of a predetermined size that is placed or painted at a predetermined position relative to the position of the weighing machine.

[0058] Although the embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can take on various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the spirit of the present invention. These embodiments and modifications thereof are included in the scope and spirit of the invention described in this specification, etc., and are included in the invention described in the claims and their equivalents.

[0059] Furthermore, the present invention can be provided not only as devices such as those described above or as systems composed of these devices, but also as methods executed by these devices, programs for realizing the functions of these devices using a processor, and storage media for storing such programs in a computer-readable manner. [Industrial Applicability]

[0060] The present invention can be used in a system for monitoring self-service refueling at a gas station. [Explanation of symbols]

[0061] 10, 10A, 10B, 10': camera, 20: weighing machine, 30: vehicle, 40A, 40B: vehicle stopping position, 50: captured image, 60: camera control device, 61: memory, 62: control unit, 63: display unit, 64: operation unit, 70, 74: adjustment image, 72, 76: guide

Claims

1. A camera installed directly above a metering machine at a gas station or at a position shifted from directly above the metering machine toward a vehicle stopping position; a camera control device having a function of controlling pan, tilt and zoom of the camera, The camera control device uses guide information that specifies the position and size of a reference object in the image captured by the camera to perform a process of controlling the pan and tilt of the camera so that the center coordinates of the reference object in the image captured by the camera match the center coordinates of the reference object included in the guide information, and then performs a process of controlling the zoom of the camera so that the size of the reference object in the image captured by the camera matches the size of the reference object included in the guide information.

2. The camera installation support system according to claim 1, The camera control device is characterized in that it performs a process of detecting a reference object from the image captured by the camera using a trained model for detecting a reference object contained in the image.

3. 3. The camera installation support system according to claim 1, The camera control device is characterized in that it executes a process of outputting an image in which an image indicating the position and size of a reference object included in the guide information is superimposed on the image captured by the camera.

4. 4. The camera installation support system according to claim 1, A camera installation support system characterized in that the reference object is a weighing machine.

5. 4. The camera installation support system according to claim 1, A camera installation support system characterized in that the reference object is a mark installed or painted on the ground.

6. A camera control device having a function of controlling pan, tilt, and zoom of a camera installed at a gas station, The camera is installed directly above a metering machine at the gas station or at a position shifted from directly above the metering machine toward a vehicle stopping position, The camera control device uses guide information that specifies the position and size of a reference object in the image captured by the camera to perform a process of controlling the pan and tilt of the camera so that the center coordinates of the reference object in the image captured by the camera match the center coordinates of the reference object included in the guide information, and then performs a process of controlling the zoom of the camera so that the size of the reference object in the image captured by the camera matches the size of the reference object included in the guide information.

7. an installation step of installing a camera at a position directly above a metering machine at a gas station or at a position shifted from directly above the metering machine toward a vehicle stopping position; an adjustment step of adjusting the field of view of the camera using an adjustment image including a guide that defines the position and size of a reference object in the image captured by the camera, A camera installation method characterized in that in the adjustment process, a process is performed to control the pan and tilt of the camera so that the center coordinates of the reference object in the image captured by the camera and the center coordinates of the guide in the adjustment image match, and then a process is performed to control the zoom of the camera so that the size of the reference object in the image captured by the camera and the size of the guide in the adjustment image match.

8. The camera installation method according to claim 7, A camera installation method characterized in that the adjustment process includes a process of detecting a reference object from the image captured by the camera using a trained model for detecting a reference object from camera image.

9. The camera installation method according to claim 7 or 8, A camera installation method characterized in that the reference object is a weighing machine.

10. The camera installation method according to claim 7 or 8, A camera installation method characterized in that the reference object is a mark installed or painted on the ground.

11. The camera installation method according to any one of claims 7 to 10, The camera installation method, wherein the adjustment step includes a process of displaying the adjustment image superimposed on the image captured by the camera.

Images