Vehicle put-in and take-out management program, vehicle put-in and take-out management device, and parking lot system using program and device, and settlement method

Abstract

To provide a vehicle put-in and take-out management program, a vehicle put-in and take-out management device, and a parking lot system using the program and device, and a settlement method that can reduce facility cost.SOLUTION: In step 902, an image of the entire parking lot 10 is acquired. In step 903, a trained vehicle front image learning control model 18 using vehicle front image data for learning as input data for extracting a feature quantity is used, and image data is input to the model to determine whether vehicle front image data is extracted. In step 904, a vehicle number is recognized from the vehicle front image data. In step 905, a trained vehicle rear image learning control model 19 using vehicle rear image data for learning as input data for extracting a feature quantity is used, and image data is input to the model to determine whether vehicle rear image data is extracted. In step 906, the vehicle number is recognized from the vehicle rear image data. In step 907, a determination is made as to whether the vehicle with the recognized vehicle number is in any one vehicle compartment.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to a vehicle entrance / exit management program, a vehicle entrance / exit management device, and a parking lot system and a payment method using these. [Background technology]

[0002] In a first conventional parking lot, a gate machine for raising / lowering a bar to stop vehicles from passing is provided at the entrance and exit of the parking lot.

[0003] In the first conventional parking lot described above, the entrance gate is provided with a ticket issuing machine, and an entrance loop coil is embedded near the entrance gate to detect vehicles. As a result, when an operator operates the ticket issuing machine after a vehicle is detected by the entrance loop coil, the bar of the entrance gate rises, and after the vehicle passes through the entrance gate, the bar of the entrance gate falls. On the other hand, the exit gate is provided with a fare adjustment machine, and an exit loop coil is embedded near the exit gate to detect vehicles. As a result, when an operator operates the fare adjustment machine after a vehicle is detected by the exit loop coil, the bar of the exit gate rises, and after the vehicle passes through the exit gate, the bar of the exit gate falls.

[0004] Fig. 33 shows a second conventional parking lot. In Fig. 33, an unregulated entrance / exit gate 3301 is provided for free entry and exit to facilitate entry / exit management, and cameras 3302-1, 3302-2, ..., 3302-9 are provided in each parking space 3301-1, 3301-2, ..., 3301-9 to capture images of the vehicle number in order to verify the vacancy status of each space, and entry / exit management is performed by extracting and identifying the vehicle number of the vehicle. In Fig. 33, 3303 is a nighttime illumination light, and 3304 is a payment machine.

[0005] Furthermore, a method for authenticating a vehicle's license plate number is publicly known (see Patent Document 1). [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2022-54632 A (Patent No. 7277879) Summary of the Invention [Problem to be solved by the invention]

[0007] However, in the first conventional parking lot described above, the loop coil is embedded near the gate machine, which poses a problem of high equipment costs.

[0008] Furthermore, in the second conventional parking lot shown in FIG. 33 above, a number of cameras proportional to the number of parking spaces is required, so there is also a problem of high equipment costs. [Means for solving the problem]

[0009] In order to solve the above-mentioned problems, the vehicle entry and exit management program of the present invention is a parking lot having at least one camera capable of capturing an image of the entire parking lot, and causes a computer to execute a vehicle image extraction procedure for extracting a front image and / or a rear image of the vehicle from the camera image, a vehicle number extraction procedure for extracting a vehicle number from the front image and / or the rear image of the vehicle, and a space occupancy determination / space number linking procedure for linking the vehicle number to the space number of the space determined to be full when the space in which the vehicle from which the vehicle number is extracted is located is determined to be full.

[0010] In addition, the vehicle entry and exit management device of the present invention is a parking lot having at least one camera capable of capturing an image of the entire parking lot, and is equipped with a vehicle image extraction means for extracting a front image and / or a rear image of the vehicle from the camera image, a vehicle number extraction means for extracting a vehicle number from the front image and / or the rear image of the vehicle, and a vehicle compartment occupancy determination / vehicle number linking means for linking the vehicle number to the vehicle compartment number of the vehicle compartment determined to be full when the vehicle compartment in which the vehicle from which the vehicle number is extracted is located is determined to be full.

[0011] Furthermore, the parking lot system of the present invention comprises a vehicle entry / exit management device having a storage medium storing the above-mentioned vehicle entry / exit management program or a vehicle entry / exit management device having the above-mentioned configuration, a management server capable of communicating with the vehicle entry / exit management device to manage parking lots by vehicle number and parking space number linked to the vehicle number, and a static code unit provided in the parking lot in which parking lot information related to the parking lot and URL information related to the management server are embedded as image codes.

[0012] Furthermore, the electronic payment method in the parking lot system of the present invention includes, in the above-mentioned parking lot system, a first step of scanning the static code unit with the user communication terminal and establishing communication between the user communication terminal and the management server based on parking lot information regarding the parking lot and URL information regarding the management server, a second step of transmitting a vehicle number or a parking space number from the user communication terminal to the management server after the first step, and a third step of transmitting provider information of the selected electronic payment server and user information of the user communication terminal for the selected electronic payment server to the management server after the second step, so that payment of parking fees is made between the management server and the electronic payment server. Effect of the Invention

[0013] According to the present invention, since there is no need for a loop coil, and no need for a camera in each vehicle compartment for capturing an image of the vehicle number plate of the vehicle, the equipment cost can be reduced. [Brief description of the drawings]

[0014] [Figure 1] 1 is a diagram showing a first embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention. [Diagram 2] 2 shows details of the parking lot in FIG. 1, where (A) is a top view and (B) is a perspective view. [Diagram 3] 2 is a detailed block circuit diagram of the vehicle entry / exit management device and the order management server of FIG. 1. [Figure 4]4 is a flowchart for explaining a vehicle front image learning operation of a central processing unit of the vehicle entrance / exit management device of FIG. 3. [Diagram 5] 4 is a flowchart for explaining a vehicle rear image learning operation of a central processing unit of the vehicle entrance / exit management device of FIG. 3. [Figure 6] 4 is a flowchart showing an initial setting routine of a central processing unit of the vehicle entrance / exit management device of FIG. 3. [Figure 7] FIG. 7 is a diagram showing a parking lot during the initial setting operation in FIG. 6. [Figure 8] 7 is a table showing an example of a vehicle compartment occupancy status in FIG. 6. [Figure 9] 4 is a flowchart for explaining a main operation of a central processing unit of the vehicle entrance / exit management device of FIG. 3. [Figure 10A] FIG. 10 is a diagram for supplementarily explaining step 903 in FIG. [Figure 10B] FIG. 10 is a diagram for supplementarily explaining step 905 in FIG. [Figure 11] 4 is a block diagram showing another example of a vehicle entry / exit management device for the parking lot in FIG. 3. [Figure 12] 2 is a flowchart for explaining an electronic payment routine in the parking lot system of FIG. 1. [Figure 13] 13 is a diagram showing an image displayed on a user communication terminal for explaining the flowchart of FIG. 12. [Figure 14] FIG. 11 is a diagram showing a second embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention. [Figure 15] 15 is a front view of the electronic payment settlement machine and the vehicle entrance / exit management device of FIG. 14. [Figure 16] 15 is a detailed block circuit diagram of the vehicle entry / exit management device and the order management server of FIG. 14. [Figure 17] 15 is a flowchart for explaining an electronic payment routine 1 in the parking lot system of FIG. 14. [Figure 18] 18 is a diagram showing an image displayed on a touch panel for explaining the flowchart in FIG. 17. FIG. [Figure 19] 15 is a flowchart for explaining a second electronic payment routine in the parking lot system of FIG. 14. [Figure 20] 20 is a diagram showing an image displayed on a user communication terminal for explaining the flowchart of FIG. 19. [Figure 21] FIG. 11 is a diagram showing a third embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention. [Figure 22] 22 is a front view of the cash settlement / electronic settlement settlement machine and the vehicle entrance / exit management device of FIG. 21. [Diagram 23] 22 is a detailed block circuit diagram of the vehicle entry / exit management device and the order management server of FIG. 21. [Figure 24] 22 is a flowchart for explaining a cash payment / electronic payment routine in the parking lot system of FIG. 21. [Diagram 25] 25 is a diagram showing an image displayed on a touch panel for explaining the flowchart of FIG. 24. FIG. [Figure 26] 22 is a flowchart for explaining an electronic payment routine in the parking lot system of FIG. 21. [Figure 27] FIG. 2 is a diagram showing a modification of the parking lot system of FIG. [Figure 28] 28 is a flowchart for explaining an electronic payment / terminal payment routine in the parking lot system of FIG. 27. [Figure 29] FIG. 15 is a diagram showing a modification of the parking lot system of FIG. [Diagram 30] 30 is a flowchart for explaining an electronic payment / terminal payment routine in the parking lot system of FIG. 29. [Diagram 31] FIG. 22 is a diagram showing a modification of the parking lot system of FIG. 21. [Diagram 32] 32 is a flowchart for explaining a cash payment / electronic payment / terminal payment routine in the parking lot system of FIG. 31. [Diagram 33] FIG. 2 shows a second conventional parking lot. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] FIG. 1 is a diagram showing a first embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention.

[0016] 1, the parking lot system is composed of at least one parking lot 1-1, 1-2, ... (more precisely, a vehicle entry / exit management device described later) that is constantly connected to the Internet 2, an order management server (web server) 3 that is constantly connected to the Internet 2, user communication terminals 4-1, 4-2, ... that are connected to the Internet 2 as needed, and electronic payment (code payment) servers (web servers) 5-1, 5-2, ... owned by an electronic payment company (code payment provider) that are constantly connected to the Internet 2. The parking lots 1-1, 1-2, ... have a similar configuration.

[0017] The user communication terminals 4-1, 4-2, . . . and the electronic payment servers 5-1, 5-2, . . . in FIG. 1 are used and operate when making electronic payments (code payments).

[0018] FIG. 2 shows details of the parking lot 1-1 in FIG. 1, (A) being a top view and (B) being a perspective view.

[0019] In FIG. 2, six vehicle compartments 11-1, 11-2, ..., 11-6 are provided on one side of the parking lot 1-1, and six vehicle compartments 11-7, 11-8, ..., 11-12 are provided on the other side of the parking lot 1-1. There are no loop coils, bar gates, cameras, etc. at the unregulated entrance / exit gates 11-13 and 11-14 of the parking lot 1-1, and vehicles can enter and exit the parking lot completely freely. At one end of the parking lot 1-1, a vehicle entrance / exit management device 1 connected to the Internet 2 is provided. At least one camera (for example, a wide-angle monocular camera) 13 is fixed to a pole 13a at a height of, for example, 3 m, so that the entire parking lot 1-1 can be imaged at once. In other words, the vehicles in the parking lot 1-1 and the vehicle compartments 11-1 to 11-12 can be imaged at once. In particular, it can capture images of the front of the vehicle parked in the vehicle compartments 11-1 to 11-6 and images of the rear of the vehicle parked in the vehicle compartments 11-7 to 11-12. The camera 13 is connected to the vehicle entrance / exit management device 12. The vehicle entrance / exit management device 12 is located away from the pole 13a of the camera 13, but if the motherboard of the vehicle entrance / exit management device 12 is enclosed in a small case and installed in the middle of the pole 13a of the camera 13, the area of ​​the parking lot 1-1 can be used effectively. In addition, the static code unit (plate) 14 is a one-dimensional code (e.g., barcode) or two-dimensional code (e.g., QR code (registered trademark)) in which parking lot information, such as the management company name / business name of the parking lot 1-1 and URL information of the order management server 3, such as the name of the order management server 3, acquired files, etc., are embedded in a fixed manner, and the contents cannot be changed. Furthermore, there are no payment machines in the parking lots 1-1, 1-2, ... in FIG. 2. The vehicle entry / exit management device 12 is, for example, 45 cm wide x 38.5 cm deep x 75 cm high, and is relatively small in height. In contrast, the static code unit 14 is, for example, 45 cm wide x 5 cm deep x 150 cm high, and is relatively large in height to match the user's line of sight. Furthermore, since there is no electrical connection between the vehicle entry / exit management device 12 and the static code unit 14, the vehicle entry / exit management device 12 and the static code unit 14 can be freely arranged within the parking lots 1-1, 1-2, ...

[0020] The vehicle number of the vehicle and the vacancy status of each parking space 11-1, 11-2, ..., 11-12 linked to the vehicle number of the parking lots 1-1, 1-2, ... are successively determined by the vehicle entry / exit management device 12 and transferred to the order management server 3 via the Internet 2. As a result, the order management server 3 manages information for each order. For example, an order number is given to each order, Parking lot management company name Parking lot business name Vehicle number Vehicle number Receipt time Payment time Delivery time Status: For example, parked, payment completed, recharge, etc. Parking Fee Payment Fee payment method Front image of vehicle / rear image of vehicle The vehicle number is linked to the vehicle number.

[0021] FIG. 3 is a detailed block circuit diagram of the vehicle entry / exit management device 12 and the order management server 3 of the parking lot 1-1 in FIG.

[0022] In FIG. 3, the vehicle entry / exit management device 12 is configured by a computer, and in detail, includes a central processing unit (CPU) 301, a read-only memory (ROM) 302 for storing programs, etc., a flash memory 303 for storing programs, temporary data, etc., a random access memory (RAM) 304 for storing temporary data, etc., an input / output (I / O) interface 305 having a USB terminal, interrupt terminals INT1, INT2, INT3, etc., a communication interface 306 connected to the Internet 2, an image interface 307 connected to the camera 13, a vehicle front image learning control model 308, a vehicle rear image learning control model 309, etc. Each learning control model 308, 309 is a deep learning neural network consisting of an input layer, multiple intermediate layers, and an output layer. In the neural network, learning is performed by adjusting the weights and biases of a multilayer perceptron by the error backpropagation method.

[0023] 3, the order management server 3 is also a computer with a similar configuration to the vehicle entry / exit management device 12, but since no camera is connected, there is no image interface, and no learning control model. Therefore, the order management server 3 is configured by a computer, and in detail, is configured by a central processing unit (CPU) 301', a read-only memory (ROM) 302' for storing programs, etc., a flash memory 303' for storing programs, temporary data, etc., a random access memory (RAM) 304' for storing temporary data, etc., an input / output (I / O) interface 305' having a USB terminal, interrupt terminals INT1', INT2', etc., a communication interface 306' connected to the Internet 2, etc.

[0024] Fig. 4 shows a vehicle front image learning operation routine executed by the CPU 301 in response to an interrupt from an operator to the interrupt terminal INT1 of the vehicle entering and leaving management device 12 in Fig. 3. This learning operation routine is stored in the ROM 302 or the flash memory 303.

[0025] First, in step 401, a plurality of learning vehicle front image data recognized by the operator is acquired from a vehicle front camera (not shown) or a USB memory previously acquired, etc. The more the recognized learning vehicle front image data is, the greater the learning effect in step 402 is.

[0026] In step 402, a vehicle front image learning process is performed. That is, a vehicle front image learning control model 18 that extracts feature amounts using a large amount of recognized learning vehicle front image data as input data is trained by deep learning.

[0027] Then, the routine of FIG.

[0028] Fig. 5 shows a vehicle rear image learning operation routine executed by the CPU 301 in response to an interrupt from an operator to the interrupt terminal INT2 of the vehicle entrance / exit management device 12 in Fig. 3. This learning operation routine is stored in the ROM 302 or the flash memory 303.

[0029] First, in step 501, a plurality of learning rear image data of the vehicle recognized by the operator is acquired from a vehicle rear camera (not shown) or a USB memory previously acquired, etc. The greater the number of recognized learning rear image data of the vehicle, the greater the learning effect in step 502.

[0030] In step 502, a vehicle rear image learning process is performed. That is, a vehicle rear image learning control model 19 that extracts features using a large number of recognized learning vehicle rear image data as input data is trained by deep learning.

[0031] Then, the routine of FIG.

[0032] 4 and 5 can be executed by the operator at any time thereafter, which increases the learning effect. Learning may also be executed on the cloud side connected to the Internet 2, and the learning results may be introduced into the learning control models 308, 309 via the Internet 2. In this case, the same applies to the other parking lots 1-2, .... Furthermore, in the order management server 3, learning vehicle front image data and learning vehicle rear image data may be retrieved from a USB memory or the like in response to an interrupt from the operator via the interrupt terminals INT1', INT2', and the learning operation may be executed on the cloud side, which may then be retrieved into each parking lot.

[0033] Fig. 6 shows an initial setting routine executed by the CPU 301 of the vehicle entry / exit management device 12 of Fig. 3, which is an interrupt routine executed by an interrupt from the operator to the interrupt terminal INT3 after checking the vacancy status of all the parking spaces 11-1, 11-2, ..., 11-12 in the operator's parking lot 1-1. This initial setting routine is executed at least once after the parking lot 1-1 is started up, for example. This initial setting routine is stored in the ROM 302 or the flash memory 303.

[0034] First, in step 601, the initial setting flag S1 is set (S1←"1"), which essentially prohibits the execution of the main routine described below.

[0035] Next, in step 602, image data of vacant parking spaces 11-1, 11-2, ..., 11-12 in parking lot 1-1 shown in Fig. 7 is acquired by camera 13. The image data of vacant spaces is data showing, for example, white and yellow rectangular frames of parking spaces.

[0036] Next, in step 603, vehicle interior area data is extracted from the image data of the vacant vehicle interiors 11-1, 11-2, ..., 11-12. Each vehicle interior area data is the four coordinates (x1, y1), (x2, y2), (x3, y3), and (x4, y4) indicating the four corners shown in Figure 7. This vehicle interior area data is stored in the RAM 14.

[0037] Next, in step 604, as shown in FIG. 8, the occupancy status of each of the compartments 11-1, 11-2, . . . , 11-12 in the RAM 304 is set to "0" (vacant).

[0038] Next, in step 605, the initial setting flag S1 is reset (S1←“0”), which essentially enables the execution of the main routine described below.

[0039] 6 ends in step 606. The initial setting routine in FIG. 6 is also executed in the other parking lots 1-2, . . .

[0040] Fig. 9 shows a main routine executed by the CPU 301 of the vehicle entrance / exit management device 12 shown in Fig. 3. This main routine is stored in the ROM 302 or the flash memory 303.

[0041] First, in step 901, it is determined whether or not initialization is in progress (S1="1") based on the initial setting flag S1, and only if initialization is not in progress (S1="0"), the process proceeds to step 902. In other words, execution of the main routine is substantially prohibited during initialization.

[0042] In step 902, the camera 13 captures an image of the entire parking lot 1-1, and in particular, an image of the vehicles present in the parking lot 1-1.

[0043] Next, in step 903, the trained vehicle front image learning control model 308, which extracts features using the recognized learning vehicle front image data as input data, is used to input image data from the camera 13 and determine whether the vehicle front image data has been extracted. In this case, as shown in Fig. 10A, the vehicle front image is extracted together with the vehicle number whether the vehicle is inside or outside the vehicle. If the vehicle front image data has been extracted, the process proceeds to step 904, and if the vehicle front image data has not been extracted, the process proceeds to step 905.

[0044] Next, in step 904, the vehicle number is recognized from the vehicle front image data extracted in step 903. That is, the vehicle number recognition process includes a black and white binary data conversion procedure for converting the vehicle front image data extracted in step 903 into black and white binary data, a rectangular contour area extraction procedure for extracting connected contours of connected black data or white data of the black and white binary data as a plurality of rectangular contour areas, a number / dot area extraction procedure for determining and extracting a plurality of number areas and dot areas from the plurality of rectangular contour areas, and a vehicle number extraction procedure for extracting the vehicle number of the vehicle from the number area and dot area. The number / dot area extraction procedure includes a Boolean image conversion procedure for converting an image within each rectangular contour area into a Boolean image, and a Boolean image and a Boolean number template are compared by pixel-by-pixel Boolean operation to extract each rectangular contour area when the similarity between the Boolean image and the Boolean number template is equal to or greater than a first threshold or equal to or less than a second threshold that is smaller than the first threshold. The method has a number / dot discrimination and extraction procedure for discriminating that the contour area is a number / dot area and extracting it, and the vehicle number extraction processing procedure has an average value calculation procedure for calculating the average height of all the number / dot areas, a first selection procedure for selecting one of the number / dot areas as a first area, a second selection procedure for selecting a number / dot area within a range of a predetermined multiple of the average height on the right side of the first area as a second area, a third selection procedure for selecting a number / dot area between the first and second areas as a third area, a vehicle number candidate selection procedure for setting the first, second and third areas as vehicle number candidates when there is a predetermined number of third areas, and a vehicle number selection procedure for selecting the vehicle number candidate as the vehicle number of the vehicle when there is one vehicle number candidate, and selecting the vehicle number candidate that is most likely to satisfy a predetermined condition as the vehicle number of the vehicle when there is multiple vehicle number candidates (see Patent Document 1).

[0045] Next, in step 905, the trained vehicle rear image learning control model 309 extracts features using the recognized learning vehicle rear image data as input data, and inputs the image data of the camera 13 to determine whether the vehicle rear image data has been extracted. For example, as shown in FIG. 10B, the vehicle rear image can be extracted. At that time, when the vehicle is outside the vehicle cabin, it is extracted together with the vehicle number, but when the vehicle is completely inside the vehicle cabin, it is difficult to extract the vehicle number. Even in this case, in the present invention, the vehicle rear image including the vehicle number is extracted when the vehicle starts entering the vehicle cabin. When the vehicle rear image data has been extracted, the process proceeds to step 907, and when the vehicle rear image data has not been extracted, the process proceeds directly to step 908.

[0046] Next, in step 906, the vehicle number is recognized from the vehicle rear image data extracted in step 905. That is, the vehicle number recognition process includes a black and white binary data conversion procedure for converting the vehicle rear image data extracted in step 905 into black and white binary data, a rectangular contour area extraction procedure for extracting connected contours of connected black data or white data of the black and white binary data as a plurality of rectangular contour areas, a number and dot area extraction procedure for determining and extracting a plurality of number areas and dot areas from the plurality of rectangular contour areas, and a vehicle number extraction procedure for extracting the vehicle number of the vehicle from the number areas and dot areas. The number and dot area extraction procedure includes a Boolean image conversion procedure for converting an image within each rectangular contour area into a Boolean image, and a Boolean image and a Boolean number template are compared by pixel-by-pixel Boolean operation to compare each rectangular contour area with each other when the similarity between the Boolean image and the Boolean number template is equal to or greater than a first threshold or equal to or less than a second threshold that is smaller than the first threshold. The method has a number / dot discrimination and extraction procedure for discriminating that the contour area is a number / dot area and extracting it, and the vehicle number extraction processing procedure has an average value calculation procedure for calculating the average height of all the number / dot areas, a first selection procedure for selecting one of the number / dot areas as a first area, a second selection procedure for selecting a number / dot area within a range of a predetermined multiple of the average height on the right side of the first area as a second area, a third selection procedure for selecting a number / dot area between the first and second areas as a third area, a vehicle number candidate selection procedure for setting the first, second and third areas as vehicle number candidates when there is a predetermined number of third areas, and a vehicle number selection procedure for selecting the vehicle number candidate as the vehicle number of the vehicle when there is one vehicle number candidate, and selecting the vehicle number candidate that is most likely to satisfy a predetermined condition as the vehicle number of the vehicle when there is multiple vehicle number candidates (see Patent Document 1).

[0047] Next, in step 907, it is determined whether the vehicle whose vehicle number was recognized in steps 904 and 906 is in any vehicle compartment. For example, it is determined that the vehicle compartment is full due to the vehicle based on the overlap ratio between the vehicle's projection data using Boolean calculation and the area data of each vehicle compartment shown in FIG. 7. Here, if the area data of the vehicle compartment is 100%, when the overlap ratio of the vehicle's projection data exceeds 30%, the vehicle compartment is determined to be full, and on the other hand, when the overlap ratio is less than 30%, the vehicle compartment is determined to be vacant. The vehicle projection data is preferably vertical projection data, but is not limited to this. As a result, when it is determined to be full, the vehicle number of the vehicle is linked to the vehicle number of the vehicle. Of course, the vehicle compartment number determined to be vacant is not linked. However, theoretically, if the vehicle enters a vehicle compartment in the parking lot even once, the vehicle compartment number is linked. On the other hand, in exceptional cases, when a vehicle enters the parking lot but leaves without entering a parking space, there is no parking space that is determined to be full, so there is no link to a parking space number. However, even in this case, parking fees are incurred based on the order created using the recognized vehicle number.

[0048] Next, in step 908, the vehicle number obtained in steps 904 and 906 and the vehicle space number of the space determined to be full in step 907 and linked to the vehicle number are sent to the order management server 3 together with information on the parking lot 1-1, i.e., the management company name, the business name, and the vehicle front image and / or the vehicle rear image. In this case, the vehicle space number determined to be vacant is not sent, of course. As a result, the order management server 3 performs order generation and closure processing. For example, when a new vehicle number is obtained, a new order, i.e., an order number, is generated, and the entry time and the vehicle front image and / or the vehicle rear image are recorded. On the other hand, when the vehicle number is no longer recognized in either the vehicle front image or the vehicle rear image, the departure time is recorded in the order, and the order is closed.

[0049] In the first embodiment, the features are estimated and extracted from the vehicle front image data and the vehicle rear image data by learning control, but if the camera 13 is set high in a parking lot, the features can be extracted directly from the vehicle image data.

[0050] The main routine of FIG. 9 is also executed in the vehicle entry / exit management devices of the other parking lots 1-2, . . .

[0051] The vehicle entry / exit management device of FIG. 3 can also be configured with hardware shown in FIG.

[0052] In Figure 11, a parking lot has at least one camera capable of capturing images of multiple parking spaces and the entire parking lot, and the vehicle entry / exit management device has a vehicle image extraction means 1101 that extracts a front image and / or a rear image of the vehicle from the camera image, a vehicle number extraction means 1102 that extracts a vehicle number from the front image and / or the rear image of the vehicle, and a compartment occupancy determination / compartment number linking means 1103 that links the vehicle number of the compartment determined to be full to the vehicle number when the compartment in which the vehicle from which the vehicle number is extracted is determined to be full.

[0053] Next, the electronic payment (code payment) routine in the parking lot system of Fig. 1 will be described with reference to Fig. 12. The electronic payment routine of Fig. 12 is executed by, for example, the user communication terminal 4-1, and electronic payment is performed between the vehicle entry / exit management device 12, the order management server 3, the user communication terminal 4-1, and the electronic payment server 5-1.

[0054] First, in step 1201, the user scans the static code unit 14 using the camera of the user communication terminal 4-1 and converts the image code into a character code, as shown in Fig. 13(A). As a result, a request is made from the user communication terminal 4-1 to the order management server 3, and communication is established between the user communication terminal 4-1 and the order management server 3 via the Internet 2 using information about the parking lot, such as the management company name / business name, information about the order management server 3, and user information about the user communication terminal 4-1 (account ID, password, email number, etc.).

[0055] 13B, in step 1202, the user communication terminal 4-1 responds to the request message from the order management server 3 by inputting the selected vehicle number or cabin number and transmitting it to the order management server 3. In this case, the input vehicle number is, for example, only four digits.

[0056] Next, in step 1203, as shown in Fig. 13(C), the user communication terminal 4-1 receives the vehicle front image and / or vehicle rear image of the vehicle number or cabin number entered in step 1202 sent from the order management server 3 and confirms whether or not it is the corresponding vehicle. The order management server 3 obtains the vehicle front image and / or vehicle rear image of each cabin from the vehicle entry / exit management device 12. As a result, if it is not the corresponding vehicle, "return" is tapped to return to step 1202 and the vehicle number or cabin number is re-entered. On the other hand, if it is the corresponding vehicle, the process proceeds to step 1204.

[0057] In step 1204, the calculated parking fee is confirmed on the user communication terminal 4-1 using the same information as in (C) of Fig. 13. In this case, the order management server 3 calculates the parking fee for the relevant parking space based on a predetermined parking fee table based on information from the vehicle entry / exit management device 12, and transmits the calculated parking fee to the user communication terminal 4-1. Therefore, when "Confirm" is tapped, the order management server 3 records the current time as the payment time of the order for the relevant parking space number.

[0058] 13D, in step 1205, the user taps "Settlement" on the user communication terminal 4-1 to send information about the selected electronic payment provider (electronic payment server, e.g., 5-1) and user information such as the account ID, password, and e-mail number of the user communication terminal 4-1 for the selected electronic payment server to the order management server 3. As a result, the order management server 3 communicates with the electronic payment server 5-1 to settle the parking fee.

[0059] Finally, in step 1206, as shown in Fig. 13(E), the user communication terminal 4-1 confirms the settlement upon receiving the payment from the order management server 3. At this time, the user communication terminal 4-1 receives the receipt issued by the order management server 3 only when receipt issue is tapped, and the electronic settlement is completed in step 1207. When the vehicle leaves the garage, the vehicle compartment becomes "0" (vacant), so the order management server 3 records the departure time of the order and closes the order.

[0060] In this way, electronic payment, so-called code payment, is performed by communication between the user communication terminals 4-1, 4-2, ... and the order management server 3 using the static code unit 14, and communication between the order management server 3 and the electronic payment servers 5-1, 5-2, ....

[0061] FIG. 14 is a diagram showing a second embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention.

[0062] In FIG. 14, an electronic settlement machine 15 is provided in place of the static code unit 14 in FIG.

[0063] FIG. 15 is a front view of the electronic settlement machine 15 and the vehicle entrance / exit management device 12 of FIG.

[0064] In FIG. 15, the electronic payment settlement machine 15 has a size of, for example, 45 cm wide x 38.5 cm deep x 150 cm high, and is equipped with a touch panel 151 that also displays dynamic codes. The touch panel 151 has a liquid crystal display unit or the like for displaying image information received from the vehicle entry / exit management device 12, and when the user's fingertip touches the screen of the liquid crystal display unit or the like, the screen position information is sent to the vehicle entry / exit management device 12. Note that dynamic code display is a display in which the displayed image code is variable, and is particularly suitable for displaying a variable parking fee as an image code. The touch panel 151 is connected to the I / O interface 305 of the vehicle entry / exit management device 12 by an electrical wiring C. In contrast, the vehicle entry / exit management device 12 has a size of, for example, 45 cm wide x 38.5 cm deep x 75 cm high, and is separate from the electronic payment settlement machine 11-8, and the arrangement of the electronic payment settlement machine 11-8 and the vehicle entry / exit management device 12 in the parking lot 1-1 is restricted by the electrical wiring C. For this reason, by housing only the motherboard of the vehicle entry / exit management device 12 inside the electronic payment settlement machine 15, the electrical wiring C can be made the internal wiring of the electronic payment settlement machine 15. As a result, the installation work in the parking lot 1-1 is simplified. Such an electronic payment settlement machine 15 is called a vehicle entry / exit management device-housed electronic payment settlement machine.

[0065] The touch panel 151 is, for example, a 17-inch (43 cm) type, and displays a response message from the vehicle entrance / exit management device 12, while transmitting the user's touch information to the vehicle entrance / exit management device 12. The dynamic code display displayed on the touch panel 151 displays parking lot information, for example, the management company / business name of the parking lot 1-1 and the user's parking fee, in the form of a one-dimensional code (for example, a barcode) or two-dimensional code (for example, a QR code) image code, and the image content, in particular the parking fee, is changed by the vehicle entrance / exit management device 12.

[0066] The touch panel 151 is connected to an I / O interface 205 of the vehicle entry / exit control device 12 by an electric wiring C, as shown in FIG.

[0067] Next, the electronic payment routine in the parking lot system of Fig. 14 will be described with reference to Fig. 17 and Fig. 19. Electronic payment routine 1 in Fig. 17 is executed by the operation of the touch panel 151 of the electronic payment settlement machine 15 by the user, and electronic payment routine 2 in Fig. 19 is executed by, for example, the user communication terminal 4-1, resulting in electronic payment being performed between the electronic payment settlement machine 15, the order management server 3, the user communication terminal 4-1, and the electronic payment server 5-1.

[0068] An electronic settlement routine 1 based on the operation of the touch panel 151 of the electronic settlement machine 15 in FIG. 17 will be described.

[0069] First, in step 1701, as shown in (A) and (A') of Figure 18, the user responds to a request message for input of a vehicle number or a vehicle compartment number obtained from the order management server 3 via the vehicle entry / exit management device 12 by inputting the selected vehicle number or vehicle compartment number, and taps "Confirm" to send it to the order management server 3.

[0070] Next, in step 1702, as shown in Fig. 18(B), the user receives a vehicle image of the vehicle number or vehicle compartment number input in step 1701 sent from the order management server 3 and checks whether it is the corresponding vehicle. The order management server 3 has previously obtained vehicle images of each vehicle number or vehicle compartment number from the vehicle entry / exit management device 12. As a result, if it is not the corresponding vehicle, "Back" is tapped to return to step 1701 and the vehicle number or vehicle compartment number is re-input. On the other hand, if it is the corresponding vehicle, the process proceeds to step 1703.

[0071] In step 1703, the user confirms the calculated parking fee using the same information shown in Fig. 18(B). In this case, the order management server 3 calculates the parking fee for the vehicle space based on the vacancy information from the vehicle entry / exit management device 12 and a predetermined parking fee table, and transmits the calculated parking fee to the user communication terminal 4-1. Therefore, when "Pay parking fee" is tapped, the order management server 3 records the current time as the payment time of the order for the vehicle number.

[0072] Next, in step 1704, the order management server 3 displays, for example, a QR code as a dynamic code display DR shown in Fig. 18(C) on the touch panel 151 via the vehicle entry / exit management device 12. This dynamic code display includes parking lot information and parking fees for the parking lot. If the user does not tap "Back", this dynamic code display is erased after a predetermined time in steps 1705 and 1706 so that it cannot be seen by anyone other than the user. Then, the process ends in step 1707.

[0073] The electronic settlement routine 2 by the user communication terminal 4-1 of FIG. 19 will now be described.

[0074] First, in step 1901, as shown in FIG. 20A, the user communication terminal 4-1 selects a provider of an electronic settlement service provider (electronic settlement server, for example, 5-1).

[0075] Next, in step 1902, the user scans the dynamic code display DR using the camera of the user communication terminal 4-1, as shown in (C) of Fig. 18, and converts the image code into a character code. As a result, "Payment" is tapped and a request is made from the user communication terminal 4-1 to the electronic payment server 5-1, and therefore, communication is established between the user communication terminal 4-1 and the electronic payment server 5-1 via the Internet 2 using information about the parking lot, such as the management company name / business name, and user information about the user communication terminal 4-1, and the payment of the calculated parking fee is executed.

[0076] Next, in step 1903, as shown in Fig. 20(B), the user communication terminal 4-1 confirms the settlement upon receipt of the settlement from the electronic settlement server 5-1. At this time, the user communication terminal 4-1 receives the receipt issued by the electronic settlement server 5-1 only when receipt issue is tapped, and the electronic settlement is completed in step 1904. When the vehicle leaves the garage, the vehicle space becomes "0" (vacant), so the order management server 3 records the departure time of the order and closes the order.

[0077] In this way, electronic settlement, so-called code settlement, is performed by communication between the user communication terminals 4-1, 4-2, . . . and the electronic settlement servers 5-1, 5-2, .

[0078] FIG. 21 is a diagram showing a third embodiment of a parking lot system including a vehicle entrance / exit management device according to the present invention.

[0079] In FIG. 21, a cash settlement / electronic settlement machine 16 is provided instead of the electronic settlement machine 15 in FIG.

[0080] FIG. 22 is a front view of the cash settlement / electronic settlement settlement machine 16 and the vehicle entrance / exit management device 12 of FIG.

[0081] 22, the cash settlement / electronic settlement machine 16 also has dimensions of, for example, 45 cm wide x 38.5 cm deep x 150 cm high, and is equipped with a touch panel 161 that also performs dynamic code display DR, as well as a coin slot 162, a bill slot 163, and a change / receipt outlet 164. A coin sorter and a bill identifier (or validator) (not shown) are provided at the coin slot 162 and the bill slot 163, and a change / receipt outlet 164 is provided with a change slot (not shown) and a receipt printer (not shown). These are also connected to the I / O interface 205 of the vehicle entry / exit management device 12 together with the touch panel 151 by electrical wiring C' as shown in FIG. In contrast, the vehicle entry / exit management device 12 has dimensions of, for example, 45 cm wide x 38.5 cm deep x 75 cm high, is separate from the cash payment / electronic payment settlement machine 16, and the electrical wiring C' restricts the placement of the cash payment / electronic payment settlement machine 16 and the vehicle entry / exit management device 12 in the parking lot 1-1. Even in this case, the electrical wiring C' can be made internal by placing only the motherboard of the vehicle entry / exit management device 12 in the cash payment / electronic payment settlement machine 16. As a result, placement work in the parking lot 1-1 becomes easier. In this case, the cash payment / electronic payment settlement machine 16 is called a vehicle compartment authentication device-accommodated cash payment / electronic payment settlement machine.

[0082] Next, the payment routine in the parking lot system of Fig. 21 will be described with reference to Fig. 24 and Fig. 26. The cash payment / electronic payment preparation routine of Fig. 24 is executed by the operation of the touch panel 161 of the cash payment / electronic payment settlement machine 16 by the user, and the electronic payment routine of Fig. 26 is executed by, for example, the user communication terminal 4-1, and as a result, a payment is made between the cash payment / electronic payment settlement machine 16, the order management server 3, the user communication terminal 4-1, and the electronic payment server 5-1.

[0083] The cash settlement / electronic settlement preparation routine based on the operation of the touch panel 161 of the cash settlement / electronic settlement settlement machine 16 in FIG. 24 will be described.

[0084] First, in step 2401, as shown in (A) and (A') of Figure 18, the user responds to a request message for input of a vehicle number or a vehicle compartment number obtained from the order management server 3 via the vehicle entry / exit management device 12 by inputting the selected vehicle number or vehicle compartment number, and taps "Confirm" to send it to the order management server 3.

[0085] Next, in step 2402, as shown in FIG. 18(B), the order management server 3 receives a vehicle image of the vehicle number or vehicle compartment number input by the user in step 2401 and transmits it to the user to confirm whether it is the corresponding vehicle. In this case, the order management server 3 has previously obtained a vehicle image of each vehicle number or vehicle compartment number from the vehicle entry / exit management device 12. As a result, if it is not the corresponding vehicle, "Back" is tapped to return to step 2401 and the vehicle number or vehicle compartment number is re-input. On the other hand, if it is the corresponding vehicle, the process proceeds to step 2403.

[0086] In step 2403, the user confirms the calculated parking fee using the same information shown in Fig. 18(B). In this case, the order management server 3 calculates the parking fee for the vehicle number or space number based on a predetermined parking fee table based on the vacancy information from the vehicle entry / exit management device 12, and transmits it to the user communication terminal 4-1. Therefore, when "Pay parking fee" is tapped, the order management server 3 records the current time as the payment time of the order for the vehicle number or space number.

[0087] Next, in step 2404, the user selects either cash payment or QR payment on the settlement selection screen of the touch panel 161 shown in Fig. 25(A). As a result, if the user taps "cash payment", the process proceeds to steps 2405 and 2406. On the other hand, if the user taps "QR payment", the process proceeds to steps 2407, 2408, and 2409.

[0088] In step 2405, the user inserts cash into the coin insertion slot 161 and / or the bill insertion slot 162. In this case, the remaining balance is displayed as shown in FIG. 25(B). Insert cash until the remaining balance is exhausted. Unless "Cancel / Refund" is tapped, the "Remaining" will be 0 yen, the cash insertion is completed, and the process proceeds to step 2406.

[0089] In step 2406, the completion of settlement is confirmed as shown in (C) of Fig. 25. Only when "Issue receipt" is tapped, is a receipt sent from the change / receipt exit 163, and the process ends in step 2410.

[0090] On the other hand, in step 2407, the order management server 3 displays, for example, a QR code as a dynamic code display DR shown in Fig. 18(C) on the touch panel 161 via the vehicle entry / exit management device 12. This dynamic code display DR includes parking lot information and parking fees for the parking lot. If the user does not tap "Back", the dynamic code display can be erased after a predetermined time by providing steps 2408 and 2409 so that it cannot be seen by anyone other than the user. Then, the process ends in step 2410.

[0091] The electronic payment routine by the user communication terminal 4-1 will be described below with reference to Fig. 26. The routine in Fig. 26 is the same as the routine in Fig. 19.

[0092] First, in step 2601, as shown in FIG. 20A, an electronic settlement service provider (electronic settlement server, for example, 5-1), that is, a provider, is selected in the user communication terminal 4-1.

[0093] Next, in step 2602, the user scans the dynamic code display DR using the camera of the user communication terminal 4-1 and converts the image code into a character code, as shown in (C) of Fig. 18. As a result, "Payment" is tapped and a request is made from the user communication terminal 4-1 to the electronic payment server 5-1, and therefore, communication is established between the user communication terminal 4-1 and the electronic payment server 5-1 via the Internet 2 using information about the parking lot, such as the management company name / business name, and user information about the user communication terminal 4-1, and the parking fee is paid.

[0094] Next, in step 2603, as shown in Fig. 20(B), the user communication terminal 4-1 confirms the settlement upon receipt of the settlement from the electronic settlement server 5-1. At this time, the user communication terminal 4-1 receives the receipt issued by the electronic settlement server 5-1 only when receipt issue is tapped, and the electronic settlement is completed in step 2604. When the vehicle leaves the warehouse, the vehicle number becomes "0" (vacant), so the order management server 3 records the departure time of the order and closes the order.

[0095] In this way, electronic settlement, so-called code settlement, is performed by communication between the user communication terminals 4-1, 4-2, . . . and the electronic settlement servers 5-1, 5-2, .

[0096] In recent years, a multi-payment system has been used in which a parking lot or the like is provided with a single multi-payment terminal corresponding to multiple payment modes and this multi-payment terminal is linked to a multi-payment server via the Internet. Such a multi-payment system can also be adopted in the parking lot system according to the present invention.

[0097] FIG. 27 shows a modification of the parking lot system of FIG. 1, which also employs a multi-payment terminal.

[0098] In FIG. 27, a multi-payment terminal 17 is provided in each of the parking lots 1-1, 1-2, ... in FIG. 1, and is constantly connected to a multi-payment server 6 owned by a multi-payment company (provider) via the Internet 2. That is, each multi-payment terminal 17 is capable of communicating with the multi-payment server 6. As a result, a user can perform a number of payment modes simply by non-contact touching each multi-payment terminal 17. In addition, the order management server 3 is also capable of communicating with each multi-payment terminal 17 via the Internet 2, so that the calculated parking fee is transmitted from the order management server 3 to each multi-payment terminal 17, and the calculated parking fee is recorded and displayed in each multi-payment terminal 17, as described below.

[0099] The multi-payment terminal 17 is configured with a computer configuration having a display unit, and has, as an input unit, for example, a magnetic stripe reader for reading a magnetic card for magnetic credit card payment, a camera for reading barcodes, QR codes, etc. for code payment, an IC reader for reading an IC card for payment with transportation electronic money, etc., in order to enable multiple payment modes. As a result, non-contact touch payment in various payment modes is possible. It also has a printer function for issuing a payment statement (or receipt).

[0100] The multi-payment server 6 is connected to payment agent servers and receiving agency servers (not shown) of other companies via the Internet 2 according to the payment provider of the acquired payment. This makes it possible to handle payments from multiple payment providers.

[0101] Figure 28 is a flow chart for explaining the electronic payment / terminal payment routine in the parking lot system of Figure 27. In Figure 28, steps 1205' and 1206' have been added to Figure 12. That is, either the flow of steps 1205 and 1206 or the flow of steps 1205' and 1206' is selected and executed.

[0102] In step 1204 of FIG. 28, the order management server 3 transmits the calculated parking fee for the vehicle number to the multi-payment terminal 17. As a result, the calculated parking fee is recorded in the RAM or the like of the multi-payment terminal 17 and is displayed on the display unit. At this stage, in step 1200, the user selects either electronic payment (code payment) or terminal payment using the multi-payment terminal 17. In the case of code payment, the flow of steps 1205 and 1206 is executed as in the case of FIG. 12. On the other hand, in the case of terminal payment, if the multi-payment terminal 17 is touched without contact, steps 1205' and 1206' are executed instead of steps 1205 and 1206.

[0103] In step 1205', the payment provider information and user information obtained by the touch operation are acquired and transmitted together with the calculated parking fee to the multi-payment server 6. As a result, the multi-payment server 6 communicates with the payment agent server and the receiving agency server (not shown) as necessary to settle the calculated parking fee.

[0104] Next, in step 1206', the multi-payment server 6 issues a payment statement (or receipt) to the multi-payment terminal 17. As a result, the multi-payment terminal 17 confirms the settlement and receives the payment statement (or receipt). Furthermore, upon receiving the payment completion report from the multi-payment server 6, the order management server 3 records the time of dispatch of the order and closes the order. Then, the process proceeds to step 1207.

[0105] In the parking lot system in Fig. 27, electronic payment by an electronic payment (code payment) company and terminal payment by a multi-payment company are supported in parallel, but if terminal payment includes code payment, it is also possible to have only terminal payment by a multi-payment company. In this case, in Fig. 28, steps 1205 and 1206 are not performed, and only steps 1205' and 1206' are executed.

[0106] FIG. 29 shows a modification of the parking lot system of FIG. 14, which also employs a multi-payment terminal.

[0107] In Fig. 29, a multi-payment terminal 17 is provided in each of the parking lots 1-1, ... in Fig. 14, and is constantly connected to a multi-payment server 6 owned by a multi-payment company (provider) via the Internet 2. In other words, the multi-payment terminal 17 is capable of communicating with the multi-payment server 6. As a result, a user can perform multiple payment modes simply by non-contact touching the multi-payment terminal 17. In addition, the order management server 3 is also capable of communicating with the multi-payment terminal 17 via the Internet 2, so that the calculated parking fee is transmitted from the order management server 3 to the multi-payment terminal 17, and the calculated parking fee is recorded and displayed on the multi-payment terminal 17, as described below.

[0108] Figure 30 is a flow chart for explaining the electronic payment / terminal payment routine in the parking lot system of Figure 29. In Figure 30, steps 1705' and 1706' have been added to Figure 17. That is, either the flow of steps 1704 to 1706 (including the flow of Figure 19) or the flow of steps 1705' and 1706' is selected and executed.

[0109] In step 1703 in FIG. 30, the order management server 3 also transmits the calculated parking fee for the vehicle number to the multi-payment terminal 17. As a result, the calculated parking fee is recorded in the RAM or the like of the multi-payment terminal 17 and is displayed on the display unit. In step 1700, the user selects between electronic payment (code payment) or terminal payment using the multi-payment terminal 17. In the case of code payment, the flow of steps 1704 to 1706 is executed as in the case of FIG. 17. On the other hand, in the case of terminal payment, if the multi-payment terminal 17 is touched without contact, steps 1705' and 1706' are executed instead of steps 1704 to 1706.

[0110] In step 1705', the payment provider information and user information obtained by the touch operation are acquired and transmitted together with the calculated parking fee to the multi-payment server 6. As a result, the multi-payment server 6 communicates with the payment agent server and the receiving agency server (not shown) as necessary to settle the calculated parking fee.

[0111] Next, in step 1706', the multi-payment server 6 issues a payment statement (or receipt) to the multi-payment terminal 17. As a result, the multi-payment terminal 17 confirms the settlement and receives the payment statement (or receipt). Furthermore, upon receiving the payment completion report from the multi-payment server 6, the order management server 3 records the time of dispatch of the order and closes the order. Then, the process proceeds to step 1707.

[0112] In the parking lot system in Fig. 29, electronic payment by an electronic payment (code payment) company and terminal payment by a multi-payment company are made available in parallel, but if terminal payment includes code payment, it is also possible to have only terminal payment by a multi-payment company. In this case, in Fig. 30, steps 1704 to 1706 and the flow in Fig. 19 are not performed, and only steps 1705' and 1706' are executed. Also, in step 1703, the calculated parking fee is sent only to the multi-payment terminal 17.

[0113] FIG. 31 shows a modification of the parking lot system of FIG. 21, which also employs a multi-payment terminal.

[0114] In Fig. 31, a multi-payment terminal 17 is provided in each of the parking lots 1-1, 1-2, ... in Fig. 21, and is constantly connected to a multi-payment server 6 owned by a multi-payment company (provider) via the Internet 2. In other words, the multi-payment terminal 17 is capable of communicating with the multi-payment server 6. As a result, a user can perform multiple payment modes simply by non-contact touching the multi-payment terminal 17. In addition, the order management server 3 is also capable of communicating with the multi-payment terminal 17 via the Internet 2, so that the calculated parking fee is transmitted from the order management server 3 to the multi-payment terminal 17, and the calculated parking fee is recorded and displayed on the multi-payment terminal 17, as described below.

[0115] Figure 32 is a flow chart for explaining the cash payment / electronic payment / terminal payment routine in the parking lot system of Figure 31. In Figure 32, steps 2405' and 2406' are added to Figure 24. That is, one of the flow of steps 2405 and 2406, the flow of steps 2407 to 2409 (including the flow of Figure 26), and the flow of steps 2405' and 2406' is selected and executed.

[0116] In step 2403 in Fig. 32, the order management server 3 also transmits the calculated parking fee for the vehicle number to the multi-payment terminal 17. In step 2404, the user selects cash payment, electronic payment (code payment), or terminal payment using the multi-payment terminal 17. In the case of cash payment, the flow of steps 2405 and 2406 is executed, and in the case of code payment, the flow of steps 2407, 2408, and 2409 is executed. On the other hand, in the case of terminal payment, when the multi-payment terminal 17 is touched without contact, steps 2405' and 2406' are executed.

[0117] In step 2405', the payment provider information and user information obtained by the touch operation are acquired and transmitted together with the calculated parking fee to the multi-payment server 6. As a result, the multi-payment server 6 communicates with the payment agent server and the receiving agency server (not shown) as necessary to settle the calculated parking fee.

[0118] Next, in step 2406', the multi-payment server 6 issues a payment statement (or receipt) to the multi-payment terminal 17. As a result, the multi-payment terminal 17 confirms the settlement and receives the payment statement (or receipt). Furthermore, upon receiving a payment completion report from the multi-payment server 6, the order management server 3 records the time of dispatch of the order and closes the order. Then, the process proceeds to step 2410.

[0119] In the parking lot system in Fig. 31, three payment methods are available: cash payment, electronic payment by an electronic payment (code payment) company, and terminal payment by a multi-payment company. However, if the terminal payment includes code payment, it is also possible to have only two payment methods: cash payment and terminal payment by a multi-payment company. In this case, in Fig. 32, the cash payment flow of steps 2405 and 2406, or the flow of steps 2405' and 2406' is executed. Also, in step 2403, the calculated parking fee is sent only to the multi-payment terminal 17.

[0120] In the modified examples of Figures 27, 29, and 31, a multi-payment terminal 17 having multiple payment modes is provided, but the number of payment modes may be fewer, and the terminal may not have multiple payment modes, but may have a single payment mode. For example, the terminal may have a single payment mode in which only an IC reader for reading an IC card is provided as an input unit. Therefore, the payment terminal in the claims includes both a multi-payment terminal and a single payment mode payment terminal.

[0121] In the above embodiment, one camera 2 is provided, but two or more cameras, the number of which is less than the number of parking spaces, may be provided to capture the entire parking lot. However, the fewer the number of cameras, the greater the effect of reducing equipment costs. In addition, although an unregulated entrance / exit is provided, the present invention can also be applied to a case where a gate machine with a bar, or a regulated entrance / exit with a loop coil, etc. is provided.

[0122] In the above embodiment, both the front image and the rear image of the vehicle are extracted at the same time, but it is sufficient to extract only one of them.

[0123] Furthermore, the present invention can be applied to any modifications within the obvious scope of the above-mentioned embodiments. [Explanation of symbols]

[0124] 1-1, 1-2, ...: Parking lot 11-1, 11-2,…, 11-12: Vehicle interior 11-13, 11-14: Unregulated entrance / exit 12: Vehicle entry / exit management device 12a:Payment machine 13: Camera 13a: Paul 14: Static code unit (board) 15: Electronic payment settlement machine 16: Cash payment / electronic payment settlement machine 151, 161: Touch panel 162: Coin slot 163:Banknote slot 164: Change / receipt exit 17: Multi-payment terminal 2: Internet 3: Order Management Server 4-1, 4-2, ...: User communication terminal 5-1, 5-2, ...: Electronic payment server 6: Multi-payment server 301, 301': CPU 303, 303':ROM 303, 303': Flash memory 304, 304':RAM 305, 305': I / O interface 306, 306': communication interface 307: Image interface 308: Vehicle forward image learning control model 309: Vehicle rear image learning control model DR: Dynamic Code Display

Claims

1. A parking lot having at least one camera capable of capturing an image of the entire parking lot, a vehicle image extraction step of extracting a vehicle front image and / or a vehicle rear image of a vehicle from the images of the camera; a vehicle number extraction step of extracting a vehicle number from the vehicle front image and / or the vehicle rear image; a compartment occupancy determination / compartment number linking step of linking the compartment number of the compartment determined to be full to the vehicle number when the compartment in which the vehicle from which the vehicle number is extracted is determined to be full; A parking lot vehicle entry / exit management program for causing a computer to execute the above.

2. The vehicle image extraction procedure includes: a vehicle front image estimation and extraction step of estimating and extracting the vehicle front image data using a learned vehicle front learning control model with learning vehicle front image data as input data and an image from the camera as input data; a vehicle rear image estimating and extracting step of estimating and extracting the vehicle rear image data by using a learned vehicle rear learning control model with learning vehicle rear image data as input data and with an image from the camera as input data; 2. A parking lot vehicle entry / exit management program executed by a computer according to claim 1, comprising:

3. The procedure for determining whether a vehicle is vacant or not includes the steps of:

2. A parking lot vehicle entry / exit management program to be executed by a computer as described in claim 1, comprising a procedure for determining whether the vehicle space is full or vacant based on the overlap ratio between the vehicle area defined by the projection data of the vehicle from which the vehicle number was extracted and the vehicle compartment area defined by the vehicle compartment area data.

4. 2. The parking lot vehicle entry / exit management program according to claim 1, wherein the parking lot has at least one unregulated entrance / exit.

5. A parking lot having at least one camera capable of capturing an image of the entire parking lot, a vehicle image extraction means for extracting a vehicle front image and / or a vehicle rear image from the image of the camera; a vehicle number extraction means for extracting a vehicle number from the vehicle front image and / or the vehicle rear image; a vehicle compartment occupancy determination / vehicle compartment number linking means for linking the vehicle number of the vehicle compartment determined to be full to the vehicle compartment number when the vehicle compartment in which the vehicle number is extracted is determined to be full; A vehicle entry / exit management device for a parking lot comprising:

6. The vehicle image extraction means a vehicle front image estimation and extraction means for estimating and extracting the vehicle front image data using a learned vehicle front learning control model with learning vehicle front image data as input data and an image from the camera as input data; a vehicle rear image estimation and extraction means for estimating and extracting the vehicle rear image data using a learned vehicle rear learning control model with learning vehicle rear image data as input data and an image from the camera as input data; 6. The vehicle entrance / exit management device for a parking lot according to claim 5, further comprising:

7. The vehicle compartment occupancy determination means 6. A vehicle entry / exit management device for a parking lot as described in claim 5, further comprising a means for determining whether the vehicle space is full or vacant based on the overlap ratio between the vehicle area defined by the projection data of the vehicle from which the vehicle number was extracted and the vehicle compartment area defined by the vehicle compartment area data.

8. 6. The vehicle entrance / exit management device for a parking lot according to claim 5, wherein the parking lot has at least one unregulated entrance / exit gate.

9. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; a static code unit provided in the parking lot, in which parking lot information related to the parking lot and URL information related to the management server are embedded; A parking system comprising:

10. 10. The electronic payment method for a parking system according to claim 9, a first step of scanning the static code unit by a user communication terminal to establish communication between the user communication terminal and the management server based on parking lot information related to the parking lot, URL information related to the management server, and user information related to the user communication terminal; a second step of transmitting a selected vehicle number or a selected cabin number from the user communication terminal to the management server after the first step; a third step of transmitting provider information of the selected electronic settlement server and user information of the user communication terminal for the selected electronic settlement server to the management server after the second step; An electronic payment method in a parking lot system comprising the steps of:

11. The electronic payment method in a parking lot system as described in claim 10 further includes a fourth step, after the second step and before the third step, in which the user communication terminal receives a vehicle image of the selected vehicle number or the selected parking space number from the management server and confirms that it is the relevant vehicle.

12. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; a static code unit provided in the parking lot, in which parking lot information related to the parking lot and URL information related to the management server are embedded as image codes; a payment terminal provided in the parking lot, the payment terminal having a terminal payment information / user information input means for inputting terminal payment information and user information, and a parking fee record display means for recording and displaying the parking fee for the vehicle number or the parking space number; A parking system comprising:

13. 13. The electronic payment / terminal payment method for a parking system according to claim 12, a first step of scanning the static code unit by a user communication terminal to establish communication between the user communication terminal and the management server based on parking lot information related to the parking lot, URL information related to the management server, and user information related to the user communication terminal; a second step of transmitting, after the first step, a selected vehicle number or a selected parking space number of the parking lot from the user communication terminal to the management server; a third step of transmitting, after the second step, a calculated parking fee for the selected vehicle number or the selected parking space number from the management server to the user communication terminal and the payment terminal; a fourth step of transmitting provider information of the electronic payment server selected by the user communication terminal and user information of the user communication terminal for the selected electronic payment server to the management server, and making payment of the calculated parking fee between the management server and the electronic payment server after the third step; or a fifth step of transmitting the terminal payment information and the user information captured by the payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server, and making payment by the terminal payment server; A method for electronic payment / terminal payment in a parking system comprising:

14. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; an electronic payment settlement machine connected to the vehicle entry / exit management device and having a touch panel capable of displaying parking lot information related to the parking lot and the parking fee for the vehicle number or the parking space number as a dynamic code display; A parking system comprising:

15. 15. The parking lot system according to claim 14, wherein the electronic payment settlement machine comprises a vehicle entry / exit management device-accommodating electronic payment settlement machine that accommodates the vehicle entry / exit management device therein.

16. 15. The electronic payment method for a parking system according to claim 14, A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the electronic payment settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting the calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server to the electronic payment settlement machine via the vehicle entry / exit management device after the first step, and displaying the calculated parking fee together with parking lot information of the parking lot as the dynamic code display on the touch panel; a third step of selecting an electronic payment server in the user communication terminal after the second step; a fourth step of scanning the dynamic code display on the touch panel by a camera of the user communication terminal after the third step; An electronic settlement method in a parking lot system having the above.

17. The electronic settlement method in a parking lot system as described in claim 16 further includes a fifth step of, almost simultaneously with the second step, transmitting a vehicle image of the selected vehicle number or the selected parking space number in the parking lot from the management server via the vehicle entry / exit management device to the electronic settlement machine, and displaying the image on the touch panel.

18. The electronic payment method in a parking lot system as described in claim 15, further comprising a sixth step, after the fifth step and before the third step, of confirming that the vehicle image on the touch panel is the vehicle in question.

19. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; an electronic payment settlement machine connected to the vehicle entry / exit management device and having a touch panel capable of displaying parking lot information related to the parking lot and the parking fee for the vehicle number or the parking space number as a dynamic code display; a payment terminal provided in the parking lot, the payment terminal having a terminal payment information / user information importing means for importing terminal payment information and user information and a parking fee recording / displaying means for recording and displaying the parking fee for the vehicle number or the parking space number; A parking system comprising:

20. 20. The method of electronic / terminal payment in a parking system according to claim 19, comprising: A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the electronic payment settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting, after the first step, the calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server via the vehicle entry / exit management device to the electronic payment settlement machine, and also transmitting the calculated parking fee from the management server to the payment terminal, and displaying the calculated parking fee together with parking lot information of the parking lot as the dynamic code display on the touch panel; a third step of selecting an electronic payment server in a user communication terminal after the second step, scanning the dynamic code display on the touch panel with a camera of the user communication terminal, and making a payment between the user communication terminal and the selected electronic payment server based on information on the dynamic code display; or a fourth step of transmitting the terminal payment information and the user information captured by the payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server, and making a payment by the terminal payment server; A method for electronic payment / terminal payment in a parking system comprising:

21. A vehicle authentication device having a storage medium storing the vehicle entry / exit management program according to claim 1 or a vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; a cash settlement / electronic settlement machine connected to the vehicle entry / exit management device and having a touch panel capable of displaying parking lot information related to the parking lot and the parking fee for the vehicle number or the parking space number as a dynamic code display; A parking system comprising:

22. 22. The parking lot system according to claim 21, wherein the cash payment / electronic payment settlement machine comprises a vehicle entry / exit management device-accommodated cash payment / electronic payment settlement machine that accommodates the vehicle entry / exit management device therein.

23. 22. A cash / electronic payment method for a parking system according to claim 21, comprising: A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the cash settlement / electronic settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting the calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server to the cash settlement / electronic settlement settlement machine via the vehicle entry / exit management device after the first step, and displaying the calculated parking fee together with parking information of the parking lot as an image on the touch panel as the dynamic code display; a third step of displaying images of cash payment and electronic payment on the touch panel after the second step and allowing the user to select either the cash payment or the electronic payment; a fourth step of inserting cash for the cash payment into the cash payment / electronic payment settlement machine when the cash payment is selected; a fifth step of displaying parking information of the parking lot and the calculated parking fee as an image on the touch panel as the dynamic code display when the electronic payment is selected; a sixth step of selecting an electronic payment server in the user communication terminal after the fifth step; a seventh step of scanning the dynamic code display on the touch panel by a camera of the user communication terminal after the sixth step; A cash / electronic settlement method in a parking lot system having the above.

24. The cash payment / electronic settlement method in a parking lot system as described in claim 23 further includes an eighth step of, almost simultaneously with the second step, transmitting a vehicle image of the selected vehicle number or the selected parking space number in the parking lot from the management server via the vehicle entry / exit management device to the cash payment / electronic payment settlement machine, and displaying the image on the touch panel.

25. The cash payment / electronic payment method in a parking lot system as described in claim 24, further comprising a ninth step, after the eighth step and before the third step, of confirming that the vehicle image in the vehicle compartment on the touch panel is the corresponding vehicle.

26. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; a cash settlement / electronic settlement machine connected to the vehicle entry / exit management device and having a touch panel capable of displaying parking lot information related to the parking lot and the parking fee for the vehicle number or the parking space number as a dynamic code display; a payment terminal provided in the parking lot, the payment terminal having a terminal payment / user information importing means for importing terminal payment information and user information and a parking fee recording and displaying means for recording and displaying the parking fee for the vehicle number or the parking space number; A parking system comprising:

27. 27. A method for cash / electronic / terminal payment in a parking lot system according to claim 26, comprising: A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the cash settlement / electronic settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting, after the first step, the calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server via the vehicle entry / exit management device to the cash settlement / electronic settlement settlement machine and from the management server to the settlement terminal; a third step of allowing the user to select cash payment, electronic payment, or terminal payment after the second step; a fourth step of inserting cash for the cash payment into the cash payment / electronic payment settlement machine when the cash payment is selected; a fifth step of displaying parking information of the parking lot and the calculated parking fee as the dynamic code display on the touch panel when the electronic payment is selected, and performing a payment between the user communication terminal and the selected electronic payment server based on the dynamic code display scanned by the user communication terminal; a sixth step of transmitting, when the terminal payment is selected, the terminal payment information and the user information captured by the payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server, and making a payment by the terminal payment server; A cash payment / electronic payment / terminal payment method in a parking lot system having the above.

28. 13. The electronic payment method for a parking system according to claim 12, a first step of scanning the static code unit by a user communication terminal to establish communication between the user communication terminal and the management server based on parking lot information related to the parking lot, URL information related to the management server, and user information related to the user communication terminal; a second step of transmitting, after the first step, a selected vehicle number or a selected parking space number of the parking lot from the user communication terminal to the management server; a third step of transmitting a calculated parking fee for the selected vehicle number or the selected parking space number from the management server to the payment terminal after the second step; a fourth step of transmitting the terminal payment information and user information captured by the terminal payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server after the third step, and having the terminal payment server perform payment; A terminal payment method in a parking lot system having the above.

29. A vehicle entry / exit management device having a storage medium storing the vehicle entry / exit management program according to claim 1 or the vehicle entry / exit management device according to claim 5; A management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; an electronic payment settlement machine connected to the vehicle entry / exit management device and having a touch panel capable of displaying images of parking lot information relating to the parking lot; a payment terminal provided in the parking lot, the payment terminal having a terminal payment information / user information importing means for importing terminal payment information and user information and a parking fee recording / displaying means for recording and displaying the parking fee of the vehicle having the vehicle number or the parking space number; In a parking lot system comprising: A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the electronic payment settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting a calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server to the payment terminal after the first step; a third step of transmitting the terminal payment information and user information captured by the payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server after the second step, and making a payment by the terminal payment server; A terminal payment method in a parking lot system having the above.

30. A vehicle authentication device having a storage medium storing the vehicle entry / exit management program according to claim 1 or a vehicle entry / exit management device according to claim 5; a management server capable of communicating with the vehicle entrance / exit management device in order to manage the parking lot for each vehicle number and each vehicle compartment number linked to the vehicle number; a cash settlement / electronic settlement machine connected to the vehicle entrance / exit management device and having a touch panel capable of displaying images of parking lot information relating to the parking lot; a payment terminal provided in the parking lot, the payment terminal having a terminal payment / user information importing means for importing terminal payment information and user information and a parking fee recording and displaying means for recording and displaying the parking fee for the vehicle number or the parking space number; In a parking lot system comprising: A first step of inputting a selected vehicle number or a selected parking space number of the parking lot into the touch panel and transmitting the inputted number from the cash settlement / electronic settlement machine to the management server via the vehicle entry / exit management device; a second step of transmitting a calculated parking fee for the selected vehicle number or the selected parking space number of the parking lot from the management server to the payment terminal after the first step; a third step of prompting the user to select either cash payment or terminal payment after the second step; a fourth step of inserting cash for the cash payment into the cash payment / electronic payment settlement machine when the cash payment is selected; a fifth step of transmitting the terminal payment information and user information captured by the payment terminal and the calculated parking fee for the selected vehicle number or the selected parking space number to a terminal payment server when the terminal payment is selected; and A cash payment / terminal payment method in a parking lot system having the above.

Images