Mechanical parking system, monitoring center for mechanical parking equipment, and program

Abstract

To increase the accuracy of safety confirmation inside a boarding / alighting unit of a mechanical parking equipment.SOLUTION: A mechanical parking system 100 includes a determination unit 62 having an unoccupied determination model for determining the presence or absence of people in an image, and outputting a result of determining the presence or absence of a person in the boarding / alighting section by inputting an image of the inside of the boarding / alighting unit 10 of a mechanical parking equipment 1 into the unoccupied determination model, and a control unit (entering / leaving control device 30) that closes a door 13 provided in the boarding / alighting unit when the determination unit outputs a determination result that the vehicle is unoccupied.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The technology disclosed herein relates to a mechanical parking system, a monitoring center for a mechanical parking facility, and a program. [Background technology]

[0002] Patent Document 1 describes a mechanical parking facility that can be operated using a mobile terminal. More specifically, the mechanical parking facility of Patent Document 1 is equipped with a communication unit that can communicate with a mobile terminal (e.g., a smartphone) owned by a user. If the mobile terminal is connected to the mechanical parking facility, the user can call up a pallet when entering or leaving the facility by operating the mobile terminal. While the pallet is being called up, notes regarding entry or exit are displayed on the mobile terminal, and when the vehicle is placed on the pallet when entering the facility, guidance information regarding the vehicle's stopping position is displayed on the mobile terminal. The user can obtain various information regarding parking through the mobile terminal.

[0003] In the mechanical parking facility of Patent Document 1, after a user gets off his / her car and checks that the surrounding area is safe, the door closes by operating a control panel provided near the entrance / exit.

[0004] Patent Document 2 also describes a mechanical parking facility that can be operated using a mobile terminal. In more detail, the mechanical parking facility of Patent Document 2 displays an operation screen on a mobile terminal (e.g., a tablet terminal) owned by a user, which is the same as the operation panel of the mechanical parking facility. A user can enter or leave the mechanical parking facility by operating the mobile terminal in the same way as when operating the operation panel of the mechanical parking facility.

[0005] In the mechanical parking facility of Patent Document 2, the image of a security camera installed in the boarding / deboarding compartment that records the interior of the compartment is displayed on a mobile terminal. By viewing the security camera image displayed on the mobile terminal, the user can check the safety of the interior of the boarding / deboarding compartment and close the entrance / exit door on the mobile terminal. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2015-108227 A [Patent Document 2] JP 2020-70695 A Summary of the Invention [Problem to be solved by the invention]

[0007] As described in Patent Document 2, before closing the doors of the boarding and alighting area, a safety check must be performed to check whether or not there is anyone inside the boarding and alighting area. The safety check may be performed by users directly visually checking inside the boarding and alighting area, or, as described in Patent Document 2, may be performed based on a video or image captured by a camera installed inside the boarding and alighting area.

[0008] However, when a person checks whether there is anyone in the boarding and disembarking area, whether by directly looking at the vehicle or by looking at a captured image, there is a possibility that mistakes such as overlooking something may occur.

[0009] The technology disclosed herein increases the accuracy of safety confirmation within the boarding and disembarking areas of mechanical parking facilities. [Means for solving the problem]

[0010] The technology disclosed here uses image recognition technology to increase accuracy by having AI (Artificial Intelligence) check for safety based on images taken inside the boarding and disembarking areas.

[0011] Specifically, the technology disclosed herein relates to a mechanical parking system. a determination unit having an unmanned determination model for determining the presence or absence of a person in an image, the determination unit inputting an image taken inside a boarding / alighting section of a mechanical parking facility into the unmanned determination model and outputting a result of determining the presence or absence of a person in the boarding / alighting section; The vehicle is further equipped with a control unit that closes a door provided at the boarding / alighting section when the determination unit outputs a determination result that there is no occupant.

[0012] According to this configuration, the determination unit receives an image captured inside the boarding / alighting section of the mechanical parking facility and determines the presence or absence of a person in the boarding / alighting section using an unmanned determination model. The image may be either a still image or a moving image. Since the determination unit makes the determination without involving a person, it can accurately determine that the boarding / alighting section is unmanned.

[0013] As an example, the unmanned vehicle determination model can be constructed in advance as a model that outputs whether a person is captured in the image (i.e., there is a person in the boarding and alighting section) or not (i.e., there is no person in the boarding and alighting section) by learning a large amount of image data related to the presence or absence of a person in advance using deep learning technology, and can be implemented in the determination section. The unmanned vehicle determination model is not limited to a model constructed using deep learning technology, and may be a model constructed using AI technology other than deep learning (e.g., supervised learning, unsupervised learning, or reinforcement learning).

[0014] The unattended determination model may be constructed as a model capable of determining not only the presence or absence of a person in an image, but also the presence or absence of an animal, such as a pet, in an image.

[0015] Here, since the determination unit performs the determination using images taken inside the boarding and disembarking area, the determination unit can be installed in a location away from the mechanical parking facility by sending the images via communication. The mechanical parking system can be flexibly constructed.

[0016] The control unit closes the door provided in the boarding / alighting section when the determination unit outputs a determination result that there is no one present. The control unit may close the door provided in the boarding / alighting section when the determination unit outputs a determination result that there is no one present and on condition that the operation unit outputs a close signal. The operation unit may output a close signal when a user of the mechanical parking facility or an attendant operates the operation unit. In this way, the user, the attendant, etc. can explicitly indicate their intention to close the door. The control unit may close the door provided in the boarding / alighting section when the determination unit outputs a determination result that there is no one present and on condition that an entrance / exit sensor provided near the entrance / exit of the boarding / alighting section for detecting the entry and exit of people and vehicles to the boarding / alighting section detects the passage of people and vehicles.

[0017] In the mechanical parking system of this configuration, the judgment unit determines whether there is anyone in the boarding and alighting area, thereby increasing the accuracy of safety confirmation within the boarding and alighting area of ​​the mechanical parking facility.

[0018] The determination unit may input a plurality of images captured at different angles to the unmanned determination model.

[0019] By using multiple images taken at different angles, the entire area inside the boarding / alighting section is included in the image without any blind spots. The determination unit inputs multiple images into the unmanned determination model, thereby increasing the accuracy of the determination result of the determination unit.

[0020] The mechanical parking system includes a portable device that uses a camera function to take pictures of the inside of the boarding and disembarking area by operating a predetermined application. The vessel The captured image is input to the unmanned determination model, and the result of determining whether or not a person is present in the boarding and disembarking section is output. do.

[0021] The portable device has a camera function. It is preferable that the portable device also has a communication function. The communication function may be communication by short-distance wireless communication (e.g., Bluetooth (registered trademark) or the like) or may be wide-area communication via an Internet line. The portable device does not need to be a device dedicated to this mechanical parking system. The portable device may be, for example, a commercially available smartphone, tablet terminal, etc. The portable device may be, for example, a portable device owned by a user of the mechanical parking facility. In the following, the mechanical parking system having the above configuration will be described using an example in which a user of the mechanical parking facility uses a commercially available portable device owned by the user, but the subject of the photographing is not limited to the user of the mechanical parking facility. For example, it may be a staff member of the mechanical parking facility. In addition, the portable device is not limited to a commercially available portable device owned by the user.

[0022] Users use the camera function of their portable devices to take pictures inside the boarding and disembarking area. Because they use portable devices, users can take pictures inside the boarding and disembarking area by changing the position and angle from which they take pictures. Unlike fixed cameras installed in the boarding and disembarking area, users can take pictures inside the boarding and disembarking area without blind spots caused by vehicles, etc. In addition, because they use portable devices, users can open the door of their vehicle in the boarding and disembarking area and take pictures inside the vehicle when the vehicle enters the parking lot.

[0023] The determination unit determines whether or not there is a person in the boarding and alighting area by inputting the image captured by the portable device into an unoccupied determination model. Since the images captured by the portable device are images of the inside of the boarding and alighting area taken from various positions and angles, the determination result of the determination unit is more certain that there is no person in the boarding and alighting area. Furthermore, if the determination unit determines that there is no person in the boarding and alighting area using images taken inside the vehicle, the certainty that there is no person in the boarding and alighting area is further increased.

[0024] In addition, the use of a mobile device eliminates the need to install a fixed camera in the boarding and disembarking area. The mechanical parking system can also be retrofitted to an existing mechanical parking facility.

[0025] An identifier that can be identified by image recognition is attached to at least a floor or a wall in the boarding and disembarking area, The application specifies an image to be taken such that the identifier is included in the image; The determination unit may determine whether a shooting angle of the image is appropriate based on an identifier included in the image.

[0026] In this way, a user can take an image at a position and angle where the identifier of the floor or wall is included in the image, and thus an image can be taken without any blind spots in the boarding / alighting area. Even a user with little knowledge can take an image that can confirm that there is no one in the boarding / alighting area without any blind spots.

[0027] Since the identifier is an identifier that can be identified by image recognition, the determination unit can determine whether or not the identifier is included in the captured image by image recognition processing. If the identifier is included in the image, the image can be identified as an image captured at an appropriate position and angle. The determination unit inputs only images with suitable shooting angles into the unmanned determination model, thereby improving the accuracy of determining whether or not there is a person in the boarding and disembarking area.

[0028] If the shooting angle is not suitable, the determination unit may instruct the user to retake the image of the inside of the boarding and disembarking area through an application on the mobile device, thereby increasing the accuracy of the safety confirmation inside the boarding and disembarking area.

[0029] The mechanical parking system comprises: A storage unit that stores images taken inside the boarding and disembarking area; The vehicle may further include a learning unit that causes the unmanned determination model to learn using the images stored in the storage unit.

[0030] The learning unit trains the unmanned determination model using images taken inside the boarding and disembarking area, thereby improving the determination accuracy of the determination unit, thereby increasing the accuracy of safety confirmation inside the boarding and disembarking area.

[0031] The technology disclosed herein relates to a monitoring center for a mechanical parking facility. The Communications Department and A determination unit that outputs a determination result of whether or not the boarding / alighting section of the mechanical parking facility is unoccupied through the communication unit, The determination unit is A non-person detection model is provided to detect the presence or absence of a person in an image; By operating a predetermined application, an image taken by a mobile device that takes pictures of the inside of the boarding and disembarking area using a camera function is Acquired through the communication unit 、 before Record The image is input to the unoccupied determination model, and the result of determining whether or not a person is present in the boarding and alighting section is output.

[0032] The monitoring center in this configuration can remotely determine whether there is anyone in the loading and unloading area. The mechanical parking facility can close the doors upon receiving the determination that there is no one there.

[0033] Since the monitoring center can monitor multiple mechanical parking facilities, each mechanical parking facility can be operated safely without the need for an attendant to be stationed at each facility.

[0034] The technology disclosed herein is Used in the mechanical parking system mentioned above This is an application program that is installed on a mobile device. Using the camera function of the mobile device, an image of the inside of the boarding and disembarking section of the mechanical parking facility is taken, The vehicle has an unmanned vehicle determination model that determines whether or not a person is present in an image, and by inputting the captured image into the unmanned vehicle determination model, it outputs a result of determining whether or not a person is present in the boarding and disembarking area.

[0035] With this configuration, the portable device can take an image of the inside of the boarding and alighting section and determine whether or not there is a person in the boarding and alighting section based on the taken image. A user can use the portable device to check the safety of the boarding and alighting section of the mechanical parking facility. Effect of the Invention

[0036] As described above, according to the mechanical parking system, the monitoring center for the mechanical parking facility, and the program, the judgment unit having the unmanned determination model checks whether or not there is a person in the boarding and alighting area, thereby increasing the accuracy of safety confirmation in the boarding and alighting area. [Brief description of the drawings]

[0037] [Figure 1] FIG. 1 is a schematic diagram illustrating the configuration of a boarding and disembarking section of a mechanical parking facility. [Diagram 2] FIG. 2 is a block diagram illustrating the configuration of a mechanical parking system. [Diagram 3] FIG. 3 is a flow chart illustrating a control procedure for establishing communication between a mobile device and a mechanical parking facility. [Figure 4] FIG. 4 is a flowchart illustrating an example of an entry control procedure of the mechanical parking system. [Diagram 5] FIG. 5 is a flowchart illustrating a procedure for exit control in the mechanical parking system. [Figure 6] FIG. 6 shows an example of a screen relating to a shooting guide displayed on a mobile device. [Figure 7] FIG. 7 shows an example of a screen relating to a shooting guide displayed on a mobile device. [Figure 8] FIG. 8 shows an example of a screen that provides guidance on the shooting position and shooting angle. [Figure 9] FIG. 9 shows an example of a screen relating to a shooting guide displayed on a mobile device. [Figure 10] FIG. 10 shows an example of a screen related to the closing operation displayed on the mobile device. [Figure 11] FIG. 11 is a flowchart illustrating an example of an entry control procedure of a mechanical parking system that does not include a monitoring center. [Figure 12] FIG. 12 is a flowchart illustrating a procedure for exit control in a mechanical parking system that does not include a monitoring center. [Figure 13]FIG. 13 is a flowchart illustrating a procedure of entry control of a mechanical parking system in which unattended parking is determined by a portable device. [Figure 14] FIG. 14 is a flowchart illustrating a procedure of exit control of a mechanical parking system in which unoccupied parking is determined by a portable device. [Figure 15] FIG. 15 is a flowchart illustrating a procedure for controlling entry into a mechanical parking system in which a portable device and a monitoring center communicate directly with each other. [Figure 16] FIG. 16 is a flowchart illustrating a procedure for controlling leaving a parking lot in a mechanical parking system in which a portable device and a monitoring center communicate directly with each other. [Figure 17] FIG. 17 is a schematic diagram illustrating the configuration of a boarding and disembarking section where fixed cameras are installed. [Figure 18] FIG. 18 is a flowchart illustrating a procedure of entry control in a mechanical parking system that does not include a portable device. [Figure 19] FIG. 19 is a flowchart illustrating a procedure for exit control in a mechanical parking system that does not include a portable device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0038] Hereinafter, embodiments of a mechanical parking system, a mechanical parking facility, a monitoring center for the mechanical parking facility, and a program will be described with reference to the drawings. The systems and the like described here are merely examples.

[0039] (Overall configuration of mechanical parking system) FIG. 1 illustrates an example of the boarding and disembarking section 10 of a mechanical parking facility 1. The technology disclosed herein can be applied to various types of mechanical parking facilities 1, such as a tower type, an underground type, and a level reciprocating type. FIG. 2 illustrates an example of the configuration of a mechanical parking system 100. The mechanical parking system 100 includes a mechanical parking facility 1, a portable device 5, and a monitoring center 6. In the example configuration of FIG. 2, the mechanical parking facility 1, the portable device 5, and the monitoring center 6 are each connected to an Internet line 40.

[0040] For ease of explanation, the top of the paper in FIG. 1 will be referred to as the front, the bottom as the rear, the left as the left, and the right as the right, based on the vehicle V entering the boarding and disembarking area 10 when entering the parking area.

[0041] (Configuration of mechanical parking facilities) The boarding / alighting section 10 is a place where users get on and off the vehicle V. In the configuration example of FIG. 1, the mechanical parking facility 1 is a so-called pallet-type parking facility. The pallet-type parking facility includes a pallet 16 on which the vehicle V is placed, and a pallet driving means 14 (see FIG. 2) for transporting the pallet 16. A user places the vehicle V to be entered on the pallet 16 at the boarding / alighting section 10 and disembarks. The user also gets on the vehicle V to be removed that is placed on the pallet 16 at the boarding / alighting section 10. The pallet driving means 14 transports the pallet 16 on which the vehicle V is placed, or the empty pallet 16 on which no vehicle V is placed, between the boarding / alighting section 10 and a plurality of storage units not shown. Note that the mechanical parking facility 1 is not limited to the pallet type.

[0042] The boarding / alighting section 10 includes an entrance / exit gate 12 and a door 13 for opening and closing the entrance / exit gate 12. The entrance / exit gate 12 is provided at the rear of the boarding / alighting section 10. The vehicle V enters the boarding / alighting section 10 through the entrance / exit gate 12 and leaves the boarding / alighting section 10 through the entrance / exit gate 12. The door 13 opens when the vehicle enters the parking lot and when the vehicle leaves the parking lot, and is closed at other times. Although details will be described later, when the vehicle enters the parking lot and when the vehicle leaves the parking lot, it is necessary to perform a safety check to see whether or not there is anyone inside the boarding / alighting section 10 before closing the door 13.

[0043] In the configuration example of FIG. 1, a photoelectric sensor 21 is installed in the boarding / disembarking section 10. A plurality of photoelectric sensors 21 are arranged in the boarding / disembarking section 10. The photoelectric sensors 21 detect objects including people and pets in the boarding / disembarking section 10. Specifically, two photoelectric sensors 21 with optical axes extending in the front-rear direction are arranged at a distance in the left-right direction to the left of the pallet 16. In addition, two photoelectric sensors 21 with optical axes extending in the front-rear direction are arranged at a distance in the left-right direction to the right of the pallet 16. Note that the photoelectric sensors 21 arranged on the left and right of the pallet 16 may each be one each.

[0044] An entrance / exit sensor 22 having an optical axis extending in the left-right direction so as to cross the entrance / exit 12 is disposed near the entrance / exit 12 of the boarding / alighting section 10. The entrance / exit sensor 22 detects the entry / exit of a person or a vehicle V at the boarding / alighting section 10.

[0045] A photoelectric sensor 21 with an optical axis extending in the left-right direction is disposed at the rear of the boarding / disembarking section 10. This photoelectric sensor 21 detects people and objects, and also detects the rear end of the vehicle V to be stored, thereby detecting whether the vehicle V is parked in its designated position on the pallet 16.

[0046] A photoelectric sensor 21 with an optical axis extending in the left-right direction is disposed at the front of the boarding / disembarking section 10. This photoelectric sensor 21 detects people and objects, and also detects the front end of the vehicle V to be stored, to detect whether the vehicle V is protruding from its designated position.

[0047] A vehicle detection sensor 23 having an optical axis extending in the left-right direction so as to cross the pallet 16 is disposed in the center position in the front-rear direction of the boarding / disembarking section 10. The vehicle detection sensor 23 detects whether a vehicle V is parked on the pallet 16. Note that the sensors 21, 22, 23 installed in the boarding / disembarking section 10 may be sensors of other types.

[0048] The pallet driving means 14 includes a driving device for opening and closing the door 13 of the entrance / exit 12, as well as the above-mentioned sensors 21, 22, and 23, in addition to driving the pallets 16. The pallet driving means 14 is driven and controlled by a programmable controller 15. The operation (motion) of the mechanical parking facility 1, which moves the pallets 16, etc., is controlled by the programmable controller 15.

[0049] The operation panel 17 is connected to the programmable controller 15. As illustrated in FIG. 1, the operation panel 17 is disposed outside the boarding / disembarking area 10 and to the right of the entrance / exit gate 12. When a user operates the operation panel 17, an operation signal corresponding to the operation is input to the programmable controller 15, and the programmable controller 15 causes the mechanical parking facility 1 to perform an entrance operation or an exit operation. As will be described later, an operation signal obtained by operating the portable device 5 instead of operating the operation panel 17 can be input to the programmable controller 15 via the communication units (51, 56, 34, 35) to perform an entrance operation or an exit operation.

[0050] The mechanical parking facility 1 is equipped with an entry / exit control device 30. The entry / exit control device 30 is equipped with a control unit 31, a short-range wireless communication unit 34, and a wide-area communication unit 35. The control unit 31 has a central processing unit (hereinafter simply referred to as "CPU") 32, and a storage unit 33 including ROM and RAM for storing computer programs executed by the CPU 32, various data, etc.

[0051] The control unit 31, whose CPU 32 is connected to the programmable controller 15, controls the programmable controller 15. The control unit 31 also stores information on the entered vehicle V and the user, and information on the exited vehicle V and the user in the memory unit 33. The memory unit 33 stores a management list related to the mechanical parking facility 1. The management list includes information on pre-registered users, information on the user's vehicle V, and information on the entry and exit of the vehicle V.

[0052] The short-range wireless communication unit 34 has a transmission / reception function for performing two-way wireless communication with the mobile device 5 in compliance with a short-range wireless communication standard called Bluetooth (registered trademark). The short-range wireless communication unit 34 may perform two-way wireless communication with the mobile device 5 in compliance with other communication standards.

[0053] The wide area communication unit 35 has a transmission / reception function for performing two-way communication via a wide area communication network, for example, an Internet line 40 .

[0054] As described below, the control unit 31 controls the entry and exit operations of the mechanical parking facility 1 through the programmable controller 15 based on various signals from a mobile device 5 connected to the mechanical parking facility 1 via two-way wireless communication.

[0055] (Mobile device configuration) A commercially available mobile phone (for example, a smartphone) can be used as the mobile device 5. In this configuration example, the mobile device 5 is assumed to be owned by the user of the mechanical parking facility 1.

[0056] The portable device 5 includes, for example, a short-range wireless communication unit 56 for performing two-way wireless communication in accordance with the above-mentioned short-range wireless communication standard. The portable device 5 also includes a wide-area wireless communication unit 51 for making calls and connecting to the Internet, a microphone 52 and a speaker 53 mainly for calls, an operation input unit 54, a display unit 55 for displaying characters and images on a screen, the short-range wireless communication unit 56, and a control unit 57 for controlling these. Here, the operation input unit 54 and the display unit 55 are configured by a touch panel display 58. In the portable device 5, all necessary programs and information to be stored are stored in a storage unit 59.

[0057] The mobile device 5 is equipped with a camera 510 and can capture still images and moving images and store them in a memory unit 59. The captured images can also be transmitted to the outside via the wide-area wireless communication unit 51 or the short-range wireless communication unit 56.

[0058] Moreover, application software (hereinafter, referred to as a "parking utilization app"), which is a predetermined program for using the mechanical parking facility 1, is installed in the mobile device 5. For example, the mobile device 5 accesses a site that provides a parking utilization app via the Internet line 40, and installs the parking utilization app downloaded from the site.

[0059] A user who uses the mechanical parking facility 1 using the parking utilization app has previously registered as a member with respect to the mechanical parking system 100. Information on the registered member, specifically, an ID code that identifies the member and information on the vehicle V that will enter the mechanical parking facility 1, are stored in the memory unit 33 of the mechanical parking facility 1 as described above, and are also stored in the memory unit 59 of the mobile device 5 in which the parking utilization app is installed.

[0060] (Monitoring Center Configuration) The monitoring center 6 includes a computer 60. The computer 60 includes a wide area communication unit 61, a determination unit 62, a learning unit 63, and a storage unit 64. The wide area communication unit 61 can communicate with the mobile device 5 or the entry / exit control device 30 of the mechanical parking facility 1 via the Internet line 40.

[0061] The determination unit 62 uses image recognition technology to determine whether or not there is a person inside the boarding and alighting unit 10 of the mechanical parking facility 1. More specifically, the determination unit 62 has an unmanned determination model. The determination unit 62 inputs an image captured inside the boarding and alighting unit 10 into the unmanned determination model, and outputs the result of determining whether or not there is a person inside the boarding and alighting unit 10. The unmanned determination model is constructed in advance as a model that outputs whether or not a person is captured in the image (i.e., there is a person inside the boarding and alighting unit 10) or not (i.e., there is no person inside the boarding and alighting unit 10) by learning a large amount of image data related to the presence or absence of a person in advance using, for example, deep learning technology, and can be implemented in the determination unit 62.

[0062] The unmanned object determination model may be constructed as a model capable of determining not only the presence or absence of a person in an image, but also the presence or absence of an animal such as a pet in an image. In this specification, claims, and drawings, the determination target of the unmanned object determination model is not limited to a person, and may include an animal such as a pet.

[0063] In addition, the unmanned determination model is not limited to a model constructed using deep learning technology and AI technology other than deep learning (e.g., supervised learning, unsupervised learning, or reinforcement learning). An unmanned determination model can be constructed using various image processing technologies. For example, the unmanned determination model may be constructed as a model that outputs whether or not a person (or an object other than a vehicle) is captured in an image based on the difference between an image captured inside the boarding and alighting section 10 when entering or leaving the warehouse and an image captured inside the unmanned boarding and alighting section 10.

[0064] The storage unit 64 stores images captured inside the boarding and disembarking area 10. The learning unit 63 performs machine learning (including deep learning) of the unmanned determination model using the images stored in the storage unit 64. The learning unit 63 performs machine learning of the unmanned determination model, thereby improving the determination accuracy of the unmanned determination model.

[0065] Next, the entry control and exit control in the mechanical parking system 100 having the above-mentioned configuration will be described in detail with reference to the drawings.

[0066] (Linked control of mobile devices and mechanical parking facilities) FIG. 3 is a flowchart illustrating a procedure for establishing two-way communication between the portable device 5 and the mechanical parking facility 1 and linking the portable device 5 and the mechanical parking facility 1.

[0067] When the user starts the parking utilization application on the mobile device 5, the mobile device 5 turns on the short-range wireless communication (step S101). When the mobile device 5 enters a range where it can communicate with the mechanical parking facility 1, the parking utilization application may be automatically started and the short-range wireless communication may be turned on. The mechanical parking facility 1 judges whether or not it has received a communication signal from the mobile device 5 (step S201), and if it has received a communication signal, the mechanical parking facility 1 sends a reply to the mobile device 5 (step S202). The mobile device 5 judges whether or not it has received a reply from the mechanical parking facility 1 (step S102), and if it has received a reply, the mobile device 5 sends the user's ID stored in the storage unit 59 (step S103). Instead of the mobile device 5 automatically sending the user's ID, the mobile device 5 may send the user's ID based on the user manually inputting his or her own ID. The mechanical parking facility 1 receives the ID sent from the mobile device 5 (step S203). If necessary, the mechanical parking facility 1 may perform processing related to the user's ID (for example, a process of confirming whether the ID is stored in the memory unit 33, or a process of authenticating the user including having the user enter a password).

[0068] The mechanical parking facility 1 compares the received ID with the management list stored in the memory unit 33, and determines whether or not the vehicle V corresponding to the received ID has been parked in the mechanical parking facility 1 (step S204). If the vehicle V has been parked, the user is expected to take the vehicle V out, and the process proceeds to the exit control in step S208. The control process of the mechanical parking system 100 proceeds to the flow of FIG. 5. If the vehicle V has not been parked, the user is expected to take the vehicle V in, and the process proceeds to step S205.

[0069] In step S205, the mechanical parking facility 1 judges whether or not the vehicle V can be entered. If entry is possible, the process proceeds to entry control in step S207. The control process of the mechanical parking system 100 proceeds to the flow of FIG. 4. If entry is not possible, the mechanical parking facility 1 transmits entry impossible information to the mobile device 5 (step S206). The mobile device 5 receives the entry impossible information (step S104), and the process ends.

[0070] (warehousing control) FIG. 4 is a flowchart illustrating the control of the mobile device 5, the mechanical parking facility 1, and the monitoring center 6 regarding the entry control in step S207 in FIG.

[0071] First, in step S211, the mechanical parking facility 1 calls an empty pallet 16, and in the following step S212, it is determined whether or not the empty pallet 16 has arrived at the boarding and disembarking area 10. If the empty pallet 16 has arrived, the process proceeds from step S212 to step S213. In step S213, the mechanical parking facility 1 transmits arrival information of the empty pallet 16. The portable device 5 determines whether or not it has received arrival information of the empty pallet 16 (step S111), and if it has been received, the process proceeds from S111 to S112.

[0072] In step S214, the mechanical parking facility 1 opens the door 13. The mobile device 5 that has received the arrival information of the empty pallet 16 in step S111 may display a message encouraging the user to open the door, and after the user confirms the safety around the door 13, the user may operate the operation button displayed on the mobile device 5 to send an instruction to open the door 13 to the mechanical parking facility 1, and the mechanical parking facility 1 that has received this instruction opens the door in step S214. The user drives the vehicle V through the entrance / exit 12 into the boarding / disembarking section 10 and places the vehicle V on the pallet 16. Based on the detection of the various sensors 21, 22, and 23, the user parks the vehicle V at a designated position. The user then gets off the vehicle V.

[0073] The user who has disembarked takes a picture of the inside of the boarding and disembarking section 10 using the mobile device 5. In step S112, the parking utilization application of the mobile device 5 provides the user with a guide to take pictures. FIG. 6 illustrates an example of an initial screen D1 of the photography guidance displayed on the display unit 55 of the mobile device 5. In the example of the initial screen of FIG. 6, the user is instructed to stand at each of the four corners of the boarding and disembarking section 10, front, rear, left, and right, and to take a picture of the center of the boarding and disembarking section 10. The screen D1 has four buttons, a "right rear" button, a "left rear" button, a "right front" button, and a "right rear" button. The user selects the four buttons in order. When the user performs a button selection operation, the process of the flow of FIG. 4 proceeds from step S112 to step S113, and the parking utilization application starts the camera 510 of the mobile device 5. In addition, the following screen is displayed on the mobile device 5.

[0074] 7 shows an example of a shooting guide screen D2 that is displayed on the mobile device 5 when the "Right Rear" button is selected. On the screen D2, an image captured by the camera function of the mobile device 5 is displayed, and three frames 18 are displayed so as to overlap the image.

[0075] When the user selects the "Right Rear" button, he or she stands at the right rear corner of the boarding / alighting area 10 and takes an image of the center of the boarding / alighting area 10 from there. Here, as shown in Fig. 1, identifiers 11 that can be identified by image recognition, which will be described later, are attached to predetermined locations on the floor and walls of the boarding / alighting area 10. The identifiers 11 are attached, for example, to eight locations in total, two locations on each of the front, rear, left, and right walls, and two locations on each of the left and right sides of the pallet 16, for a total of four locations.

[0076] In the illustrated example, the identifier 11 is a two-dimensional code (e.g., a QR code (registered trademark)). On the photography guide screen D2, the user is guided to photograph the inside of the boarding and alighting area 10 at an angle where the identifiers 11 affixed to the floor and wall fit into each of the three displayed frames 18. In other words, the parking utilization app specifies the image to be photographed. The user follows the guidance, adjusts the orientation of the mobile device 5, and photographs the inside of the boarding and alighting area 10. The user can use the mobile device 5 to photograph an image of a range that includes the area that needs to be photographed.

[0077] FIG. 8 (a) shows an example of a screen when the "right rear" button is selected, (b) shows an example of a screen when the "left rear" button is selected, (c) shows an example of a screen when the "right front" button is selected, and (d) shows an example of a screen when the "left front" button is selected. When the "left rear" button is selected, a user stands in the left rear corner of the boarding / alighting section 10 and takes a picture of the center of the boarding / alighting section 10 from there. When the "right front" button is selected, a user stands in the right front corner of the boarding / alighting section 10 and takes a picture of the center of the boarding / alighting section 10 from there. When the "left front" button is selected, a user stands in the left front corner of the boarding / alighting section 10 and takes a picture of the center of the boarding / alighting section 10 from there.

[0078] The three frames 18 are located at the bottom center, the upper left, and the upper right of each screen. The frame 18 at the bottom center corresponds to the identifier 11 affixed to the floor of the boarding and disembarking section 10. The frames 18 at the upper left or upper right each correspond to the identifier 11 affixed to the wall of the boarding and disembarking section 10. Note that the operation of selecting the four buttons in step S112 may be omitted, and the location where the image was taken may be automatically determined based on the information of the identifier 11 included in the photographed image, and the remaining locations where photography has not been performed may be displayed (photography guide) so that the remaining locations may be known.

[0079] The parking utilization app guides the user to take pictures, and the user can use the mobile device 5 to take pictures of the inside of the boarding / alighting area 10 without any blind spots. The taken images are used for image recognition, as described later, and since even a user who has little knowledge about safety checks inside the boarding / alighting area 10 can take appropriate images, the mechanical parking system 100 can accurately determine whether or not there is a person inside the boarding / alighting area 10.

[0080] When vehicle V is parked, the parking utilization app instructs the user to take pictures of the interior of the vehicle V in addition to taking pictures of the exterior of the vehicle V, as shown in FIG. 9 for example. The user follows the instructions, opens the door of the vehicle V, and takes pictures of the interior. The image of the interior of the vehicle may be one or multiple. By using the mobile device 5, the user can easily take pictures of the interior of the vehicle. By taking pictures of the interior of the vehicle, it is possible to confirm that no one is inside the vehicle V to be parked.

[0081] When the user takes the necessary images, the mobile device 5 transmits the taken images (step S114). The images may be transmitted all at once when the parking utilization app determines that all the necessary images have been taken, or may be transmitted each time an image is taken.

[0082] In step S215, the mechanical parking facility 1 determines whether it has received all the images, for example, at least five images, including four images of the exterior of the vehicle and at least one image of the interior of the vehicle, in the case of parking entry. If all the images have been received, the process proceeds to step S216. In step S216, the mechanical parking facility 1 transfers the images to the monitoring center 6.

[0083] The monitoring center 6 judges whether an image has been received through the wide area communication unit 61 (step S311). If an image has been received, the process proceeds from step S311 to step S312. The judgment unit 62 outputs the result of judging whether or not there is a person in the boarding and alighting unit 10 by inputting the received image into the unmanned determination model. The monitoring center 6 then transmits the judgment result to the mechanical parking facility 1 (step S313). The monitoring center 6 also stores the image used for the unmanned determination in the storage unit 64. As described above, the learning unit 63 executes machine learning of the unmanned determination model using the images stored in the storage unit 64. In addition, the stored images can be used, for example, to analyze the cause when an unexpected situation occurs, or to statistically investigate the implementation status of safety confirmation.

[0084] When the mechanical parking facility 1 receives the determination result from the monitoring center 6, it transfers the determination result to the mobile device 5 (step S217).

[0085] The mobile device 5 receives the result of the determination by the determination unit 62 of the monitoring center 6 and determines whether or not it is determined that there is no one there (step S115). If there is no one there, the process proceeds to step S116. If there is no one there, the process returns to step S112. The user confirms that there is no one there, takes an image of the inside of the boarding and alighting unit 10 again, and transmits the image to the mechanical parking facility 1 (steps S112 to S114). The mechanical parking facility 1 transfers the image (steps S215, S216), and the determination unit 62 of the monitoring center 6 determines again whether there is no one there in the boarding and alighting unit 10 based on the re-taken image (steps S311 to S314). If it is determined that there is no one there, the image determined to be not unattended may be displayed on the mobile device 5 to allow the user to check the inside of the lot and take action, or if there is clearly a false detection by the determination unit, the user may input that it is a false detection and proceed to step S116.

[0086] If it is determined that there is no one in the parking lot, the user performs a close operation of the door 13 on the mobile device 5 (step S116). FIG. 10 shows an example of a close operation screen D4 of the mobile device 5. The parking utilization app makes the "close door" button inoperable (for example, grayed out) on the close operation screen D4 as shown in the left figure while it is not determined that there is no one in the parking lot, and makes the "close door" button operable as shown in the right figure if it is determined that there is no one in the parking lot. After confirming that there is no one in the boarding and disembarking area 10, the user operates the "close door" button on the mobile device 5. If there is a button operation, the process proceeds from step S116 to step S117, and the mobile device 5 transmits a door close signal to the mechanical parking facility 1.

[0087] The mechanical parking facility 1 determines whether or not it has received a door close signal from the portable device 5 (step S218). If it has received a door close signal, the process proceeds from step S218 to step S219, and the mechanical parking facility 1 closes the door 13.

[0088] Furthermore, after step S217, if the mechanical parking facility 1 determines that there is no one in the boarding and alighting area 10, it waits for a closing signal from the portable device 5, and if there is no one in the boarding and alighting area 10, it waits for a re-taken image to be sent.

[0089] (Shipping control) FIG. 5 is a flowchart illustrating the control of the mobile device 5, the mechanical parking facility 1, and the monitoring center 6 regarding the leaving control in step S208 in FIG.

[0090] First, in step S221, the mechanical parking facility calls up the pallet 16 on which the vehicle V corresponding to the user's ID is placed. The subsequent steps S222 to S224 are substantially the same as steps S212 to S214 in the flow of FIG.

[0091] When the pallet 16 arrives at the boarding / disembarking section 10 and the door 13 opens, the user gets into the vehicle V and causes the vehicle V to exit the boarding / disembarking section 10 through the entrance / exit 12. When the vehicle V exits, the user gets off the vehicle V and photographs the interior of the boarding / disembarking section 10 (see FIGS. 6 to 8). Steps S122 to S123 in the portable device 5 are substantially the same as steps S112 to S113 in the flow of FIG. 4. Note that, in the exit control, since the vehicle V is not in the boarding / disembarking section 10, photographing of the interior is not performed. In addition, since there are no blind spots due to the vehicle V, the number of locations to be photographed may be reduced to, for example, one or two locations.

[0092] When the user has taken all the images inside the boarding and disembarking area 10, the mobile device 5 transmits the captured images (four images in this case) to the mechanical parking facility 1 (step S124). The mechanical parking facility 1 transfers the received images to the monitoring center 6 (steps S225, S226).

[0093] When the monitoring center 6 receives an image (step S321), the determination unit 62 inputs the received image into the unmanned determination model and outputs the determination result as to whether or not there is an unmanned person in the boarding / alighting area 10 (step S322), as described above. The monitoring center 6 transmits the determination result to the mechanical parking facility 1 through the wide area communication unit 61 (step S323), and also stores the image (step S324).

[0094] The mechanical parking facility 1 transfers the determination result of the monitoring center 6 to the portable device 5 (step S227). If there is no one in the boarding / alighting area 10, the mechanical parking facility 1 waits for a close signal from the portable device 5. If there is no one in the area, the mechanical parking facility 1 waits for the transmission of a re-captured image.

[0095] If the monitoring center 6 determines in the portable device 5 that the parking area is not unattended, the process returns from step S125 to step S122 to retake an image. If the determination result is that the parking area is unattended, the portable device 5 waits for the user to perform a closing operation (step S126), and when the user performs the closing operation, the portable device 5 transmits a closing signal to the mechanical parking facility 1 (step S127). The mechanical parking facility 1 that has received the door closing signal closes the door 13 (steps S228, S229).

[0096] In this way, the mechanical parking system 100 uses the camera function of the portable device 5 to take pictures inside the boarding and alighting area 10. Unlike a fixed camera arranged inside the boarding and alighting area 10, the user can take pictures inside the boarding and alighting area 10 without any blind spots. In addition, the parking utilization app guides the user to take pictures, so that the user can take pictures inside the boarding and alighting area 10 from an appropriate position and angle.

[0097] When the mechanical parking facility 1 confirms through the short-range wireless communication unit 34 or the wide-area communication unit 35 that the portable device 5 has output a close signal and that at least the portable device 5 has photographed the inside of the boarding / alighting section 10 (steps S216, S217, S226, S227), it closes the door 13. Since photographing the inside of the boarding / alighting section 10 using the portable device 5 increases the certainty that no one is inside the boarding / alighting section 10, the mechanical parking system 100 can close the door 13 while ensuring that no one is inside the boarding / alighting section 10.

[0098] In addition, in the mechanical parking system 100 having the above configuration, the determination unit 62 of the monitoring center 6 determines the presence or absence of a person in the boarding / alighting area 10 based on the image. Since the determination unit 62 makes the determination without human intervention, it can accurately determine that the boarding / alighting area 10 is unoccupied.

[0099] Therefore, by combining photographing the inside of the boarding and alighting area 10 using the portable device 5 and the judgment unit 62 determining whether there is anyone inside the boarding and alighting area 10 based on that image, the mechanical parking system 100 can determine with an even higher degree of accuracy that there is no one inside the boarding and alighting area 10, and can close the door 13 of the boarding and alighting area 10 based on that judgment.

[0100] Here, the determination unit 62 of the monitoring center 6 may determine whether the identifier 11 is present at an appropriate position in the image, in other words, whether the image has been taken at an appropriate position and an appropriate angle, in addition to determining whether or not there is a person in the boarding and disembarking area 10. Since the identifier 11 consisting of a two-dimensional code can be identified by image recognition as shown in the figure, the determination unit 62 can compare the position of the identifier 11 in the captured image with the position of the frame 18. The determination unit 62 can determine whether or not the identifier 11 is located within the frame 18.

[0101] When the determination unit 62 determines that the identifier 11 is not located within the frame 18, the mechanical parking system 100 may prompt the user to retake an image of the inside of the boarding / alighting area 10 via the mobile device 5. In other words, the parking utilization app may specify an image to be taken again.

[0102] In addition, instead of the determination unit 62 of the monitoring center 6 determining the position of the identifier 11, the parking utilization app of the mobile device 5 may determine whether or not the identifier 11 is located within the frame 18 while the user is taking a photo, and if necessary, prompt the user to take the photo inside the boarding and disembarking area 10 again.

[0103] The identifier 11 is not limited to the two-dimensional code described above. Any identifier 11 may be used as long as it can be identified by image recognition. In addition, the position and direction within the boarding and disembarking area 10 may be determined from a captured image, for example, by AI, without using an identifier.

[0104] Furthermore, the monitoring center 6 is not limited to monitoring one mechanical parking facility 1, but can monitor multiple mechanical parking facilities 1 located at various locations. By providing a determination unit 62 in the monitoring center 6, the monitoring center 6 can perform unmanned determination for the boarding and disembarking sections 10 of each of the multiple mechanical parking facilities 1. Even if an attendant is not always present at each mechanical parking facility 1, this mechanical parking system 100 can safely operate each mechanical parking facility 1. In addition, when the determination unit 62 provided in the monitoring center 6 is a model constructed using AI technology, there is also the advantage that the model can be easily updated.

[0105] Another advantage of the mechanical parking system 100 is that it can be constructed even for an existing mechanical parking facility 1 that does not have a fixed camera installed in the boarding and disembarking area 10 by simply adding a communication unit, etc.

[0106] (First modified example of mechanical parking system) In the mechanical parking system 100 shown in Fig. 2, the monitoring center 6 judges whether or not there is a person in the boarding / disembarking area 10, but the judgment unit may be provided in a location other than the monitoring center 6. Although not shown in the figure, for example, the mechanical parking facility 1 may be provided with a judgment unit that judges whether or not there is a person based on an image. In this case, the monitoring center 6 can be omitted from the mechanical parking system 100.

[0107] 11 illustrates a flowchart of entry control of the mechanical parking system 100 in which the mechanical parking facility 1 is equipped with a determination unit. The flowchart in FIG. 11 corresponds to the flowchart in FIG.

[0108] Steps S231 to S234 are the same as steps S211 to S214 in the flow of FIG. 4. The mechanical parking facility 1 calls an empty pallet 16 (step S231), and when the empty pallet 16 arrives at the boarding / disembarking section 10, the mechanical parking facility 1 transmits arrival information of the empty pallet to the mobile device 5 (steps S232, S233). The mechanical parking facility 1 opens the door 13 (step S234). When the mobile device 5 receives the arrival information of the empty pallet 16, the process proceeds from S131 to S132. The user drives the vehicle V into the boarding / disembarking section 10 and parks the vehicle V at a predetermined position on the pallet 16. The user then gets off the vehicle V.

[0109] Steps S132 to S134 are the same as steps S112 to S114 in the flow of Fig. 4. The mobile device 5 guides the user to take a photograph (step S132) and starts up the camera 510 (step S133). As described above, the user takes a photograph of the inside of the boarding and disembarking area 10 from a specified position at a specified angle (see Figs. 6 to 9). When the user takes a photograph of the specified image using the mobile device 5, the mobile device 5 transmits the taken image (step S134).

[0110] The mechanical parking facility 1 judges whether all images have been received (step S235). If all images have been received, the process proceeds from step S235 to step S236. In step S236, the judgment unit of the mechanical parking facility 1 inputs the received images to an unmanned determination model and outputs a judgment result as to whether the boarding / alighting section 10 is unmanned. The mechanical parking facility 1 also transmits the judgment result to the mobile device 5 via the short-range wireless communication unit 34, and stores the images, for example, in the storage unit 33 (step S237). The learning unit of the mechanical parking facility 1 uses the stored images to perform machine learning of the unmanned determination model.

[0111] The mobile device 5 receives the determination result by the determination unit of the mechanical parking facility 1. If there is no occupant, the process proceeds from step S135 to step S136. If there is no occupant, the process returns to step S132, where the user confirms that the boarding and alighting section 10 is unoccupied and photographs the boarding and alighting section 10 again (steps S132 to S134). The determination unit of the mechanical parking facility 1 once again determines whether there is no occupant inside the boarding and alighting section 10 based on the re-photographed image.

[0112] When it is determined that the user is unattended, the user performs a closing operation of the door 13 using the closing operation screen D4 in Fig. 10 (step S136). When the user performs the operation, the mobile device 5 transmits a door closing signal to the mechanical parking facility 1 (step S137).

[0113] The mechanical parking facility 1 determines whether or not a door close signal has been received from the portable device 5 (step S238), and if a door close signal has been received, the mechanical parking facility 1 closes the door 13 (step S239).

[0114] 12 illustrates a flowchart of the exit control of the mechanical parking system 100 in which the mechanical parking facility 1 includes a determination unit. FIG. 12 corresponds to the flow in FIG.

[0115] Steps S241 to S244 are the same as steps S221 to S224 in the flow of FIG. 5. The mechanical parking facility 1 calls the pallet 16 on which the vehicle V corresponding to the user's ID is placed (step S241), and when the pallet 16 arrives at the boarding / alighting section 10, the mechanical parking facility 1 transmits arrival information of the pallet 16 to the mobile device 5 (steps S242, S243). The mechanical parking facility 1 opens the door 13 (step S244). When the mobile device 5 receives the arrival information of the pallet 16, the process proceeds from S141 to S142. The user gets in the vehicle V and causes the vehicle V to exit the boarding / alighting section 10. The user then gets out of the vehicle V.

[0116] Steps S142 to S144 are the same as steps S122 to S124 in the flow of Fig. 5. The mobile device 5 guides the user to take a photograph (step S142) and activates the camera 510 (step S143). As described above, the user takes a photograph of the inside of the boarding and disembarking area 10 from a specified position at a specified angle (see Figs. 6 to 8). When the user takes a photograph of the specified image using the mobile device 5, the mobile device 5 transmits the photographed image (step S144).

[0117] As in the case of entry control, when the mechanical parking facility 1 receives all the images (step S245), the determination unit of the mechanical parking facility 1 inputs the received images into the unmanned determination model and outputs the determination result as to whether or not there is no one in the boarding / alighting area 10 (step S246). The mechanical parking facility 1 transmits the determination result to the mobile device 5 via the short-range wireless communication unit 34, and stores the images, for example, in the storage unit 33 (step S247). The learning unit of the mechanical parking facility 1 uses the stored images to perform machine learning of the unmanned determination model.

[0118] The portable device 5 receives the judgment result by the judgment unit of the mechanical parking facility 1. If there is no occupant, the process returns to step S142 to take another photograph. If there is no occupant, the process waits for the user to perform a closing operation (step S146, FIG. 10), and when the user performs a closing operation, the portable device 5 transmits a close signal to the mechanical parking facility 1 (step S147). The mechanical parking facility 1, which has received the door close signal, closes the door 13 (steps S248, S249).

[0119] Similarly to the above, the mechanical parking system 100 configured as above can determine with a high degree of accuracy that there is no one inside the boarding / alighting area 10 by combining the photographing of the inside of the boarding / alighting area 10 using the mobile device 5 with the unoccupied determination by AI, and can close the door 13 of the boarding / alighting area 10 based on the determination. Furthermore, by providing a determination unit in each mechanical parking facility 1, it is possible to avoid multiple determination processes being concentrated at the same time, and it is expected that the processing load can be reduced.

[0120] (Second modified example of mechanical parking system) The portable device 5 may include the determination unit. Figures 13 and 14 are flowcharts illustrating the entry control and exit control of the mechanical parking system 100 in which the portable device 5 determines whether the vehicle is unoccupied.

[0121] The flowchart in Fig. 13 corresponds to the flowchart in Fig. 4 or 11. Steps S251 to S254 are the same as steps S211 to S214 in the flow in Fig. 4, and step S151 is the same as step S111 in the flow in Fig. 4.

[0122] The user who places the vehicle V to be stored on the pallet 16 in the boarding / disembarking section 10 follows the photography guide of the portable device 5 to take a designated image (steps S152, S153, see Figs. 6 to 9). The determination section of the portable device 5 inputs the photographed image to an unmanned determination model and outputs a determination result as to whether or not the boarding / disembarking section 10 is unmanned (step S154). If the determination result of the unmanned determination model is that there is no one in the boarding / disembarking section 10, the process proceeds from step S155 to step S156, and the portable device 5 waits for the user to close the door. If there is no one in the boarding / disembarking section 10, the process returns to step S152, and the portable device 5 prompts the user to take another photograph, as described above.

[0123] When the user performs a door closing operation on the mobile device 5 (step S156, see FIG. 10), the mobile device 5 transmits a door closing signal to the mechanical parking facility 1 (step S157). When the mechanical parking facility 1 receives the door closing signal (step S255), it closes the door 13 (step S256).

[0124] The flowchart in Fig. 14 corresponds to the flowchart in Fig. 5 or 12. Steps S261 to S264 are the same as steps S221 to S224 in the flow in Fig. 5, and step S161 is the same as step S121 in the flow in Fig. 4.

[0125] The user who has caused the vehicle V to be taken out of the boarding and disembarking section 10 to exit the vehicle V disembarks. The user also photographs a designated image according to the photographing guide of the portable device 5 (steps S162, S163, see Figs. 6 to 8). Here, the determination unit of the portable device 5 may specify the image (location and angle) to be photographed in real time based on the identifier 11 in the image. The determination unit of the portable device 5 inputs the photographed image to an unmanned determination model and outputs a determination result as to whether or not the boarding and disembarking section 10 is unmanned (step S164). If the determination result of the unmanned determination model is unmanned, the process proceeds from step S165 to step S166, and the portable device 5 waits for the user to close the door. If the vehicle is not unmanned, the process returns to step S162, and the portable device 5 prompts the user to photograph again as described above.

[0126] When the user performs a door closing operation on the portable device 5 (step S166, see FIG. 10), the portable device 5 transmits a door closing signal to the mechanical parking facility 1 (step S167). When the mechanical parking facility 1 receives the door closing signal (step S265), it closes the door 13 (step S266).

[0127] Similarly to the above, the mechanical parking system 100 of this configuration can determine with a high degree of accuracy that there is no one inside the boarding / alighting area 10 by combining photographing the inside of the boarding / alighting area 10 using the portable device 5 with unoccupied determination using AI, and can close the door 13 of the boarding / alighting area 10 based on that determination.

[0128] In the portable device 5, unless the determination unit outputs a determination result that the boarding / alighting section 10 is unoccupied, the door 13 cannot be closed and a close signal cannot be output. By receiving the close signal from the portable device 5, the mechanical parking facility 1 can confirm through the short-range wireless communication unit 34 that the portable device 5 has output a close signal and that the portable device 5 has photographed the inside of the boarding / alighting section 10. The mechanical parking facility 1 can close the door 13 by ensuring that the boarding / alighting section 10 is unoccupied. According to this modified example, a system can be easily constructed by adding a communication unit or the like to, for example, an existing mechanical parking facility.

[0129] (Third variant of mechanical parking system) In the flowcharts illustrated in Figures 4 and 5, the mechanical parking facility 1 transfers images and the like between the mobile device 5 and the monitoring center 6. Alternatively, the mechanical parking system 100 may be configured so that the mobile device 5 and the monitoring center 6 directly transmit and receive images and the like.

[0130] In this modified example, although not shown, control for establishing two-way communication between the mobile device 5 and the monitoring center 6 is performed in accordance with the flow of FIG.

[0131] 15 and 16 show an example of a flowchart of entry control and a flowchart of exit control in the mechanical parking system 100 configured so that the mobile device 5 and the monitoring center 6 directly transmit and receive images and the like.

[0132] The flowchart in Fig. 15 corresponds to the flowchart in Fig. 4. Steps S271 to S274 in Fig. 15 are the same as steps S211 to S214 in Fig. 4, and steps S171 to S173 are the same as steps S111 to S113 in Fig. 4.

[0133] The portable device 5 transmits an image taken by the user using the portable device 5 to the monitoring center 6 via the wide-area wireless communication unit 51 (step S174). The monitoring center 6 determines whether or not an image has been received from the portable device 5 (step S371), and if an image has been received, the process proceeds from step S371 to step S372. The determination unit 62 of the monitoring center 6 inputs the image into an unmanned determination model to output a determination result as to whether or not there is no one in the boarding and disembarking section 10 (step S372). The monitoring center 6 transmits the determination result to the portable device 5 via the Internet line 40, and the portable device 5 directly receives the determination result from the monitoring center 6 via the wide-area wireless communication unit 51. If the determination result indicates that there is no one in the vehicle, the process proceeds from step S175 to step S176, and the portable device 5 waits for a closing operation by the user. When the user performs a closing operation (step S176), the portable device 5 transmits a door close signal to the mechanical parking facility 1 through the short-range wireless communication unit 56 (step S177). When the mechanical parking facility 1 receives the door close signal from the portable device 5 (step S275), it closes the door 13 (step S276).

[0134] The flowchart in Fig. 16 corresponds to the flowchart in Fig. 5. Steps S281 to S284 in Fig. 16 are the same as steps S221 to S224 in Fig. 5, and steps S181 to S183 are the same as steps S121 to S123 in Fig. 5.

[0135] The portable device 5 transmits an image taken by the user using the portable device 5 to the monitoring center 6 via the wide-area wireless communication unit 51 (step S184). The monitoring center 6 determines whether or not an image has been received from the portable device 5 (step S381), and if an image has been received, the process proceeds from step S381 to step S382. The determination unit 62 of the monitoring center 6 inputs the image into an unmanned determination model to output a determination result as to whether or not there is no one in the boarding and disembarking section 10 (step S382). The monitoring center 6 transmits the determination result to the portable device 5 via the Internet line 40, and the portable device 5 directly receives the determination result from the monitoring center 6 via the wide-area wireless communication unit 51. If the determination result indicates that there is no one in the vehicle, the process proceeds from step S185 to step S186, and the portable device 5 waits for a closing operation by the user. When the user performs a closing operation (step S186), the portable device 5 transmits a door close signal to the mechanical parking facility 1 through the short-range wireless communication unit 56 (step S187). When the mechanical parking facility 1 receives the door close signal from the portable device 5 (step S285), it closes the door 13 (step S286).

[0136] Even in this third modified example, unless the determination unit of the portable device 5 outputs a determination result that no one is inside the boarding and alighting section 10, the door 13 cannot be closed and a close signal cannot be output. By receiving a close signal from the portable device 5, the mechanical parking facility 1 can confirm through the short-range wireless communication unit 34 that the portable device 5 has output a close signal and that the portable device 5 has photographed the inside of the boarding and alighting section 10. The mechanical parking facility 1 can close the door 13 by ensuring that no one is inside the boarding and alighting section 10.

[0137] Although not shown in the figure, instead of transmitting a door close signal from the portable device 5 to the mechanical parking facility 1, the portable device 5 may transmit a door close signal to the monitoring center 6, and the monitoring center 6, upon receiving the door close signal, may transfer the door close signal to the mechanical parking facility 1. In this case, the establishment of two-way communication between the portable device 5 and the mechanical parking facility 1 can be omitted. Even in this configuration example, the mechanical parking facility 1 can confirm that the portable device 5 has output a close signal and that the portable device 5 has photographed the inside of the boarding and disembarking area 10 based on the door close signal transferred from the monitoring center 6. According to this modified example, a system can be easily constructed by adding a communication unit or the like to an existing mechanical parking facility, for example.

[0138] (Fourth variant of mechanical parking system) In the above-mentioned mechanical parking system, when the mobile device 5 receives the judgment result of the judgment unit and the boarding / disembarking unit 10 is unoccupied, the mobile device 5 switches whether or not the door 13 can be closed. In contrast to this, for example, when the mechanical parking facility 1 receives a door close signal from the mobile device 5, if the boarding / disembarking unit 10 is unoccupied, the door 13 may be closed. Specifically, for example, in the flowchart of FIG. 4, the mechanical parking facility 1 omits step S217 for transferring the judgment result from the monitoring center 6 to the mobile device 5. In addition, the mobile device 5 omits the judgment step of step S115 and transmits a door close signal to the mechanical parking facility 1 in response to the user's operation, regardless of the judgment result of the judgment unit 62. When the mechanical parking facility 1 receives the judgment result from the monitoring center 6 and judges that the boarding / disembarking unit 10 is unoccupied and receives a door close signal, it closes the door 13 (step S219). Note that the same change may be made in the flowchart of FIG. 5 and the like.

[0139] Also, instead of performing the closing operation of the door 13 on the mobile device 5, the user may perform the closing operation of the door 13 on the operation control panel 17 of the mechanical parking facility 1. That is, the mobile device 5 is used only for taking pictures inside the boarding / alighting section 10, and the user performs the closing operation of the door 13 on the operation control panel 17 installed near the entrance / exit 12 of the boarding / alighting section 10. Specifically, for example, in the flowchart of FIG. 4, the mechanical parking facility 1 omits step S217 in which the determination result from the monitoring center 6 is transferred to the mobile device 5. Also, each step of steps S115 to S117 in the mobile device 5 is omitted. Also, instead of step S218 in which the mechanical parking facility 1 waits for reception of a door close signal from the mobile device 5, it is determined whether or not the closing operation of the door 13 has been performed on the operation control panel 17, and the mechanical parking facility 1 closes the door 13 when it is determined that the closing operation of the door 13 has been performed and that no one is present inside the boarding / alighting section 10 (step S219). Similar changes may also be made to the flowcharts of FIG.

[0140] In each of the configuration examples described above, the mobile device 5 may take moving images instead of still images.

[0141] (Fifth variant of mechanical parking system) FIG. 17 shows a modified example of the boarding / alighting section 10 of the mechanical parking facility 1. This mechanical parking system 100 is a system that does not include a portable device 5. Instead of the camera function of the portable device 5, a fixed camera 25 is installed in the boarding / alighting section 10. The fixed camera 25 is installed, for example, at each of the four corners of the boarding / alighting section 10, i.e., the front, rear, left and right. The fixed camera 25 is configured to capture an image of the center of the boarding / alighting section 10 from each of the four corners.

[0142] FIG. 18 illustrates an example of a flow of entry control of the mechanical parking system 100 that does not include the portable device 5. Steps S291 to S293 in FIG. 18 are the same as steps S211 to S213 in the flow in FIG. 4. When the empty pallet 16 arrives at the boarding / disembarking section 10, the user enters the vehicle V to be entered into the boarding / disembarking section 10 and places it on the pallet 16. The user gets off the vehicle V and exits through the entrance / exit 12. When the entrance / exit sensor 22 detects the user's exit, the fixed camera 25 takes an image of the inside of the boarding / disembarking section 10 (step S294). The fixed camera 25 may take an image of the inside of the boarding / disembarking section 10 when the user operates the driving operation panel 17 as a trigger, or may take an image continuously from the time of the door opening (step S293) or the vehicle entering the parking facility. The mechanical parking facility 1 transmits the captured image to the monitoring center 6 through the wide area communication unit 35.

[0143] Steps S391 to S394 of the monitoring center 6 are the same as steps S311 to S314 in FIG. 4. The transmission of the determination result (step S393) may wait until the determination result indicates that the vehicle is unattended. If the determination result from the monitoring center 6 indicates that the vehicle is unattended, the mechanical parking facility 1 displays this on the operation panel 17 and waits for the user to perform a closing operation on the operation panel 17 (step S297). If the user performs a closing operation of the door 13, the mechanical parking facility 1 closes the door 13. If the determination result from the monitoring center 6 indicates that the vehicle is unattended, the mechanical parking facility 1 notifies the user of this through the operation panel 17 and prompts the user to check inside the boarding and disembarking area 10. At this time, an image determined to be unattended may be displayed on the operation panel, or the part of the image determined to be unattended may be highlighted. The fixed camera 25 photographs the inside of the boarding and disembarking section 10 again, and the determination section 62 of the monitoring center 6 performs a new determination of whether or not there is anyone in the boarding and disembarking section 10 based on the new image.

[0144] FIG. 19 illustrates an example of a flow of exit control of the mechanical parking system 100 that does not include the portable device 5. Steps S2101 to S2103 in FIG. 19 are the same as steps S221 to S223 in FIG. 5. When the pallet 16 carrying the vehicle V to be removed arrives at the loading / unloading section 10, the user causes the vehicle V to exit the loading / unloading section 10. When the entrance / exit sensor 22 detects the exit of the vehicle V, the fixed camera 25 takes an image of the inside of the loading / unloading section 10 (step S2104). The fixed camera 25 may take an image of the inside of the loading / unloading section 10 when the user gets off the vehicle V and operates the driving operation panel 17. The mechanical parking facility 1 transmits the captured image to the monitoring center 6 via the wide area communication unit 35.

[0145] Steps S3101 to S3104 of the monitoring center 6 are the same as steps S321 to S324 in Fig. 5. If the determination result from the monitoring center 6 is that there is no one present, the mechanical parking facility 1 displays that fact on the operation panel 17 and waits for the user to perform a closing operation on the operation panel 17 (step S2107). If the user performs a closing operation of the door 13, the mechanical parking facility 1 closes the door 13. If the determination result from the monitoring center 6 is not that there is no one present, the mechanical parking facility 1 notifies the user of that fact through the operation panel 17 and prompts the user to check inside the boarding and alighting area 10. The fixed camera 25 photographs the inside of the boarding and alighting area 10 again, and the determination unit 62 of the monitoring center 6 performs a new determination of whether there is no one present in the boarding and alighting area 10 based on the new image.

[0146] Although not shown in the drawings, in the mechanical parking system 100 according to Fig. 17 to Fig. 19, the mechanical parking facility 1 may include a determination unit. The mechanical parking system 100 that performs unmanned determination using AI can be composed of only the mechanical parking facility 1.

[0147] Furthermore, the fixed camera 25 may capture moving images instead of still images. [Explanation of symbols]

[0148] 1. Mechanical parking facilities 10. Boarding and alighting area 11 Identifiers 13 Door 17 Operation panel (operation section) 100 Mechanical Parking System 30 Storage and retrieval control device (control unit) 34 Near Field Wireless Communication Department 35 Wide Area Communications Department 5. Mobile devices 51 Wide Area Wireless Communication Division 54 Operation input section (operation section) 56 Near Field Wireless Communication Department 61 Wide Area Communications Department 62 Judgment section 6. Monitoring Center

Claims

1. a determination unit having an unmanned determination model for determining the presence or absence of a person in an image, the determination unit inputting an image taken inside a boarding / alighting section of a mechanical parking facility into the unmanned determination model and outputting a result of determining the presence or absence of a person in the boarding / alighting section; a control unit that closes a door provided at the boarding / alighting section when the determination unit outputs a determination result that the vehicle is unoccupied, The determination unit, when a predetermined application is operated, inputs an image taken by a portable device that takes an image of the inside of the boarding and alighting section using a camera function into the unmanned determination model, and outputs a result of determining whether or not a person is present in the boarding and alighting section. Mechanical parking system.

2. 2. The mechanical parking system according to claim 1, The determination unit inputs a plurality of images taken at different angles into the unmanned determination model. Mechanical parking system.

3. In the mechanical parking system according to claim 1 or 2, An identifier that can be identified by image recognition is attached to at least a floor or a wall in the boarding and disembarking area, The application specifies an image to be taken such that the identifier is included in the image; The determination unit determines whether a shooting angle of the image is appropriate based on an identifier included in the image. Mechanical parking system.

4. In the mechanical parking system according to any one of claims 1 to 3, A storage unit that stores images taken inside the boarding and disembarking area; A learning unit that causes the unmanned determination model to learn using the images stored in the storage unit. Mechanical parking system.

5. The Communications Department and A determination unit that outputs a determination result of whether or not the boarding / alighting section of the mechanical parking facility is unoccupied through the communication unit, The determination unit is A non-person detection model is provided to detect the presence or absence of a person in an image; By operating a predetermined application, an image taken by a mobile device that takes an image of the boarding and disembarking area using a camera function is acquired through the communication unit, The image is input to the unmanned determination model, and a result of determining whether or not a person is present in the boarding and alighting section is output. Monitoring center for mechanical parking facilities.

6. A program for an application to be installed on a portable device used in the mechanical parking system according to claim 1, Using the camera function of the mobile device, an image of the inside of the boarding and disembarking section of the mechanical parking facility is taken, a no-person determination model that determines whether or not a person is present in an image, and the captured image is input to the no-person determination model to output a result of determining whether or not a person is present in the boarding and alighting section; program.

Images