Automated valet parking management system and automated valet parking management method

The automatic valet parking management system addresses inefficiencies and safety issues by selecting parking spaces based on vehicle characteristics, ensuring effective monitoring and maximizing parking capacity.

JP2024168037APending Publication Date: 2024-12-05AMANO KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023084424
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing automatic valet parking systems do not effectively manage parking space efficiency and vehicle safety, particularly when guiding vehicles of varying sizes, leading to potential blind spots and increased complexity in monitoring and controlling multiple vehicles.

Method used

An automatic valet parking management system that selects final parking spaces based on vehicle characteristics, such as size and safety performance, to avoid blind spots and ensure effective monitoring using surveillance cameras, and includes an automatic valet control device to guide vehicles to these spaces.

Benefits of technology

The system enhances parking efficiency by minimizing blind spots, improving vehicle safety, and allowing for more vehicles to be parked without the need for extensive repositioning, thereby optimizing parking lot utilization and reducing operational complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168037000001_ABST
    Figure 2024168037000001_ABST
Patent Text Reader

Abstract

To park a large number of vehicles efficiently, and to guide and manage vehicles while monitoring a parking lot with surveillance cameras without any blind spots.SOLUTION: An automatic valet parking management system includes: a parking lot management device that selects a final parking space for an autonomous vehicle based on the characteristics of the autonomous vehicle, which is not a blind spot for a camera installed in a parking lot; and an automatic valet parking control system that outputs commands to the autonomous vehicle to park in the final parking space.SELECTED DRAWING: Figure 9
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a vehicle control device and system in a parking lot that supports an automated valet parking service. [Background technology]

[0002] Recently, a so-called automated valet parking service has been realized in which a vehicle is automatically parked in a parking space within a parking lot.

[0003] In a parking lot, if the size (area) of the parking space is fixed, parking a small to medium-sized self-driving vehicle, which does not require as much parking space as a large vehicle, reduces the efficiency of the parking space.

[0004] When guiding parking to a parking space without determining the size (free parking space), it is necessary to monitor the actual parking status using a surveillance camera or the like.

[0005] However, if a vehicle is guided to park without determining the size of the parking space, there may be cases where the vehicle is prevented from leaving due to safety devices or other factors surrounding parked vehicles.

[0006] In this case, in the worst case scenario, it may be necessary to shift the vehicles one after the other, but this would mean controlling a large number of vehicles in a short period of time, which could complicate authentication and control of autonomous driving. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP 2019-061418 A Summary of the Invention [Problem to be solved by the invention]

[0008] Patent Document 1 discloses a parking lot operation method and parking system for parking a vehicle with an automatic driving function. Specifically, various processes related to the entry and exit of a vehicle with an automatic driving function and an automatic parking mode are automatically executed.

[0009] However, the parking lot management device in Patent Document 1 does not include any mention of monitoring vehicles using surveillance cameras or understanding the performance of safety devices, etc., and it cannot be said that the device is operated with consideration for the safety of vehicles entering and leaving the parking lot, or the efficiency of parking space.

[0010] In view of the above circumstances, it is desirable to park a large number of vehicles efficiently and to guide and manage the vehicles while monitoring the parking lot with surveillance cameras to eliminate blind spots. [Means for solving the problem]

[0011] An automated valet parking management system according to one embodiment of the present invention comprises: A parking lot management device that selects a final parking space for the autonomous vehicle based on the characteristics of the autonomous vehicle, the final parking space being free of a blind spot of a camera installed in the parking lot; An automatic valet control device that outputs a command to the automatic driving vehicle to park in the final parking space; Equipped with:

[0012] This will improve safety regarding vehicle guidance and make it easier to monitor vehicles during guidance using on-site cameras, contributing to proper guidance and parking.

[0013] The characteristics of the autonomous vehicle include a size; The parking lot management device may select the final parking space based on the size of the autonomous vehicle, such that a larger autonomous vehicle is spaced a greater distance from the camera.

[0014] This will improve safety in guiding vehicles, and when there are a lot of parked vehicles in a parking lot, it will make it easier to monitor vehicles using on-site cameras by parking them so that they are not in blind spots, which will contribute to more appropriate guiding and parking.

[0015] The parking lot management device may select the final parking space that minimizes the vehicle-to-vehicle distance in the vehicle width direction from the already parked vehicle based on the characteristics of the already parked vehicle parked in the parking lot and the characteristics of the automatically driven vehicle.

[0016] This makes it possible to park as many vehicles as possible in a parking lot (free space) that is not divided by parking space (by vehicle compartment), which contributes to improving the parking lot's profits. Also, when the parking lot management device selects a parking space for a vehicle, if there is a vehicle already parked next to the parking space, it selects the parking space after taking into account the performance of the vehicle's safety performance judgment function, which contributes to appropriately guiding and managing the vehicle.

[0017] The parking lot management device may select the final parking space based on characteristics of the already parked vehicle and characteristics of the autonomous vehicle, such that the autonomous vehicle does not place the already parked vehicle in the blind spot of the camera, and such that the already parked vehicle does not place the autonomous vehicle in the blind spot of the camera.

[0018] This allows the parking position of the vehicle being guided in to be shifted forward, etc., so that it can be parked in the parking space (if the on-site cameras cannot monitor a relatively small vehicle due to the shadow of a relatively large vehicle, the relatively small vehicle will be parked slightly forward), which allows continuous monitoring by the on-site cameras and contributes to the safe management of vehicles.

[0019] The parking lot management device may select the final parking space based on characteristics of the autonomously driven vehicle stored for each autonomously driven vehicle in a vehicle DB.

[0020] As a result, the parking lot management device contributes to appropriately guiding and parking vehicles through its vehicle safety performance judgment function.

[0021] The parking lot management device includes: If the characteristics of the autonomous vehicle are not stored in the vehicle DB, a plan for an autonomous driving test operation is created; The automated valet control device outputs a command to the automated vehicle to perform an automated driving test operation in the parking lot based on the plan; Characteristics of the autonomous vehicle may be obtained based on the autonomous driving test operation.

[0022] As a result, the parking lot management device contributes to appropriately guiding and parking vehicles through its vehicle safety performance judgment function.

[0023] The parking lot management device may create a plan to execute the autonomous driving test operation at multiple locations within the parking lot.

[0024] As a result, the parking lot management device contributes to appropriately guiding and parking vehicles through its vehicle safety performance judgment function.

[0025] The characteristics of the autonomous vehicle may include at least one of a minimum turning radius, the presence or absence of a corner sensor, and a minimum distance from an obstacle at which the vehicle automatically stops when the obstacle is detected.

[0026] This allows the parking lot management device to select a parking space by taking into consideration not only the safety performance judgment function of the vehicle to be guided, but also the safety performance judgment function of the already parked vehicle A.

[0027] The parking lot has parking spaces for parking a plurality of vehicles in a row, The parking space has a dividing line extending in the vehicle width direction that divides the parking space from the road, and the parking positions of multiple vehicles parked side by side are not divided, The parking lot management device may select the final parking space so that the front end of the autonomous vehicle is positioned relative to the demarcation line.

[0028] This allows the parking lot management device to select a parking space that minimizes the distance between already parked vehicles in the vehicle width direction in order to park as many vehicles as possible, thereby parking vehicles closely spaced.

[0029] The parking lot management device may adjust the parking position of the autonomous vehicle so that a front end of the autonomous vehicle and a front end of an adjacent parked vehicle are aligned with respect to the demarcation line.

[0030] This makes it easier to monitor the vehicle from cameras inside the venue, since the front end of the vehicle, which is particularly low in height, is not set back relatively.

[0031] The parking lot management device may adjust the parking position of the autonomous vehicle so that either the front end of the autonomous vehicle or the front end of the other vehicle is spaced forward or backward from the dividing line, in order to avoid one of the autonomous vehicle and an adjacent parked vehicle becoming a blind spot of the camera.

[0032] This means that even if adjacent vehicles are different sizes, the larger vehicle can avoid obscuring the smaller one, allowing both vehicles to be continuously monitored by the on-site cameras.

[0033] The characteristics of the autonomous vehicle include a vehicle color; The parking lot management device may select a space next to an already parked vehicle having a different color from the color of the autonomously driven vehicle as the final parking space.

[0034] If adjacent vehicles are the same color or a similar color, the on-site camera may have difficulty identifying them as two independent vehicles, and may mistakenly recognize the two vehicles as connected as one unit and as a space rather than a vehicle, resulting in the vehicle not being able to be monitored while parked. For this reason, the parking lot management device can prevent such misrecognition by selecting the space next to an already parked vehicle of a different color from the vehicle's color as the final parking space.

[0035] A method for managing an automated valet parking lot according to one embodiment of the present invention includes the steps of: Based on the characteristics of the autonomous vehicle, a final parking space is selected for the autonomous vehicle that is not in the blind spot of the camera installed in the parking lot, A command is output to the autonomous vehicle to park in the final parking space. Effect of the Invention

[0036] According to the present invention, a large number of vehicles can be parked efficiently, and the vehicles can be guided and managed while monitoring the parking lot with a surveillance camera without any blind spots.

[0037] Note that the effects described herein are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief description of the drawings]

[0038] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an automatic valet parking management system according to an embodiment of the present invention; [Diagram 2] 1 shows an example of a vehicle DB. [Diagram 3] FIG. 1 is a schematic diagram showing an example of the configuration of a parking lot that supports an automatic valet parking service. [Figure 4] 3A and 3B show schematic diagrams of measurement of a vehicle planar shape using a vehicle planar shape measurement camera. [Diagram 5] FIG. 1 is a schematic diagram showing a configuration example of a vehicle having an automatic driving function. [Figure 6] 2 is a block diagram showing an outline of the functions of the parking lot management device. [Figure 7] 1 is a basic operation flow of an automatic valet parking operation. [Figure 8] 4 is an operational flow of a vehicle information collection process. [Figure 9] 3A and 3B illustrate a process for recognizing a vehicle planar shape. [Figure 10] 13 is an operational flow of vehicle guidance processing and collection processing of safety performance judgment functions. [Figure 11] Schematic diagram of autonomous driving test operation. [Figure 12] Schematic diagram of autonomous driving test operation. [Figure 13] 13 is an operational flow of a process for selecting a final parking space. [Figure 14] 13 is an operational flow of an empty parking space search process. [Figure 15] 1 shows an example of a vehicle's parking position relative to the lane markings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0040] 1. Configuration of the automated valet parking management system

[0041] FIG. 1 is a schematic diagram showing an example of the configuration of an automated valet parking management system according to one embodiment of the present invention.

[0042] The automated valet parking management system 500 is capable of performing various processes related to the parking lot 11, such as managing reservations requested by users of the parking lot 11, monitoring parking conditions, and calculating various fees related to the use of the parking lot.

[0043] The automated valet parking lot management system 500 includes a parking lot server 7, a parking lot management device 5, an automated valet control device 37, a payment server device (not shown) owned by a payment institution 9, and an ETC management server device (not shown) owned by an ETC (Electronic Toll Collection System) management institution 10. These terminals and devices are connected to each other so as to be able to communicate with each other via a network 1. The network 1 is constructed, for example, by the Internet or a wide area communication network. Alternatively, any wide area network (WAN) or local area network (LAN) may be used, and the protocol for constructing the network 1 is not limited.

[0044] The parking lot management device 5 and the automatic valet control device 37 are installed in the parking lot 11. As will be described later, in this embodiment, the parking lot management device 5 and the automatic valet control device 37 are used as the core components to construct an automatic valet parking lot management system 500 according to the present invention. The parking lot management device 5 is capable of comprehensively controlling the operation of each device installed in the parking lot 11. In addition, the parking lot management device 5 is capable of aggregating various information from each device installed in the parking lot 11 and transmitting it to the parking lot server 7, the automatic valet control device 37, etc. The parking lot management device 5 is capable of receiving various information from the parking lot server 7, etc. and executing various operations.

[0045] The parking lot management device 5 has hardware necessary for configuring a computer, such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and a HDD (Hard Disk Drive). The parking lot management device 5 also has a communication unit for communicating with other devices via the network 1. As the communication unit, for example, a wireless LAN module such as WiFi (registered trademark) or a communication device such as a modem or a router is used. As the parking lot management device 5, for example, any computer such as a PC (Personal Computer) is used.

[0046] The parking lot management device 5 may be capable of communicating with an external device that manages a database as big data. The big data may be, for example, big data of a city-state, an experimental municipality, or a community in which a large amount of vehicle data is stored. The parking lot management device 5 may be capable of communicating with an external device that is accessible by users, manufacturers, etc.

[0047] 1, a gate device 28 (an entrance gate device 28a and an exit gate device 28b) is installed in a parking lot 11. The gate device 28 can regulate the entry / exit of vehicles. In addition, the entire parking lot 11 is monitored by a monitoring system 24. The present invention can also be applied to so-called gateless parking lots where no gate device is installed.

[0048] The user terminal device 6 is a terminal used by a user who uses the parking lot 11. As the user terminal device 6, any computer such as a mobile terminal such as a smartphone, a tablet terminal, or various PDAs (Personal Digital Assistants), or a notebook PC (Personal Computer), may be used.

[0049] The parking lot server 7 is capable of providing the automatic valet parking service according to this embodiment as a Web service. In this embodiment, the parking lot server 7 is configured by a plurality of server devices (not shown) and a database (DB).

[0050] Each server device of the parking lot server 7 has hardware necessary for configuring a computer, such as a CPU, ROM, RAM, and HDD. Each server device also has a communication unit for communicating with other devices via the network 1. As the communication unit, for example, a wireless LAN module such as WiFi, or a communication device such as a modem or a router is used. As the server device, for example, any computer such as a PC is used.

[0051] The DB of the parking lot server 7 functions as a storage unit and stores various information related to the automatic valet parking service. For example, various DBs may be constructed in the DB of the parking lot server 7, such as a vehicle DB 101 (FIG. 2), a reservation information DB, a vehicle presence DB, a parking lot DB, an affiliated store DB, a discount DB, a departure information DB, an owner information DB, various history DBs, a management information DB, and a test result DB (described later). The various DBs are comprehensively managed by a DB server in the parking lot server 7, and, for example, the membership registration and withdrawal of users who use the automatic valet parking service, the registration, modification, and deletion of reservation information accepted from each user, the registration and storage of owner information of the parking lot 11, the recording and storage of operation income and expenditure information, etc. are executed.

[0052] FIG. 2 shows an example of the vehicle DB.

[0053] The vehicle DB 101 stores the membership number, membership type, vehicle information, vehicle color, safety performance judgment function, tire condition, charging status, email address, etc. in association with each vehicle ID (number, WCN, etc.) of a vehicle using the parking lot 11. The vehicle information includes the vehicle number and model, and allows detailed specifications of the vehicle to be known.

[0054] The safety performance judgment function includes the minimum turning radius, the presence or absence of a corner sensor, and the minimum distance from an obstacle for automatic stopping when an obstacle is detected. The tire condition is judged based on images taken by the on-site camera 32, and indicates, for example, the presence or absence of bending.

[0055] The parking lot server 7 provides the automatic valet parking service according to this embodiment using, for example, a WWW (World Wide Web) system. For example, the Web server creates various Web pages consisting of HTML documents. Hyperlinks to other Web pages and link information (for example, executable file names, URLs, etc.) for executing various processes are embedded in the Web pages. In addition, various processes in response to various requests are executed by the Web / API server in the parking lot server 7. For example, the Web / API server collects and outputs information on whether parking spaces are full or empty in the parking lot 11. The web pages generated within the parking lot server 7 are displayed on the screen by the web browser provided in each device shown in Fig. 1. For example, a user using the parking lot 11 can view various web pages and use various web applications by operating the user terminal device 6.

[0056] The settlement institution 9 is, for example, a bank or a credit company, and executes payment (settlement) of the parking fee by bank transfer, credit card payment (including transportation card payment and two-dimensional code payment), etc. The parking lot server 7 issues instructions to settle the parking fee to the settlement server device of the settlement institution 9, and executes inquiries about settlement information such as whether the settlement has been completed or not.

[0057] The ETC management institution 10 is an institution that realizes the ETC system, and manages information on users who use the ETC system, ETC card information, payment information, vehicle information, etc. For example, an ETC card is inserted into an ETC on-board unit installed in a vehicle. This allows the use of parking lots 11 that are ETC-compatible (specifically ETC 2.0-compatible) and have ETC antennas installed, by paying with ETC.

[0058] There are multiple vehicle manufacturers 12, and they provide software update information for functions related to autonomous driving in their respective genuine vehicles, parts, etc. Third parties that provide control programs for non-genuine parts and units are also included in the category of vehicle manufacturers 12.

[0059] 2.Automated Valet Parking System

[0060] The present invention is applicable to parking lots 11 that provide an automatic valet parking service. The automatic valet parking system is a system that can perform automatic valet driving (automatic valet parking, i.e. automatic valet driving into the parking lot and automatic valet driving out of the parking lot) by vehicles with an automatic driving function (autonomous driving function). A parking lot 11 in which an automatic valet parking system is built can also be said to be a parking lot 11 compatible with the automatic valet parking service.

[0061] For example, a user operates the user terminal device 6 to access an application that provides the automatic valet parking service. Then, the user can enter necessary information and register as a member, thereby becoming able to use the automatic valet parking service. In this embodiment, an automatic valet parking system is constructed as a system included in the automatic valet parking management system 500 shown in Fig. 1. That is, an automatic valet parking service is provided as a service included in the parking management service provided by the parking server 7. Various DBs related to the automatic valet parking system are constructed in the DB of the parking server 7. Without being limited thereto, an automated valet parking system may be constructed as a system separate from the automated valet parking management system 500. For example, an automated valet parking system may be constructed by a separate management device or the like not shown in Fig. 1, and a contract or the like may be made separately with the parking lot 11. There are no other limitations on the configuration or method for constructing the automatic valet parking system.

[0062] For example, a user operates the user terminal device 6 to make a reservation for automatic valet parking. Then, at the reserved time, the user manually drives a vehicle with an automatic driving function (in manual driving mode) and enters the parking lot 11. Of course, automatic driving is also acceptable. A user parks a vehicle in a parking space that supports the automatic valet parking service (hereinafter referred to as an automatic valet boarding and disembarking space) that is provided at a predetermined position within parking lot 11. Then, after getting out of the vehicle, the user issues an instruction to execute automatic valet parking. The instruction to execute automatic valet parking is issued, for example, via user terminal device 6. Alternatively, a dedicated terminal (prepayment machine 22, kiosk terminal, etc.) set up within parking lot 11 may be operated. In response to the instruction, the vehicle moves to a designated parking space in the parking lot 11 by unmanned automatic driving and parks the vehicle (automatic valet entry driving). It is also possible to enter the parking lot 11 at any time without making a reservation and perform automatic valet parking. When the user returns to the parking lot, an instruction is input to move the vehicle with an automatic driving function to the automatic valet boarding / disembarking space in the parking lot after a certain number of minutes. In response to the instruction, the vehicle moves from the parking space to the automatic valet boarding / disembarking space by unmanned automatic driving and parks the vehicle (automatic valet exit operation). Hereinafter, this embodiment will be described by taking as an example a parking lot 11 that supports an automatic valet parking service.

[0063] 3. Parking lot configuration example

[0064] FIG. 3 is a schematic diagram showing an example of the configuration of a parking lot 11 that supports an automatic valet parking service.

[0065] The parking lot 11 has an entrance 15, an exit 16, an internal walkway 17, multiple parking areas 18, an automatic valet boarding and disembarking space 19 (boarding area), stairs 20, an elevator 21 (elevator hall), a pre-payment machine 22, and an information device (not shown).

[0066] An entrance lane is configured from the entrance 15 toward the inside of the parking lot 11. In the entrance lane 27, an entrance gate device 28a, an entrance camera 29a, and a vehicle planar shape measuring camera 33 are provided. The entrance gate device 28a appropriately regulates the entry of the autonomous vehicle 3 into the parking lot 11 from the entrance lane 27. The entrance camera 29a is capable of capturing an image of the vehicle 3 that has entered the entrance lane 27, and detects the entry of the autonomous vehicle 3 into the entrance lane 27. The entry of the autonomous vehicle 3 into the entrance lane 27 may be detected based on a signal output from an entrance loop coil (not shown) provided in the entrance lane 27.

[0067] Figure 4 shows a schematic diagram of the measurement of the vehicle planar shape using a vehicle planar shape measurement camera. (A) is a plan view, and (B) is a view seen from an arrow.

[0068] The vehicle planar shape measuring camera 33 photographs the planar shape when the autonomously driven vehicle 3 enters. The vehicle planar shape measuring camera 33 may be a surveillance camera installed on the ceiling near the gate of the entrance 15. Alternatively, the vehicle planar shape measuring camera 33 may be a scanning device capable of scanning the autonomously driven vehicle 3. The specific configuration of each device is not limited, and any configuration may be adopted.

[0069] An exit lane 29 is configured from inside the parking lot 11 toward the exit gate 16. An exit gate device 28b and an exit camera 29b are provided in the exit lane 29. The exit gate device 28b appropriately regulates the exit of the vehicle 3 from the exit lane 29 to the outside of the parking lot 11. The exit camera 29b can capture an image of the autonomous vehicle 3 that has entered the exit lane 29, and detects the entry of the autonomous vehicle 3 into the exit lane 29. The entry of the autonomous vehicle 3 into the exit lane 29 may be detected based on a signal output from an exit loop coil (not shown) provided in the exit lane 29. The specific configuration of each device is not limited, and any configuration may be adopted.

[0070] Although not shown in Fig. 3, an entrance ETC antenna 30a and an exit ETC antenna 30b (Fig. 1) for detecting autonomous vehicles 3 equipped with ETC on-board units are installed in the entrance lane 27 and the exit lane 29, respectively. The entrance ETC antenna 30a and the exit ETC antenna 30b are connected to the roadside unit 34 (Fig. 1).

[0071] The on-site passage 17 is a passage through which the autonomous vehicle 3 that has entered the parking lot 11 travels. In FIG. 3, the autonomous vehicle 3 is illustrated by a substantially double rectangular shape. As shown in Fig. 3, signs (arrows, etc.) that specify the driving direction of autonomous vehicles 3 may be provided for interior passage 17. In Fig. 3, vehicles travel one way, counterclockwise, on interior passage 17, but vehicles may travel two ways on the left side. In addition, passages for pedestrians and the like may be specified.

[0072] A plurality of parking areas 18 are provided in the parking lot 11. In the example shown in Fig. 3, a plurality of parking areas 18 having space numbers A, B, C, D, E, F, and G are arranged. The parking area 18 is a space in which multiple autonomous vehicles 3 performing autonomous valet parking can be parked side-by-side. The parking space has a dividing line 18a extending in the vehicle width direction, dividing the parking area 18 from the roadway 36, which is the on-site passage 17. On the other hand, the parking area 18 is a free space, and the parking positions of multiple autonomous vehicles 3 parked side-by-side are not divided.

[0073] The automatic valet boarding and disembarking space 19 is a parking space compatible with the automatic valet parking service. In other words, the automatic valet boarding and disembarking space 19 is a space where the driver and passengers can get in and out of the automatically driven vehicle 3 that executes the automatic valet parking service. In the example shown in FIG. 3, four automated valet boarding and disembarking spaces 19 with space numbers V1 to V4 are provided near entrance 15 and exit 16. For example, a user who uses the automated valet parking service enters parking lot 11 from entrance 15, turns right, and parks automated vehicle 3 in automated valet boarding and disembarking space 19. The user then gets off automated vehicle 3 at automated valet boarding and disembarking space 19 and issues an instruction to perform automated valet parking. In response to this instruction, automated vehicle 3 performs a test drive in test passage 35. Then, automated vehicle 3 moves from automated valet boarding and disembarking space 19 to one of the parking areas 18 based on the results of the test drive. When a user of the automated valet parking service returns to parking lot 11, automated vehicle 3 moves from parking area 18 to automated valet boarding and disembarking space 19 at that time. The user gets into automated vehicle 3 and manually drives it to exit from exit gate 16.

[0074] Autonomous driving test sensors 38, 38 are installed in the test passage 35. The autonomous driving test sensors 38, 38 are capable of detecting the distance (distance from the autonomous driving test sensors 38, 38) and orientation (direction) of the autonomous driving vehicle 3 participating in the test. The autonomous driving test sensors 38, 38 are, for example, LiDER (Light Detection And Ranging), and are capable of 360-degree scanning the autonomous driving vehicle 3 participating in the test. The autonomous driving test sensors 38, 38 may alternatively be ultrasonic sensors, infrared sensors, imaging sensors, etc.

[0075] The pre-payment machine 22 is a device that enables a user of the parking lot 11 to perform pre-payment before causing the autonomous vehicle 3 to exit the parking lot 11. For example, a device having a touch panel or the like is installed as the pre-payment machine 22. The guidance device (not shown) is a device for providing various information related to the parking lot 11 and the automated valet parking management system 500 (including the automated valet parking system). For example, a device having a display device or the like and capable of displaying guidance information is used as the guidance device.

[0076] As a system for monitoring a parking lot and supporting the automated valet service, the following devices are installed in the parking lot, as shown in Figure 3.

[0077] The on-site camera 32 (white circle in the figure), which mainly photographs the on-site passage 17, the entrance camera 29a, the exit camera 29b, and the vehicle planar shape measuring camera 33 each function as a plurality of surveillance cameras (hereinafter, these are also collectively referred to as cameras, unless otherwise described individually) in the automated valet parking management system 500. As the various cameras described above in this disclosure, for example, a monocular digital camera equipped with an image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor is used. Alternatively, an infrared camera or the like may be used.

[0078] The automated valet parking management system 500 is capable of outputting monitoring information as a result of monitoring the parking lot 11. In this embodiment, images captured by various cameras and sounds captured by various microphones are output as the monitoring information. In this disclosure, images include both still images and moving images (video). The in-park cameras 32 are positioned so as to cover as much of the entire parking lot 11 as possible. In other words, multiple in-park cameras 32 are appropriately positioned so as to eliminate blind spots as much as possible.

[0079] 4.Automated Valet Parking Control System

[0080] An example of the configuration of an automated valet parking management system 500 will be described with reference to FIG. The automated valet parking management system 500 is a system constructed for the parking lot 11. The automated valet parking lot management system 500 illustrated in Figure 1 includes a parking lot management device 5, a pre-payment machine 22, an automated valet control device 37, an entrance gate device 28a, an exit gate device 28b, a roadside device 34, an entrance ETC antenna 30a, an exit ETC antenna 30b, an entrance camera 29a, an exit camera 29b, an in-park camera 32, and a vehicle planar shape measurement camera 33. 1 are communicably connected to each other, for example, via an on-site LAN (not shown) installed within the premises of the parking lot 11. Alternatively, any other communication technology via wired / wireless may be used.

[0081] The automatic valet control device 37 is a device for constructing the automatic valet parking system 500. In this embodiment, the automatic valet control device 37 cooperates with the parking lot server 7 and the parking lot management device 5 to manage the automatic valet driving and test driving by the automatically driven vehicle 3. For example, the automatic valet control device 37 controls the automatic driving operation of the automatic driving vehicle 3. For example, automatic driving from the automatic valet boarding / alighting space 19 to the specified parking area 18 is instructed. Alternatively, automatic driving from the specified parking area 18 to the automatic valet boarding / alighting space 19 is instructed. Also, automatic driving from the automatic valet boarding / alighting space 19 to the test passage 35, a test run in the test passage 35, and automatic driving from the test passage 35 to the specified parking area 18 are instructed. In addition, various other processes are performed, such as reservation management for automated valet parking. The automatic valet control device 37 has hardware necessary for configuring a computer, such as a CPU, ROM, RAM, HDD, etc. The automatic valet control device 37 also has a communication unit for communicating with other devices via the network 1. As the communication unit, for example, a wireless LAN module such as WiFi, or a communication device such as a modem or a router is used. As the automatic valet control device 37, any computer such as a PC can be used.

[0082] The DB of the parking lot management device 5 stores various data related to the parking lot 11, and any DB such as a vehicle presence DB and a history DB is constructed. Of course, data stored in the DB of the parking lot server 7 may be shared. Moreover, various information related to the automatic valet parking is stored in the DB of the parking lot management device 5. The above-mentioned vehicle information and the like may be stored in the DB of the parking lot server 7 instead of the DB of the parking lot management device 5.

[0083] 5. Self-driving vehicles

[0084] FIG. 5 is a schematic diagram showing a configuration example of a vehicle having an automatic driving function. The autonomously driving vehicle 3 has a communication unit 41, on-board cameras 42, an image processing device 43, an ETC antenna 44, an ETC on-board unit 45, a control unit 46, in-vehicle and out-of-vehicle sensors 59, a car navigation device 60, and a GPS receiver / beacon receiver 61. The communication unit 41 is a device for communicating with other devices. In this embodiment, various information including instructions from the automatic valet control device 37 is acquired via the communication unit 41. For example, a communication device such as a dedicated short range communication (DSRC) device is used as the communication unit 41. Any other communication device that complies with the current connected car standards may be used.

[0085] The on-board cameras 42 are capable of capturing images of the surroundings of the autonomously driven vehicle 3 and passengers inside the autonomously driven vehicle 3. The on-board cameras 42 may include a camera of a drive recorder. Digital cameras such as CCD cameras are used as the in-vehicle cameras 42. Alternatively, distance measuring devices such as a ToF (Time of Flight) camera or a stereo camera may be used. Infrared cameras and the like may also be used. The image processing device 43 recognizes the situation around the autonomously driven vehicle 3 based on the images captured by the on-board cameras 42. The algorithm for situation recognition is not limited. The ETC antenna 44 and the ETC vehicle unit 45 enable use of the parking lot 11 by ETC payment.

[0086] The control unit 46 has hardware necessary for configuring a computer, such as a CPU, a ROM, a RAM, a HDD, etc. In the example shown in Fig. 5, the control unit 46 realizes a driving route generation unit 47, a driving control unit 48, a vehicle / person recognition unit 57, an electrical control unit 58, and an update management unit 62 as software blocks. The driving route generation unit 47 determines a driving route for automatic driving based on instructions from the automatic valet control device 37, the recognition results by the image processing device 43, map information of the parking lot 11, and the like. The driving control unit 48 appropriately controls a drive system (not shown) and the like equipped in the autonomous driving vehicle 3 in order to realize autonomous driving along the determined driving route. 5, for example, a driving control unit 48 outputs control signals to an engine / motor control device 49, a brake control device 50, a headlight control device 51, a hazard lamp (blinker) control device 52, a horn control device 53, etc. This allows automatic driving along a driving route, crisis avoidance maneuvers, etc. to be realized. In addition, well-known technologies for achieving autonomous driving may be used as appropriate.

[0087] As described below, this automated valet parking lot management system 500 is configured to be able to monitor the driving position and parking position of each vehicle by identifying, capturing, and tracking each vehicle passing through the parking lot 11.

[0088] The vehicle / person recognition unit 57 recognizes the faces of occupants and pedestrians, etc. from images of occupants inside and outside the autonomously driven vehicle 3 captured by the onboard cameras 42, and also recognizes parked and moving vehicles around the autonomously driven vehicle 3.

[0089] The electrical control unit 58 outputs control signals to the door lock control device 54 , the window operation control device 55 , and the air conditioning control device 56 .

[0090] 6. Overview of Parking Lot Management Device Functions

[0091] FIG. 6 is a block diagram showing an outline of the functions of the parking lot management device.

[0092] The parking lot management device 5 has a parking space management function 77, a parking lot control function 78, a parking fee management function 79, a parking lot management device communication function 80, an automatic valet parking reception function 81, a vehicle information collection function 71, a safety performance judgment function 72, an available parking space selection function 73, a driving route setting function 74, a test setting function 75, a test recording function 76, and a test record output function 82. These blocks are configured by the CPU of the parking lot management device 5 executing a predetermined program and cooperating with the hardware resources within the device, thereby realizing the parking lot control method according to this embodiment. The method of installing the program in the parking lot management device 5 is not limited.

[0093] The parking lot control function 78 executes various processes related to the control of the parking lot 11. For example, it detects vehicles, controls gate equipment 28, controls each device included in monitoring system 24, controls prepayment machine 22, controls guidance equipment (not shown), confirms prepayment, communicates with other devices on network 1 shown in Fig. 1, writes and reads information to the parking lot DB, and performs various other processes related to the control of parking lot 11. Of these functions, automated valet control device 37 controls the operation of autonomously driven vehicle 3, but for simplicity, parking lot management device 5 and automated valet control device 37 are assumed to operate together.

[0094] 1 , the automated valet parking lot management system 500 according to the present invention may be realized by excluding the parking lot server 7. For example, the automated valet parking lot management system 500 according to the present invention may be realized by only the parking lot management device 5.

[0095] 7. Automatic valet parking operation

[0096] FIG. 7 shows the basic operation flow of automatic valet parking.

[0097] An autonomous vehicle 3 having an autonomous driving function enters a parking lot 11 by manual driving (step S101), and parks in an automatic valet boarding and disembarking space 19. When entering, the parking lot management device 5 collects information about the entering autonomous vehicle 3 from the recognition results of the entrance camera 29a, the entrance ETC antenna 30a, the inside camera 32, the vehicle planar shape measurement camera 33, etc. (step S102).

[0098] FIG. 8 is an operational flow of the vehicle information collection process.

[0099] For example, the parking lot management device 5 reads the vehicle ID (number, WCN, etc.) from data of the entrance camera 29a, the entrance ETC antenna 30a, and the inside camera 32 (step S201).

[0100] The parking lot management device 5 queries the vehicle DB 101 (FIG. 2) of the parking lot server 7 and searches for the vehicle ID of the corresponding autonomously driven vehicle 3 (step S202). If the corresponding vehicle ID is registered in the vehicle DB 101 (step S203, YES), the parking lot management device 5 reads the vehicle DB 101 and acquires information on the corresponding vehicle ID (membership number, membership type, vehicle body information, vehicle color, safety performance judgment function, tire status, charging status, email address, etc.) (step S204).

[0101] On the other hand, if the corresponding vehicle ID is not registered in the vehicle DB 101 (step S203, NO), the parking lot management device 5 acquires the vehicle type (light car, compact / normal car, etc.), shape (sedan, wagon, minivan, SUV, etc.), and vehicle color from the data of the entrance camera 29a, the entrance ETC antenna 30a, and the on-site camera 32. The parking lot management device 5 recognizes the planar shape of the autonomous vehicle 3 from the image data captured by the vehicle planar shape measurement camera 33 (step S205). The parking lot management device 5 needs to arrange the automatic parking position and shape on a planar map and determine whether there is enough space for the driving trajectory of the adjacent vehicle. For this reason, the planar shape of the autonomous vehicle 3 is photographed when entering the parking lot.

[0102] FIG. 9 illustrates a process for recognizing a vehicle planar shape.

[0103] As in the example (A), the parking lot management device 5 recognizes that the shape of the four corners R of the autonomous vehicle 3 is round, and measures the minimum turning radius (turning performance). As in the example (B), the parking lot management device 5 recognizes that a spare tire S is attached to the rear, and takes into account the minimum turning radius (turning performance) and the size of the required parking space. When a spare tire S is attached to the rear, the actual vehicle length of the autonomous vehicle 3 differs from the overall length of the vehicle body information. The vehicle height and the shape of the vehicle body may be measured by other sensors.

[0104] Furthermore, the parking lot management device 5 communicates with the autonomous vehicle 3 via wireless communication, and collects the minimum turning radius, the presence or absence of a corner sensor, the minimum distance from an obstacle for automatic stopping when an obstacle is detected, and the like (step S206). The parking lot management device 5 associates the collected information with the vehicle ID and stores it in the vehicle DB 101 (step S207). The information collected here, such as the minimum turning radius, the presence or absence of a corner sensor, and the minimum distance from an obstacle for automatic stopping when an obstacle is detected, is part of the safety performance judgment function information.

[0105] Regardless of whether the autonomously driven vehicle 3 has been registered in the vehicle DB 101 or not, the parking lot management device 5 determines the tire condition (such as the degree of tire deflection) from the data from the entrance camera 29a and the in-park camera 32. Furthermore, the parking lot management device 5 communicates with the autonomously driven vehicle 3 via wireless communication to collect the charging status. The parking lot management device 5 associates the collected information with the vehicle ID and stores it in the vehicle DB 101 (step S208).

[0106] Returning to FIG. 7, an instruction to perform automatic valet parking is given by a user who gets out of an autonomously driven vehicle 3 parked in an automatic valet boarding and disembarking space 19 in the parking lot 11. The instruction to perform automatic valet parking is given, for example, via a user terminal device 6 (such as a smartphone). Note that since the user terminal device 6 has been registered and paired with a vehicle ID, there is no need to specify a vehicle. Alternatively, a dedicated terminal or the like set up in the parking lot 11 may be operated. The parking lot management device 5 receives the instruction to perform automatic valet parking (step S103).

[0107] When the parking lot management device 5 receives a parking entry notification of an autonomous vehicle 3 specified by a user, the management device performs a process to change the driving mode of the specified autonomous vehicle 3 from manual driving mode to autonomous driving mode. The parking lot management device 5 selects a vacant parking space for the autonomous vehicle 3 that has switched to autonomous driving mode from the collected vehicle information, etc., and guides the autonomous vehicle 3 to the selected parking space. Before selecting a parking space, the parking lot management device 5 performs an autonomous driving test operation as necessary (step S104).

[0108] FIG. 10 shows an operational flow of the vehicle guidance process and the collection process of the safety performance judgment function.

[0109] The parking lot management device 5 acquires all the safety performance judgment function information of the autonomously driven vehicle 3 and determines whether it has been recorded in the vehicle DB 101 (step S301). If parking performance or safety performance judgment function information cannot be collected (step S206) or if it is a new autonomously driven vehicle 3 that has not been registered in the vehicle DB 101 (step S301, NO), the parking lot management device 5 collects the safety performance judgment function information by an autonomous driving test operation (step S302).

[0110] FIG. 11 shows a schematic diagram of the automatic driving test operation.

[0111] In the operation of collecting safety performance judgment function information, the parking lot management device 5 creates a plan for an autonomous driving test operation for the autonomous vehicle 3 that has entered the autonomous driving mode. The parking lot management device 5 causes the automated valet control device 37 to output a command to the autonomous vehicle 3 to execute the autonomous driving test operation in the parking lot 11 based on the plan (step S303). The autonomous driving test operation is, for example, an operation to measure the minimum radius and parking performance in the test passage 35.

[0112] FIG. 12 shows a schematic diagram of the automatic driving test operation.

[0113] The autonomous driving test operation may be carried out, for example, on a road 36 that guides the vehicle from the autonomous valet boarding and disembarking space 19 to the parking area 18, or in an empty parking area 18, or in a test passage 35, or in multiple locations.

[0114] As shown in operation 1, when autonomous vehicle 3 is guided from autonomous valet boarding / alighting space 19, as it travels along road 36 from the left side of autonomous valet boarding / alighting space 19 towards parking area 18, it is caused to pass with maximum left steering angle and the minimum turning radius is measured by autonomous driving test sensor 38a. Regarding the safety performance judgment function, a pole (in the illustrated example, autonomous driving test sensor 38a is attached to the pole) is installed on the left side halfway along road 36 towards parking area 18, and autonomous vehicle 3 is caused to travel as close as possible to the pole to measure the safety performance judgment function.

[0115] As shown in operation 2, when autonomous vehicle 3 is guided from autonomous valet boarding / disembarking space 19 toward parking area 18 on road 36 from the left side of autonomous valet boarding / disembarking space 19, as autonomous vehicle 3 turns right on road 36 and travels rightward, it passes with a maximum right-side steering angle and the minimum turning radius is measured by autonomous driving test sensor 38b. Regarding the safety performance judgment function, a pole (in the illustrated example, autonomous vehicle 3 is provided on the pole) is installed on the right side midway along road 36 toward parking area 18, and autonomous vehicle 3 is driven as close as possible to the pole to measure the safety performance judgment function.

[0116] When the parking lot management device 5 finishes the measurement and obtains the measurement results, it stores the measurement results in the vehicle DB 101 as safety performance judgment function information (step S304). The parking lot management device 5 may notify the user terminal device 6 of the test results by email or the like. Alternatively, the test results may be output to an external device to be accumulated in a database as big data. The big data may be, for example, big data of a city-state, an experimental municipality, or a community in which a large amount of vehicle data is stored. The parking lot management device 5 may output the test results to an external device that is accessible by users, manufacturers, etc.

[0117] Based on the characteristics of the autonomous vehicle 3 stored in the vehicle DB 101 for each autonomous vehicle 3 and the characteristics of another vehicle that is already parked (called an already parked vehicle), the parking lot management device 5 selects a final parking space for the autonomous vehicle 3 that is not in the blind spot of the in-parking camera 32 installed in the parking lot 11 (step S305). The "characteristics" of the autonomous vehicle 3 include, for example, the size, vehicle color, and minimum turning radius of the autonomous vehicle 3, the presence or absence of a corner sensor, and the minimum distance from an obstacle at which the autonomous vehicle 3 will automatically stop when the obstacle is detected. The size of the autonomous vehicle 3 refers to the vehicle width, vehicle length, vehicle height, and body shape, and is the size including a spare tire attached to the back, luggage placed on the top, etc.

[0118] FIG. 13 shows an operational flow of the final parking space selection process.

[0119] The parking lot management device 5 first selects a vacant parking space (one or more) (step S401).

[0120] FIG. 14 shows an operational flow of the vacant parking space search process.

[0121] In the operation flow of the vacant parking space search process, the parking lot management device 5 first searches for a vacant parking space where the vehicle 3 can be parked based on the size, and then determines the parking space based on the safety performance judgment function and planar shape of the autonomous vehicle 3. During this process, if multiple parking spaces are searched, the parking lot management device 5 narrows down the search and finally selects the optimal parking space for one vehicle. A "parking space" refers to a space (vehicle compartment) for one autonomous vehicle 3 within the parking area 18.

[0122] The parking lot management device 5 searches for a parking space that is suitable for the size of the autonomous vehicle 3 and is not in a blind spot from the on-site camera 32 (step S501). If there is a parking space that is suitable for the size of the autonomous vehicle 3 and is not in a blind spot from the on-site camera 32, the parking lot management device 5 narrows down the candidates for the parking space (step S502, YES). The parking lot management device 5 determines whether the autonomous vehicle 3 is a vehicle of a particularly large size (for example, a car body shape: one box or larger) that is greater than a predetermined size (step S503, YES). If the autonomous vehicle 3 is particularly large in size that is greater than a predetermined size (step S503, YES), the parking lot management device 5 searches for a parking space so that the distance between the large autonomous vehicle 3 and the on-site camera 32 is large (step S504). The parking lot management device 5 selects a parking space that is not in a blind spot (does not create a blind spot) by arranging a large vehicle farther from the on-site camera 32, assuming that multiple autonomous vehicles 3 of different sizes are arranged. Specifically, the parking lot management device 5 selects a parking space by relatively comparing the entered autonomous vehicles 3 from the back of the parking lot 11 as viewed from the in-park camera 32, in the order of large vehicle (minivan) > SUV > sedan > light vehicle. The parking lot management device 5 may select a parking space according to the size of the autonomous vehicles 3, such as selecting a space exclusively for small vehicles for small vehicles and a space exclusively for large vehicles for large vehicles. If there is a parking space that can fit a large-sized autonomous vehicle 3, the parking lot management device 5 narrows down the candidates for the parking space (step S505, YES).

[0123] The parking lot management device 5 judges whether the autonomous vehicle 3 can park in the candidate parking space based on the safety performance judgment function and the planar shape of the autonomous vehicle 3 (step S506). For example, the parking lot management device 5 calls vehicle information and the safety performance judgment function from the vehicle DB 101. If there is a discrepancy between the safety performance judgment function (safety device) of the autonomous vehicle 3 and the safety of the autonomous valet control device 37, the autonomous vehicle 3 cannot travel due to the safety performance judgment function of the autonomous vehicle 3. For this reason, the parking lot management device 5 measures the measurement range of the safety performance judgment function (safety device) of the autonomous vehicle 3. For example, it is assumed that the autonomous valet control device 37 guides the autonomous vehicle 3 with a tolerance of 10 cm for the safety performance judgment function at the time of reapproach (the limit of the distance between the obstacle and the autonomous vehicle 3 at which the autonomous vehicle 3 stops when the obstacle is detected). In this case, when the limit of the safety performance judgment function of the autonomous vehicle 3 is 20 cm, the autonomous vehicle 3 cannot travel according to the guidance of the autonomous valet control device 37. For this reason, the automatic valet control device 37 will guide the autonomous vehicle 3 within a tolerance of 20 cm, which is the limit of the safety performance judgment function of the autonomous vehicle 3.

[0124] When the parking lot management device 5 determines that the autonomous vehicle 3 can be parked in the candidate parking space (step S507, YES), it determines that parking space as the optimal parking space (one or more) (step S508). On the other hand, if there is no parking space that fits the size of the autonomous vehicle 3 and is not in a blind spot from the on-site camera 32 (step S502, NO), if there is no parking space that fits a large-sized autonomous vehicle 3 (step S505, NO), or if there is no parking space that fits the safety performance judgment function or planar shape of the autonomous vehicle 3 (step S507, NO), it determines that there is no parking space (step S509).

[0125] In Fig. 14, the process is to search for an empty parking space mainly based on the size and shape of the autonomous vehicle 3, extract multiple applicable empty parking space candidates, and narrow down the multiple candidates to the most suitable parking space (one or multiple) (step S508). In Fig. 13, the multiple candidates narrowed down in Fig. 14 are further narrowed down by a safety performance judgment function, etc., and finally, one final parking space 39 is selected.

[0126] Returning to Fig. 13, when there is a parking space (step S508) (step S402, YES), the parking lot management device 5 judges whether there is an already parked vehicle 3a next to the parking space (step S403). When there is an already parked vehicle next to the parking space (step S403, YES), the parking lot management device 5 compares the safety performance judgment function (the maximum distance between an obstacle and the automatically driven vehicle 3 at which the automatically driven vehicle 3 stops when the obstacle is detected) of the already parked vehicle 3a and the automatically driven vehicle 3 (step S404).

[0127] In order to park as many vehicles as possible, the parking lot management device 5 selects a parking space in which the inter-vehicle distance in the vehicle width direction between the already parked vehicle 3a is the smallest, and parks the vehicles closely together. However, for example, the tolerance of the safety performance judgment function of the already parked vehicle 3a parked next to the parking space is 20 cm, and the tolerance of the safety performance judgment function of the automatically driven vehicle 3 to be guided from now is 10 cm (step S405, NO). If the automatically driven vehicle 3 is guided to park in the parking space, the distance between the already parked vehicle A and the automatically driven vehicle 3 will be 10 cm at the minimum, and the already parked vehicle 3a will exceed the tolerance of 20 cm. Therefore, the already parked vehicle 3a cannot travel and will not be able to leave the parking space later. Therefore, the parking lot management device 5 selects a parking space taking into consideration not only the safety performance judgment function of the automatically driven vehicle 3 to be guided from now, but also the safety performance judgment function of the already parked vehicle 3a. In this case, another appropriate parking space for the automatically driven vehicle 3 is selected (return to step S401). Alternatively, the parking lot management device 5 may guide the autonomously driven vehicle 3 with a tolerance of 20 cm, the same as that of the already parked vehicle 3a.

[0128] On the other hand, if the allowable distance limit of the safety performance judgment function of the autonomous vehicle 3 to be guided is greater than or equal to the allowable distance limit of the safety performance judgment function of the already parked vehicle 3a (step S405, YES), there is no need to reselect a parking space for the autonomous vehicle 3.

[0129] The parking lot management device 5 determines whether or not both vehicles can be monitored during parking without the automatically-driven vehicle 3 to be guided being hidden (occluded) by the already-parked vehicle 3a, and conversely, without the automatically-driven vehicle 3 to be guided being hidden by the already-parked vehicle 3a (step S406). For example, the parking lot management device 5 makes the determination based on the sizes and colors of the automatically-driven vehicle 3 to be guided and the already-parked vehicle 3a. Specifically, the parking lot management device 5 determines whether or not a vehicle (relatively large) in front of the parking lot camera 32 completely hides a vehicle (relatively small) at the back (in other words, the vehicle at the back is in the blind spot of the parking lot camera 32). In addition, when an already-parked vehicle 3a of the same color as the automatically-driven vehicle 3 to be guided is parked next to the parking space, the parking lot management device 5 determines that both vehicles cannot be monitored during parking. If the adjacent vehicles are the same or similar in color, it is difficult for the on-site camera 32 to distinguish them as two independent vehicles, and the two vehicles are connected as one unit and may be mistakenly recognized as a space rather than a vehicle, resulting in the risk of not being able to monitor the autonomous vehicle 3 while it is parked. For this reason, it is preferable for the parking lot management device 5 to select the space next to the already parked vehicle 3a, which has a different color from the color of the autonomous vehicle 3, as the final parking space 39. In particular, when the parking area 18 is a free space and the parking positions of the multiple autonomous vehicles 3 parked side-by-side are not separated, there are no dividing lines between the adjacent vehicle compartments, so the multiple autonomous vehicles 3 themselves need to be distinguished by image recognition. For this reason, it is particularly effective when the parking area 18 is a free space that the adjacent vehicles do not have the same or similar colors.

[0130] When the parking lot management device 5 determines that all of the vehicles can be monitored while parked (step S407, YES), it selects this parking space as the final parking space 39 (step S409).

[0131] On the other hand, if the parking lot management device 5 determines that any of the vehicles cannot be monitored while parked (step S407, NO), it determines whether or not adjusting the parking position of the autonomous vehicle 3 that is about to park will enable monitoring of any of the vehicles while parked (step S408). For example, assume that a vehicle (relatively large) in front as viewed from the in-park camera 32 may completely hide a vehicle (relatively small) at the back. In this case, the parking lot management device 5 adjusts the parking position of the autonomous vehicle 3 with the front end based on the demarcation line 18a so that the front end of the small vehicle is further forward (closer to the demarcation line 18a) than the front end of the large vehicle.

[0132] FIG. 15 shows an example of a parking position of a vehicle based on the lane markings.

[0133] The parking lot management device 5 adjusts the parking position of the autonomous vehicle 3 so that the front end of the autonomous vehicle 3 is located relative to the demarcation line 18a. Specifically, the parking lot management device 5 adjusts the parking positions of the vehicles F1-F4 so that, in principle, the front ends of the vehicles F1-F4 and the front ends of the adjacent already parked vehicles F1-F4 are aligned with respect to the demarcation line 18a. This makes it easier to monitor the vehicles F1-F4 from the in-park camera 32, since the front ends of the vehicles, which are particularly low in height, are not relatively far back.

[0134] On the other hand, a case will be described in which a vehicle (relatively small) at the back side may be completely hidden by a vehicle (relatively large) at the front side as viewed from the in-park camera 32. In order to prevent the blind spot of the in-park camera 32 from being caused by either the self-driving vehicle 3 to be parked or the adjacent already-parked vehicle 3a, the parking lot management device 5 adjusts the parking position of the self-driving vehicle 3 so that either the front end of the one vehicle or the front end of the other vehicle is spaced forward or backward from the demarcation line 18a. For example, the parking position of the self-driving vehicle 3 to be parked is adjusted so that the front end of the other vehicle, which is relatively large, is spaced forward or backward from the demarcation line 18a compared to the front end of the one vehicle, which is relatively small. In the example of FIG. 15, in order to prevent the vehicle F5 (large) to be parked from hiding the adjacent already-parked vehicle F4 (small), the parking lot management device 5 adjusts the parking position of the vehicle F5 (large) to be parked so that the front end of the vehicle F5 (large) to be parked is spaced forward or backward from the demarcation line 18a compared to the front end of the already-parked vehicle F4 (small). This makes it possible to continuously monitor both vehicles F4, F5 with the on-site camera 32, even if the adjacent vehicles are different sizes, since the relatively large vehicle F5 is prevented from obscuring the relatively small vehicle F4. Depending on the available parking space, the front end of a relatively small vehicle may be adjusted to move away (protrude) forward from the demarcation line 18a.

[0135] In addition, when it is unavoidable for vehicles of the same or similar color to be placed next to each other, the parking lot management device 5 avoids vehicles with similar shapes as much as possible, or similarly adjusts the parking position (front end position based on the demarcation line 18a).

[0136] Returning to Fig. 13, if the parking lot management device 5 is unable to monitor any vehicle while parked even after adjusting the parking position (front / rear position) of the autonomously driven vehicle 3 that is about to park (step S408, NO), it selects another appropriate parking space for the autonomously driven vehicle 3 (return to step S401).

[0137] On the other hand, if the parking position (front and rear positions) of the autonomous vehicle 3 that is about to park can be adjusted so that both vehicles can be monitored while parked (step S408, YES), the parking lot management device 5 selects this parking space and a parking position based on the partition line 18a as the final parking space 39 (step S409). In this way, based on the characteristics of the already parked vehicle 3a and the characteristics of the autonomous vehicle 3 that will be guided, the parking lot management device selects a final parking space 39 such that the autonomous vehicle 3 that will be guided will not be in the blind spot of the on-site camera 32, and that the autonomous vehicle 3 that will be guided will not be in the blind spot of the on-site camera 32, due to the autonomous vehicle 3 that will be guided by the already parked vehicle 3a.

[0138] On the other hand, if there is no already parked vehicle 3a next to the parking space (step S403, NO), the parking lot management device 5 selects that parking space as the final parking space 39 (step S410) because the autonomously driven vehicle 3 to be guided will not be hidden therein.

[0139] Return to FIG. 10. When the parking lot management device 5 selects the final parking space 39 (steps S409 and S410) (step S305), it causes the automated valet control device 37 to output a command to park the automated vehicle 3 in the final parking space 39 (step S306). The automated valet control device 37 uses information from the on-board cameras 42 and the in-vehicle and out-of-vehicle sensors 59 of the automated vehicle 3 to determine the exact parking position. For example, the automated valet control device 37 measures the distance to the demarcation line 18a from images from the on-board cameras 42 on the left, right, front, and rear. If a previously parked vehicle 3a is already parked in front and becomes a blind spot (if a previously parked vehicle 3a is already parked between the on-site camera 32 and the parking space), the automated valet control device 37 adjusts the parking position of the automated vehicle 3 to be guided (for example, if the smallest vehicle is at the very back, move it slightly forward). This parking position adjustment may be performed by the parking lot management device 5 (step S408), the automatic valet control device 37, or both.

[0140] Thereafter, when the autonomous vehicle 3 that has been automatically valet-parked leaves the parking lot, the user uses the user terminal device 6 to notify the parking lot management device 5 to have the autonomous vehicle 3 leave (pick up) the autonomous vehicle 3 to the autonomous valet boarding and disembarking space 19. As with the entrance, the user terminal device 6 is registered and paired with the vehicle ID, so there is no need to specify a vehicle when leaving the parking lot. The parking lot management device 5 receives a departure notification from the user. The parking lot management device 5 guides the specified autonomous vehicle 3 to the autonomous valet boarding and disembarking space 19 in autonomous driving mode. When the autonomous vehicle 3 stops at the autonomous valet boarding and disembarking space 19, the parking lot management device 5 performs a process to change the driving mode of the autonomous vehicle 3 from autonomous driving mode to manual driving mode. The user starts boarding the autonomous vehicle 3 that has arrived at the autonomous valet boarding and disembarking space 19. When the boarding is completed, the user manually drives the autonomous vehicle 3 to leave the parking lot 11. Note that the departure may be in a temporary departure state. For example, the autonomous vehicle 3 that has been reserved for departure may be parked in a parallel parking position. In this case, it is useful and necessary to understand the safety performance in the forward and backward directions.

[0141] 8. Variations

[0142] The terminal used by the user to give instructions to execute automatic valet parking or to issue instructions to leave the parking lot may be a shared terminal (prepayment machine 22, kiosk terminal, etc.) instead of the user terminal device 6 (personal smartphone). In this case, the vehicle number may be entered into the shared terminal, or a two-dimensional code linked to the registered user terminal device 6 (personal smartphone) may be read into the shared terminal.

[0143] The parking lot management device 5 may select a parking space depending on the situation of the autonomous vehicle 3. For example, in the case of an autonomous vehicle 3 (electric vehicle) with a low charging capacity, a parking space with charging equipment may be selected, and after charging is completed, the parking lot management device 5 may guide the autonomous vehicle 3 to the parking space. Alternatively, after guiding the autonomous vehicle 3 to the parking space, the parking lot management device 5 may notify the user that the charging capacity is low and whether charging is possible, and when a response of "charging required" is received from the user, wireless charging or the like may be performed.

[0144] The parking lot management device 5 narrows down the optimal parking space (one or more) mainly based on the size and shape of the autonomous vehicle 3 (FIG. 14), further narrows down the space using a safety performance judgment function, etc., and finally selects one final parking space 39 (FIG. 13). In contrast, the narrowing down process using the safety performance judgment function, etc. (FIG. 13) may be included in the narrowing down process based on the size and shape, etc. (FIG. 14). For example, the optimal parking space determination process (FIG. 14) may include a process of determining a parking space by machine learning, for example, by comprehensively using the safety performance judgment function (FIG. 13, left) and information such as the vehicle color. On the other hand, if the vehicle is actually parked (FIG. 13, right) and cannot be monitored because it is hidden by a vehicle in front, the process flow of adjusting the parking position (moving forward) may be performed after the search (when parking).

[0145] 9. Conclusion

[0146] (1) According to this embodiment, the parking lot management device 5 acquires the characteristics (particularly the size) of the autonomous vehicle 3, selects a parking space that is not in a blind spot from the on-site camera 32, and guides the autonomous vehicle 3 (step S501). This improves the safety of guiding the autonomous vehicle 3, makes it easier to monitor the autonomous vehicle 3 during guidance using the on-site camera 32, and contributes to appropriate guidance and parking. In addition, the user can check the state of his / her autonomous vehicle 3 from the video from the on-site camera 32 on the user terminal device 6 and understand that it is parked safely, improving convenience.

[0147] (2) The parking lot management device 5 acquires the characteristics (particularly size) of the autonomous vehicle 3, and guides a large autonomous vehicle 3 from the far end (rear side) of the vehicle compartment that is not in a blind spot from the on-site camera 32 (step S504). This improves the safety of guiding the autonomous vehicle 3, and by parking the autonomous vehicle 3 so that it is not in a blind spot when the parking lot becomes full of parked vehicles, it makes it easier for the on-site camera 32 to monitor the autonomous vehicle 3 during guidance, which contributes to appropriate guidance and parking.

[0148] (3) The parking lot management device 5 selects a parking space based on the characteristics of the autonomous vehicle 3 (performance of the safety performance judgment function such as the minimum turning radius and corner sensor) and takes into account the performance of the safety performance judgment function of the vehicle already parked adjacent to it, and parks the vehicles closely together (step S404). This makes it possible to park as many autonomous vehicles 3 as possible in the case of a parking lot 11 (free space) that is not divided into parking spaces (vehicle compartments), which contributes to improving the profits of the parking lot 11. Furthermore, when the parking lot management device 5 selects a parking space for the autonomous vehicle 3, if there is an already parked vehicle next to the parking space, it selects a parking space after taking into account the performance of the safety performance judgment function of the autonomous vehicle 3, thereby contributing to appropriately guiding and managing the autonomous vehicle 3.

[0149] (4) When the parking lot management device 5 guides the autonomous vehicle 3 to park in a parking space, it parks the autonomous vehicle 3 in a parking position where it does not move out of the field of view of the on-site camera 32 due to the blind spot of a vehicle already parked (step S406). As a result, the parking position of the autonomous vehicle 3 to be guided from now on is shifted forward to park it in the parking space (if the on-site camera 32 cannot monitor a relatively small vehicle due to the shadow of a relatively large vehicle, the relatively small autonomous vehicle 3 is parked slightly forward), which allows continuous monitoring by the on-site camera 32 and contributes to the safe management of the autonomous vehicle 3.

[0150] (5) The parking lot management device 5 stores and acquires the performance of the safety performance judgment function of the autonomous vehicle 3 for each vehicle ID (such as a vehicle number) in the vehicle DB 101 (step S204). As a result, the parking lot management device 5 contributes to appropriately guiding and parking the autonomous vehicle 3 using the safety performance judgment function of the autonomous vehicle 3.

[0151] (6) The parking lot management device 5 measures and stores the performance of the safety performance judgment function of the vehicle 3 whose vehicle ID is not stored in the vehicle DB 101 (step S207). In this way, the parking lot management device 5 contributes to appropriately guiding and parking the autonomous vehicle 3 by using the safety performance judgment function of the autonomous vehicle 3.

[0152] (7) The parking lot management device 5 measures the performance of the safety performance judgment function of the autonomous vehicle 3 at multiple locations on the road 36 in the parking lot 11 while the autonomous vehicle 3 is traveling (step S303). As a result, the parking lot management device 5 contributes to appropriately guiding and parking the autonomous vehicle 3 using the safety performance judgment function of the autonomous vehicle 3. For example, when a temporary departure occurs, such as when an autonomous vehicle 3 that has been reserved to leave is made to wait in parallel parking, this is effective and necessary for understanding safety performance in the forward and backward directions.

[0153] According to this embodiment, the equipment cost of the parking lot is reduced by using a small number of surveillance cameras. Furthermore, the vehicle's external shape and safety performance are grasped, and larger vehicles are guided to the farthest side from the cameras, and the parking lot is guided and managed while being monitored by the surveillance cameras without blind spots. This allows the parking lot to be operated appropriately by parking vehicles efficiently in free spaces while minimizing the movement of other vehicles as much as possible.

[0154] Although the embodiments and modified examples of the present technology have been described above, the present technology is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present technology. [Industrial Applicability]

[0155] The present invention is preferably applied to parking lots that support automated valet parking services, and is designed to ensure that parking lots can be used safely and efficiently. [Explanation of symbols]

[0156] Autonomous Vehicle 3 Parking Server 7 Parking lot management device 5 Automatic Valley Control Device 37 Automated Valet Parking Management System 500

Claims

1. A parking lot management device that selects a final parking space for the autonomous vehicle based on the characteristics of the autonomous vehicle, the final parking space not being in a blind spot of a camera installed in the parking lot; An automatic valet control device that outputs a command to the automatic driving vehicle to park in the final parking space; An automated valet parking management system comprising:

2. 2. The automated valet parking management system according to claim 1, The characteristics of the autonomous vehicle include a size; The parking lot management device selects the final parking space based on the size of the autonomous vehicle so that a larger autonomous vehicle is spaced farther from the camera. Automated valet parking management system.

3. 3. The automated valet parking management system according to claim 1, The parking lot management device selects the final parking space that minimizes the inter-vehicle distance between the already parked vehicle and the automatically-operated vehicle in the vehicle width direction based on the characteristics of the already parked vehicle parked in the parking lot and the characteristics of the automatically-operated vehicle. Automated valet parking management system.

4. 4. The automated valet parking management system according to claim 3, The parking lot management device selects the final parking space based on characteristics of the already parked vehicle and characteristics of the autonomous vehicle, such that the already parked vehicle is not in a blind spot of the camera due to the autonomous vehicle and the already parked vehicle is not in a blind spot of the camera due to the autonomous vehicle. Automated valet parking management system.

5. 3. The automated valet parking management system according to claim 1, The parking lot management device selects the final parking space based on the characteristics of the autonomous vehicle stored for each autonomous vehicle in a vehicle DB. Automated valet parking management system.

6. 3. The automated valet parking management system according to claim 1, The parking lot management device includes: If the characteristics of the autonomous vehicle are not stored in the vehicle DB, a plan for an autonomous driving test operation is created; The automated valet control device outputs a command to the automated vehicle to perform an automated driving test operation in the parking lot based on the plan; Acquire characteristics of the autonomous vehicle based on the autonomous driving test operation. Automated valet parking management system.

7. 7. The automated valet parking management system according to claim 6, The parking lot management device creates a plan to execute the automated driving test operation at a plurality of locations in the parking lot. Automated valet parking management system.

8. 3. The automated valet parking management system according to claim 1, The characteristics of the autonomous vehicle include at least one of a minimum turning radius, the presence or absence of a corner sensor, and a minimum distance from an obstacle at which the vehicle automatically stops when the obstacle is detected. Automated valet parking management system.

9. 3. The automated valet parking management system according to claim 1, The parking lot has parking spaces for parking a plurality of vehicles in a row, The parking space has a dividing line extending in the vehicle width direction that divides the parking space from the road, and the parking positions of multiple vehicles parked side by side are not divided, The parking lot management device selects the final parking space so that the front end of the autonomous vehicle is located relative to the demarcation line. Automated valet parking management system.

10. 10. The automated valet parking management system according to claim 9, The parking lot management device adjusts the parking position of the autonomous vehicle so that a front end of the autonomous vehicle and a front end of an adjacent already-parked vehicle are aligned with respect to the demarcation line. Automated valet parking management system.

11. 10. The automated valet parking management system according to claim 9, The parking lot management device adjusts the parking position of the autonomous vehicle so that either the front end of the autonomous vehicle or the front end of the adjacent parked vehicle is spaced apart from the front or rear of the demarcation line in order to prevent the autonomous vehicle from being in a blind spot of the camera due to the other vehicle being in a blind spot of the camera. Automated valet parking management system.

12. 3. The automated valet parking management system according to claim 1, The characteristics of the autonomous vehicle include a vehicle color; The parking lot management device selects a space next to an already parked vehicle having a different color from the color of the autonomous vehicle as the final parking space. Automated valet parking management system.

13. Based on the characteristics of the autonomous vehicle, a final parking space is selected for the autonomous vehicle that is not in the blind spot of the camera installed in the parking lot, Outputting a command to the autonomous vehicle to park in the final parking space. Automated valet parking management method.

Citation Information

Patent Citations

  • Parking lot operation method and parking system

    JP2019061418A