Information provision system and information provision method

Abstract

Regarding automated valet parking in parking lots, the aim is to make it easier to monitor the status of vehicles within the parking lot. [Solution] The information provision system is applied to automated valet parking in a parking lot. The information provision system acquires vehicle management information, which includes at least one of the driving and parking records and schedule of each vehicle in the parking lot. The information provision system accepts the designation of a target time from the target user of the target vehicle. Based on the vehicle management information, the information provision system generates an overhead image showing the positions of the target vehicle and other vehicles in the parking lot at the target time, along with a map of the parking lot. The information provision system provides the overhead image to the target user.

Description

Technical Field

[0001] The present disclosure relates to automated valet parking (AVP) of vehicles in a parking lot. The present disclosure also relates to a technology for providing information on automated valet parking to a user.

Background Art

[0002] Patent Document 1 discloses automated valet parking in a parking lot. A vehicle corresponding to automated valet parking acquires route information from a parking lot system and autonomously travels along the acquired route.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Consider automated valet parking of vehicles in a parking lot. A user of automated valet parking may feel uneasy because they do not know the state of their own vehicle in the parking lot.

Means for Solving the Problems

[0005] A first aspect relates to an information providing system applied to automated valet parking in a parking lot. The information providing system includes one or more processors. The one or more processors acquire vehicle management information including at least one of the driving and parking performance and schedule of each vehicle in the parking lot, receive a designation of a target time from a target user of a target vehicle, Based on vehicle management information, an overhead image is generated that shows the location of the target vehicle and other vehicles within the parking lot at the specified time, along with a map of the parking lot. Provide overhead images to target users. It is configured in this way.

[0006] The second aspect concerns information provision methods that are performed by computers and applied to automated valet parking in parking lots. How to provide information: To acquire vehicle management information including at least one of the driving and parking records and schedules of each vehicle in the parking lot, We accept requests for the target time from the target users of the target vehicles, Based on vehicle management information, an overhead image is generated that shows the location of the target vehicle and other vehicles within the parking lot at the specified time, along with a map of the parking lot. To provide the target user with an overhead view image. Includes. [Effects of the Invention]

[0007] According to this disclosure, the target user is provided with an overhead image showing the positions of the target vehicle and other vehicles at a time specified by the target user. By viewing this overhead image, the target user can understand the status of the target vehicle in the parking lot. This contributes to reducing the target user's anxiety. By understanding the status of the target vehicle in the parking lot, the target user can gain a sense of security. [Brief explanation of the drawing]

[0008] [Figure 1] This is a conceptual diagram illustrating the overview of an automated valet parking system (AVP system). [Figure 2] This is a conceptual diagram illustrating an example of automated valet parking. [Figure 3] This is a conceptual diagram illustrating the overview of the information provision system. [Figure 4] This is a conceptual diagram to explain an example of an overhead view image. [Figure 5] It is a conceptual diagram for explaining another example of an overhead image. [Figure 6] It is a conceptual diagram for explaining an example of reservation availability determination. [Figure 7] It is a conceptual diagram for explaining an example of changing a reservation request. [Figure 8] It is a conceptual diagram for explaining an example of a request for adjusting the schedule of another vehicle. [Figure 9] It is a block diagram showing an example of the configuration of a vehicle. [Figure 10] It is a block diagram showing an example of the configuration of a user terminal. [Figure 11] It is a block diagram showing an example of the configuration of a backend system. [Figure 12] It is a block diagram showing an example of the configuration of a parking lot system. [Figure 13] It is a block diagram showing an example of the configuration of an information providing system.

Mode for Carrying Out the Invention

[0009] Embodiments of the present disclosure will be described with reference to the accompanying drawings. In the following description, automatic valet parking may be referred to as "AVP".

[0010] 1. Automatic Valet Parking System (AVP System) FIG. 1 is a conceptual diagram showing an overview of an AVP system 10 according to the present embodiment. The AVP system 10 is a system for AVP in a parking lot. The AVP system 10 includes a vehicle 100, a user terminal 200, a backend system 300, and a parking lot system 400.

[0011] The vehicle 100 is an object of AVP in the parking lot. The vehicle 100 is provided with at least a function of autonomously traveling in the parking lot.

[0012] The user terminal 200 is a terminal operated by a user of the AVP service, i.e., a user of the vehicle 100. Examples of user terminals 200 include smartphones and PCs.

[0013] The backend system 300 manages AVPs, AVP service users, etc., in one or more parking lots. The parking lot system 400 is an infrastructure system installed in a parking lot and manages the AVPs in that parking lot. The backend system 300 and the parking lot system 400 can also be collectively called the "management system." The management system manages the AVPs in the parking lots.

[0014] Vehicle 100 and backend system 300 can communicate with each other. For example, vehicle 100 and backend system 300 can communicate with each other using a mobile communication service. In a parking lot, vehicle 100 and parking system 400 can communicate wirelessly with each other. For example, vehicle 100 and parking system 400 can communicate wirelessly with each other using a Wi-Fi network. Furthermore, user terminal 200 and backend system 300 can communicate with each other. For example, user terminal 200 and backend system 300 can communicate with each other using a mobile communication service. In addition, backend system 300 and parking system 400 can communicate with each other via wired or wireless connections.

[0015] An example of the AVP service reservation process is as follows: Assume that the user's membership information is pre-registered in the backend system 300. First, the user makes an AVP reservation. For example, the user operates the user terminal 200 to input their user ID information, desired parking lot, desired date of use, desired time of use (scheduled entry time and scheduled exit time), etc. The user terminal 200 sends reservation request information, including the entered information, to the backend system 300. The backend system 300 processes the reservation based on the reservation request information and sends a reservation completion notification to the user terminal 200. The backend system 300 also provides the reservation information to the parking system 400 of the reserved parking lot.

[0016] Figure 2 is a conceptual diagram illustrating an example of AVP in a parking lot.

[0017] Vehicle 100 recognizes its surroundings using recognition sensors (e.g., cameras) mounted on it. Vehicle 100 drives safely while recognizing its surroundings. Multiple markers M (landmarks) may be placed within the parking lot. Markers M are used to guide vehicle 100 within the parking lot. For example, vehicle 100 acquires images of its surroundings using its camera and recognizes markers M based on the images. Then, based on the recognition results of markers M, vehicle 100 performs localization to estimate its position in the parking lot with high accuracy. Based on the estimated vehicle position, vehicle 100 drives automatically within the parking lot.

[0018] One or more infrastructure cameras (CAMs) may be installed in the parking lot. The infrastructure camera (CAM) photographs the parking lot and acquires images showing the conditions of the parking lot. The parking lot system 400 communicates with the infrastructure camera (CAM) and acquires the images taken by the infrastructure camera (CAM). The parking lot system 400 detects vehicles (100) that are shown in the images by analyzing the images. The parking lot system 400 also estimates the position of the vehicles (100) shown in the images. Furthermore, the parking lot system 400 manages each vehicle (100) in the parking lot based on its position. The parking lot system 400 may provide the vehicle (100) with its position information. The vehicle (100) may automatically drive within the parking lot based on the position information provided by the parking lot system 400.

[0019] An example of the parking process (check-in) is as follows: Vehicle 100 stops in the parking area. In the parking area, the user gets out of vehicle 100 and requests to park using a user terminal 200 or the like. The management system (at least one of the backend system 300 and the parking system 400) authenticates the user and vehicle 100. Once authentication is complete, the control of vehicle 100 is transferred from the user to the management system. The management system also communicates with vehicle 100 and starts it up. The parking system 400 then assigns an available parking space to vehicle 100. The assigned available parking space becomes the target parking space, or destination, for vehicle 100 at the time of parking. Furthermore, the parking system 400 sets a driving route TP (target trajectory) from the parking area to the target parking space in the parking lot. The parking system 400 sends a parking instruction to vehicle 100. The parking instruction includes information on the target parking space and the driving route TP. In response to the parking instruction, vehicle 100 automatically drives to the target parking space according to the driving path TP. In other words, vehicle 100 automatically drives to follow the driving path TP based on its position. Then, vehicle 100 automatically parks in the target parking space. After parking is complete, the management system instructs vehicle 100 to stop its operation.

[0020] An example of the checkout process is as follows: The user requests checkout using a user terminal 200 or the like. The management system communicates with vehicle 100 and starts vehicle 100. When checking out, the designated checkout area becomes the destination for vehicle 100. The parking system 400 sets the driving route TP (target trajectory) from the parking space in the parking lot to the checkout area. The parking system 400 sends a checkout instruction to vehicle 100. The checkout instruction includes information on the designated checkout area and driving route TP. In response to the checkout instruction, vehicle 100 automatically drives to the checkout area according to the driving route TP. In other words, vehicle 100 automatically drives to follow the driving route TP based on its position. Then, vehicle 100 automatically stops at the checkout area. Operational authority for vehicle 100 is transferred from the management system to the user. The user gets into vehicle 100. Vehicle 100 starts moving towards the next destination.

[0021] An additional service facility may be installed in the parking lot to provide additional services such as charging, car washing, and maintenance. By utilizing such additional services, users can make effective use of their parking period from entry to exit. Specifically, users who wish to use additional services apply for these services using the user terminal 200. The management system manages the usage and reservation status of the additional service facility and assigns the time slots during which the additional service facility is available to the user's vehicle 100. The parking lot system 400 sets the travel route TP (outbound) from the parking space assigned to vehicle 100 (i.e., the parking space where vehicle 100 is parked) to the additional service facility. The parking lot system 400 also sets the travel route TP (return) from the additional service facility to the assigned parking space. The parking lot system 400 then sends a movement instruction, including the travel route TP (outbound), to vehicle 100 in time for the service provision time slot assigned to vehicle 100. In response to the movement instruction, vehicle 100 automatically travels from the assigned parking space to the additional service facility according to the travel route TP. Vehicle 100 stops at an additional service facility and receives the additional service. Once the additional service is completed, the parking system 400 transmits a movement instruction to vehicle 100, including the return route TP. In response to the movement instruction, vehicle 100 automatically travels from the additional service facility to its assigned parking space according to the return route TP.

[0022] 2. Information Provision System Figure 3 is a conceptual diagram illustrating the overview of the information provision system 500 according to this embodiment. The information provision system 500 provides various information about AVP to AVP users. The information provision system 500 may also receive various requests about AVP from AVP users. The information provision system 500 may provide information about AVP to users in response to requests from users. It can also be said that the information provision system 500 provides a user interface to AVP users.

[0023] The information provision system 500 is configured to share information with the user terminal 200 of the AVP user. The information provision system 500 can receive various requests from the user via the user terminal 200 and provide various information to the user. For example, the information provision system 500 includes a backend system 300 that can communicate with the user terminal 200. The backend system 300 can receive various requests from the user and provide various information to the user by communicating with the user terminal 200. The information provision system 500 may also include a parking system 400. The parking system 400 can communicate with the user terminal 200 via the backend system 300. As yet another example, the information provision system 500 may be a separate system that is distinct from the backend system 300 and the parking system 400 but can share information with the backend system 300 and the parking system 400. As yet another example, the information provision system 500 may include the user terminal 200 itself. In either case, the information provision system 500 can receive various requests from users and provide various information to users.

[0024] The information provision system 500 acquires map information MAP, which shows a map of the parking lot. Map information MAP shows the layout of roads within the parking lot. Map information MAP may also show the layout of stationary obstacles (e.g., walls, pillars) within the parking lot. Map information MAP can be obtained, for example, from a parking system 400 installed in the parking lot.

[0025] Furthermore, the information provision system 500 acquires vehicle management information VCL. Vehicle management information VCL is information for managing each vehicle 100 that is subject to AVP. The vehicles 100 subject to AVP include vehicles 100 currently present in the parking lot. The vehicles 100 subject to AVP may also include vehicles 100 for which AVP has been reserved, i.e., vehicles 100 that are scheduled to use the parking lot in the future. Vehicle management information VCL is obtained from the backend system 300 and the parking lot system 400.

[0026] The vehicle management information VCL contains user information (e.g., user ID) for each of the 100 vehicles. This allows us to understand the correspondence between users and the 100 vehicles.

[0027] Furthermore, the vehicle management information (VCL) includes at least one of the performance information and the schedule information.

[0028] The performance information shows the driving and parking records of each vehicle 100 in the parking lot. For example, the performance information includes the hourly location information of each vehicle 100 in the parking lot. The hourly location information of each vehicle 100 is obtained from the parking system 400 or each vehicle 100. The performance information may also include information on each vehicle 100's parking space and driving route TP. The performance information may also include each vehicle 100's entry time, exit time, usage time of additional service facilities, etc.

[0029] The schedule information includes the planned entry time, planned exit time, and planned usage time of additional service facilities for each vehicle 100. The planned entry time, planned exit time, and planned usage time of additional service facilities for each vehicle 100 are obtained from reservation information managed by the backend system 300 and the parking system 400. For vehicles 100 with AVP reservations, a parking space may be provisionally assigned based on the parking lot usage status at the planned entry time. Once a parking space is provisionally assigned, the driving route TP is also provisionally determined. The schedule information may include information on the planned parking space and planned driving route for each vehicle 100.

[0030] The information provision system 500 performs information provision processing based on map information MAP and vehicle management information VCL. Various examples of information provision processing are described below. In the following explanation, the user receiving the information will be referred to as the "target user," and the target user's vehicle 100 will be referred to as "target vehicle 100T." Target vehicle 100T can also be said to be the target user's vehicle 100. Vehicles other than target vehicle 100T will be referred to as "other vehicles 100X."

[0031] 2-1. Provision (presentation) of overhead images Figure 4 is a conceptual diagram illustrating an example of an overhead view image IMG of a parking lot. The overhead view image IMG shows the location of each vehicle 100 within the parking lot, along with a map of the parking lot. The vehicles 100 in the parking lot include the target vehicle 100T of the target user and other vehicles 100X other than the target vehicle 100T. The information provision system 500 may provide (present) such an overhead view image IMG to the target user. The information provision system 500 may also receive an overhead view image request from the target user and, in response, provide (present) the overhead view image IMG to the target user.

[0032] More specifically, the target user specifies the timing or period they wish to view as the "target time." The target user can specify the target time by operating the user terminal 200. The information provision system 500 receives the target time specification from the target user. In other words, the information provision system 500 obtains information about the target time specified by the target user.

[0033] Next, the information provision system 500 generates an overhead image IMG for the target time based on the parking lot map information MAP, vehicle management information VCL, and the target time. In this example, the vehicle management information VCL includes performance information showing the driving and parking performance of each vehicle 100 in the parking lot. Based on the performance information, the information provision system 500 can obtain the position of each vehicle 100 at the target time. Then, by combining the map information MAP and the position of each vehicle 100 at the target time, the information provision system 500 generates an overhead image IMG for the target time. The overhead image IMG thus generated shows the positions of the target vehicle 100T and other vehicles 100X in the parking lot at the target time, along with the parking lot map. The overhead image IMG may be generated in real time.

[0034] The information provision system 500 then provides (presents) the generated overhead image IMG to the target user. Specifically, the information provision system 500 instructs the user terminal 200, which is operated by the target user, to display the overhead image IMG on its screen. The user terminal 200 displays the overhead image IMG on its screen. By viewing the overhead image IMG, the target user can understand the status of the target vehicle 100T in the parking lot. This contributes to reducing the target user's anxiety. By understanding the status of the target vehicle 100T in the parking lot, the target user can gain a sense of security.

[0035] As shown in Figure 4, the overhead view image IMG may show the travel route TP and assigned parking space of the target vehicle 100T.

[0036] As shown in Figure 4, the information provision system 500 may generate an overhead image IMG that distinguishes the target vehicle 100T from other vehicles 100X. For example, the information provision system 500 may make the color of the target vehicle 100T different from the color of other vehicles 100X. As another example, the information provision system 500 may circle the target vehicle 100T. As yet another example, the information provision system 500 may highlight the target vehicle 100T.

[0037] As shown in Figure 4, the information provision system 500 may display a time seek bar along with an overhead image IMG on the screen (e.g., touch panel) of the user terminal 200 operated by the target user. The target user can specify the target time (target timing) by operating the time seek bar on the screen of the user terminal 200. The information provision system 500 accepts the time specified by the operation of the time seek bar on the screen of the user terminal 200 as the target time (target timing). By continuously changing the target time using the time seek bar, it is also possible to see how each vehicle 100 moves within the parking lot.

[0038] As described above, according to this embodiment, the target user is provided with an overhead image IMG showing the positions of the target vehicle 100T and other vehicles 100X at a time specified by the target user. By viewing the overhead image IMG, the target user can understand the status of the target vehicle 100T in the parking lot. This contributes to reducing the target user's anxiety. By understanding the status of the target vehicle 100T in the parking lot, the target user can gain a sense of security.

[0039] The target user can view the status of vehicle 100T while it is parked. They can also view the status of vehicle 100T after it has been parked. Due to changes in parking positions (relocation) after parking, the parking location of vehicle 100T may change from its original location. Knowing the latest parking location is convenient, for example, when you want to retrieve something you've forgotten.

[0040] 2-2. Providing (presenting) an overhead view image at the reservation stage. During the AVP reservation stage for the target vehicle 100T, the information provision system 500 may provide the target user with a future overhead image IMG. In this case, the future overhead image IMG is generated based on the schedule information in the vehicle management information VCL. Figure 5 shows an example of a future overhead image IMG.

[0041] First, the information provision system 500 receives a reservation request for the AVP of the target vehicle 100T from the target user. Specifically, the target user operates the user terminal 200 to input their ID information, desired parking lot, desired date of use, desired time of use (scheduled entry and exit times), desired use of additional services, etc. The user terminal 200 sends the reservation request containing the entered information to the backend system 300. The information provision system 500 retrieves the reservation request and reflects it in the schedule information. In other words, the information provision system 500 updates the schedule information by adding the reservation request from the target user to the schedule information.

[0042] The target vehicle 100T is assumed to drive and park according to reservation requests from the target user. For convenience, the target vehicle 100T assumed in this way will be referred to as "virtual target vehicle 100TI" below.

[0043] The schedule information includes the driving and parking schedule of the virtual target vehicle 100TI in the parking lot. Furthermore, the schedule information includes the driving and parking schedule of other vehicles 100X in the parking lot. Based on the schedule information, the information provision system 500 estimates the positions of the virtual target vehicle 100TI and other vehicles 100X in the parking lot at the target time by simulating the future conditions of the parking lot.

[0044] For example, the information provision system 500 grasps the future usage status of the parking lot based on schedule information and assigns an available parking space to the virtual target vehicle 100TI upon entry. Furthermore, the information provision system 500 sets the driving route TP from the entry area to the assigned parking space. The rules for vehicle speed within the parking lot are predetermined. Based on the scheduled entry time, driving route TP, and vehicle speed rules, the information provision system 500 can estimate the position of the virtual target vehicle 100TI hour by hour while it is in the parking lot. Until the scheduled departure time or the start of additional service use, the virtual target vehicle 100TI is located in the assigned parking space. The position of the virtual target vehicle 100TI at the time of departure and during the additional service use period can also be estimated in the same way as at the time of entry. The positions of other vehicles 100X can also be estimated in the same way as the virtual target vehicle 100TI.

[0045] The information provision system 500 then generates an overhead image IMG for the target time by combining the map information MAP with the estimated position of each vehicle 100 at the target time. The overhead image IMG thus generated shows the estimated positions of the virtual target vehicle 100TI and other vehicles 100X within the parking lot at the target time, along with the map of the parking lot. The information provision system 500 then provides (presents) the generated overhead image IMG to the target user.

[0046] The rest is the same as in Figure 4. The overhead view image IMG may show the driving route TP and assigned parking space of the virtual target vehicle 100TI. The overhead view image IMG may be generated in a way that distinguishes the virtual target vehicle 100TI from other vehicles 100X. A time seek bar may be displayed on the screen (e.g., touch panel) of the user terminal 200 operated by the target user along with the overhead view image IMG.

[0047] 2-3. Determination of Reservation Availability The information provision system 500 may determine whether or not a reservation request from the target user is acceptable. This process will be referred to below as "reservation feasibility determination."

[0048] As described above, the information provision system 500 can estimate the positions of the virtual target vehicle 100TI and other vehicles 100X in the parking lot based on the schedule information. Therefore, the information provision system 500 can determine whether the virtual target vehicle 100TI is likely to interfere with other vehicles 100X. Here, "likely to interfere" means, for example, that the distance between the virtual target vehicle 100TI and other vehicles 100X is less than a threshold. As another example, "likely to interfere" may also mean that the TTC (Time to Collision) between the virtual target vehicle 100TI and other vehicles 100X is less than a threshold.

[0049] In the example shown in Figure 5, it is determined that there is no possibility of the virtual target vehicle 100TI interfering with other vehicles 100X. In this case, the information provision system 500 accepts the reservation request from the target user. The information provision system 500 then provides the target user with a reservation confirmation notification indicating that the reservation request has been accepted. For example, the target user's user terminal 200 displays the reservation confirmation notification on its screen.

[0050] On the other hand, in the example shown in Figure 6, it is determined that the virtual target vehicle 100TI may interfere with the first vehicle 100A among the other vehicles 100X. In this case, the information provision system 500 rejects the reservation request from the target user. The information provision system 500 then provides the target user with a reservation rejection notice indicating that the reservation request cannot be accepted. For example, the target user's user terminal 200 displays the reservation rejection notice on its screen.

[0051] 2-4. Changing a reservation request Users who receive a reservation cancellation notice may consider modifying their reservation request. In this case, by viewing an overhead image IMG that includes the virtual target vehicle 100TI and the first vehicle 100A, the user can visually understand why and how the virtual target vehicle 100TI and the first vehicle 100A interfere with each other. Visually understanding why and how the virtual target vehicle 100TI and the first vehicle 100A interfere makes it easier to consider how to modify the reservation request to avoid the interference. In this sense, providing the overhead image IMG to the user is useful.

[0052] The target user modifies the reservation request by operating the user terminal 200. The information provision system 500 receives the change in the reservation request from the target user. The information provision system 500 then performs the above-mentioned reservation approval / rejection determination for the new reservation request.

[0053] Figure 7 is a conceptual diagram illustrating an example of a change in a reservation request. The information provision system 500 displays an overhead image IMG on the screen of the user terminal 200 operated by the target user. The display position of the virtual target vehicle 100TI on the screen of the user terminal 200 can be changed by the target user's operation. For example, the screen is a touch panel. The target user can change the display position of the virtual target vehicle 100TI by touching and dragging the virtual target vehicle 100TI displayed on the touch panel. As another example, the target user may change the display position of the virtual target vehicle 100TI by clicking and dragging the virtual target vehicle 100TI on the screen using a mouse. Changing the display position of the virtual target vehicle 100TI on the screen is equivalent to changing the scheduled entry time or scheduled departure time. Therefore, the information provision system 500 receives the change in the display position of the virtual target vehicle 100TI on the screen as a change in the reservation request.

[0054] As shown in Figure 7, it is possible to visually modify the reservation request while viewing the overhead image (IMG). This improves convenience.

[0055] 2-5. Request to adjust schedule with other vehicles Vehicle 100 may be moved within the parking lot to change its parking location (repositioning). Additionally, vehicle 100 may be moved within the parking lot to utilize additional services during its parking period (e.g., charging, car wash, maintenance). Such movement schedules are not strictly defined and are negotiable.

[0056] A user who receives a notification that their reservation is unavailable may request a schedule adjustment for the first vehicle 100A. In this case, the user can visually understand why and how the virtual target vehicle 100TI and the first vehicle 100A interfere with each other by viewing an overhead image IMG that includes the virtual target vehicle 100TI and the first vehicle 100A. If the user can visually understand why and how the virtual target vehicle 100TI and the first vehicle 100A interfere, it will be easier to consider how to change the schedule of the first vehicle 100A to avoid the interference. In this sense as well, providing the overhead image IMG to the user is useful.

[0057] The target user operates user terminal 200 to request a schedule adjustment for vehicle 100A. This request will be referred to below as the "other vehicle schedule adjustment request".

[0058] Figure 8 is a conceptual diagram illustrating an example of a request for scheduling adjustments with other vehicles. The information provision system 500 displays an overhead image (IMG) on the screen of the user terminal 200 operated by the target user. The display position of the first vehicle 100A on the screen of the user terminal 200 can be changed by the target user's operation. For example, the screen is a touch panel. The target user can change the display position of the first vehicle 100A by touching and dragging the first vehicle 100A displayed on the touch panel. As another example, the target user may change the display position of the first vehicle 100A by clicking and dragging the first vehicle 100A on the screen using a mouse. Changing the display position of the first vehicle 100A on the screen is equivalent to changing the movement schedule of the first vehicle 100A. Therefore, the information provision system 500 receives the change in the display position of the first vehicle 100A on the screen as a request for scheduling adjustments with other vehicles. In this way, as shown in the example in Figure 8, it is possible to request schedule adjustments visually while viewing the overhead image (IMG). This improves convenience.

[0059] The information provision system 500 receives a request for scheduling adjustments with other vehicles from the target user. Based on the schedule information, the information provision system 500 determines whether or not it can accept the request for scheduling adjustments with other vehicles. In other words, based on the schedule information, the information provision system 500 determines whether or not it can adjust the schedule of the first vehicle 100A so that the virtual target vehicle 100TI does not interfere with the first vehicle 100A.

[0060] If the schedule of the first vehicle 100A can be adjusted, the information provision system 500 accepts the request to adjust the schedule of the other vehicle. The information provision system 500 updates the schedule information by updating the schedule of the first vehicle 100A. The information provision system 500 also accepts reservation requests from the target user. The information provision system 500 provides the target user with a reservation confirmation notification indicating that both the request to adjust the schedule of the other vehicle and the reservation request have been accepted. For example, the target user's user terminal 200 displays the reservation confirmation notification on its screen.

[0061] On the other hand, if it is not possible to adjust the schedule of the first vehicle 100A, the information provision system 500 rejects the request to adjust the schedule of another vehicle. The information provision system 500 then provides the user with a rejection notice indicating that the schedule adjustment of another vehicle is not possible. For example, the user terminal 200 of the user displays the rejection notice on its screen.

[0062] 3. Example of vehicle configuration Figure 9 is a block diagram showing an example configuration of a vehicle 100 according to this embodiment. The vehicle 100 includes a communication device 110, a sensor group 120, a driving device 130, and a control device 150.

[0063] The communication device 110 communicates with the outside world via a communication network. For example, the communication device 110 communicates with the backend system 300. It also communicates with the parking system 400 via a wireless LAN.

[0064] The sensor group 120 includes recognition sensors, vehicle condition sensors, etc. Recognition sensors are used to recognize (detect) the surrounding conditions of the vehicle 100. Examples of recognition sensors include cameras, LiDAR (Laser Imaging Detection and Ranging), radar, etc. Vehicle condition sensors include speed sensors, acceleration sensors, yaw rate sensors, steering angle sensors, etc.

[0065] The running gear 130 includes a steering gear, a drive gear, and a braking gear. The steering gear steers the wheels. For example, the steering gear includes an electric power steering (EPS) system. The drive gear is a power source that generates driving force. Examples of drive gears include an engine, an electric motor, an in-wheel motor, etc. The braking gear generates braking force.

[0066] The control device 150 is a computer that controls the vehicle 100. The control device 150 includes one or more processors 151 (hereinafter simply referred to as processor 151) and one or more storage devices 152 (hereinafter simply referred to as storage devices 152). The processor 151 performs various processes. Examples of processors 151 include general-purpose processors, application-specific processors, CPUs (Central Processing Units), GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), FPGAs (Field-Programmable Gate Arrays), integrated circuits, and / or combinations thereof. The processor 151 can also be called processing circuitry. The storage devices 152 store various information. Examples of storage devices 152 include volatile memory, non-volatile memory, HDDs (Hard Disk Drives), SSDs (Solid State Drives), etc.

[0067] The vehicle control program 160 is a computer program for controlling the vehicle 100. The functions of the control device 150 may be realized through the cooperation of a processor 151 that executes the vehicle control program 160 and a storage device 152. The vehicle control program 160 is stored in the storage device 152. Alternatively, the vehicle control program 160 may be recorded on a computer-readable recording medium.

[0068] The control device 150 performs vehicle driving control to control the movement of the vehicle 100. Vehicle driving control includes steering control, acceleration control, and deceleration control. The control device 150 performs vehicle driving control by controlling the driving equipment 130 (steering equipment, drive equipment, braking equipment).

[0069] The control device 150 communicates with the backend system 300 and the parking system 400 via the communication device 110.

[0070] The control device 150 acquires driving environment information 170 that indicates the driving environment of the vehicle 100. The driving environment information 170 is stored in the storage device 152. For example, the driving environment information 170 includes surrounding condition information, vehicle status information, map information, location information, etc.

[0071] The surrounding environment information indicates the recognition results from the recognition sensor. The surrounding environment information may include object information about objects recognized by the recognition sensor. Examples of objects around vehicle 100 include obstacles, white lines, marker M, etc. Examples of obstacles include walls, pillars, other vehicles, etc. The object information indicates the relative position and relative velocity of the object with respect to vehicle 100.

[0072] Vehicle status information indicates the vehicle status detected by vehicle status sensors. Examples of vehicle status include speed, acceleration, yaw rate, steering angle, etc.

[0073] The map information is map information of the parking lot in which vehicle 100 travels. The map information shows the layout of roads within the parking lot. The map information also shows the layout of stationary obstacles (e.g., walls, pillars) within the parking lot. Furthermore, the map information shows the layout of markers M within the parking lot. For example, the map information is provided by the parking lot system 400 that manages the parking lot. The control device 150 acquires the map information from the parking lot system 400 via the communication device 110.

[0074] The location information indicates the current position of vehicle 100 in the parking lot. For example, the control device 150 acquires highly accurate location information through localization. Specifically, the control device 150 calculates the approximate position of vehicle 100 in the parking lot based on vehicle status information (steering angle and speed). The control device 150 also recognizes markers M around vehicle 100 using a recognition sensor. Furthermore, the control device 150 acquires information on the placement of markers M around vehicle 100 from map information. The control device 150 corrects the position of vehicle 100 by matching the recognition results of markers M with their placement. This results in highly accurate location information.

[0075] Alternatively, the location information of the vehicle 100 may be estimated by the parking system 400 based on images captured by the infrastructure camera CAM. In this case, the control device 150 may obtain the location information from the parking system 400 via the communication device 110.

[0076] Furthermore, the control device 150 acquires information on the driving route TP in the parking lot. For example, the driving route TP is determined by the parking system 400, and the control device 150 acquires the driving route TP information from the parking system 400 via the communication device 110. In another example, the control device 150 may determine the driving route TP based on map information and location information. Then, based on the location information, the control device 150 performs vehicle driving control so that the vehicle 100 travels according to the driving route TP.

[0077] 4. Example of user terminal configuration Figure 10 is a block diagram showing an example configuration of a user terminal 200 according to this embodiment. The user terminal 200 includes a communication device 210, an input device 220, a display device 230, and a control device 250.

[0078] The communication device 210 communicates with the outside world via a communication network. For example, the communication device 210 communicates with the backend system 300. It also communicates with the information provision system 500.

[0079] Examples of input devices 220 include touch panels, buttons, microphones, and the like.

[0080] Examples of the display device 230 include touch panels, displays, etc. The display device 230 and the input device 220 may be the same touch panel.

[0081] The control device 250 is a computer that controls the user terminal 200. The control device 250 includes one or more processors 251 (hereinafter simply referred to as processor 251) and one or more storage devices 252 (hereinafter simply referred to as storage devices 252). The processors 251 perform various processes. Examples of processors 251 include general-purpose processors, application-specific processors, CPUs, GPUs, ASICs, FPGAs, integrated circuits, and / or combinations thereof. The processors 251 can also be called processing circuitry. The storage devices 252 store various information. Examples of storage devices 252 include volatile memory, non-volatile memory, HDDs, SSDs, etc.

[0082] The terminal control program 260 is a computer program for controlling the user terminal 200. The terminal control program 260 includes an AVP application. The functions of the control device 250 may be realized through the cooperation of the processor 251 that executes the terminal control program 260 and the storage device 252. The terminal control program 260 is stored in the storage device 252. Alternatively, the terminal control program 260 may be recorded on a computer-readable recording medium.

[0083] The control device 250 communicates with the backend system 300 and the information provision system 500 via the communication device 210.

[0084] The user can specify the target time for the overhead image IMG using the input device 220. The control device 250 transmits the target time information specified by the user to the information provision system 500.

[0085] Furthermore, the user can input requests regarding the AVP using the input device 220. For example, the user may request a reservation to use the AVP (reservation request). As another example, the user may request the provision of an overhead image IMG (overhead image provision request). As yet another example, the user may request a change to the content of a reservation request (reservation change request). As yet another example, the user may request the adjustment of the schedule of another vehicle 100X (other vehicle schedule adjustment request). The request information REQ indicates the content of the request entered by the user. The control device 250 transmits the request information REQ to the information provision system 500 via the communication device 210.

[0086] The control device 250 acquires an overhead image IMG. For example, the overhead image IMG is generated by the backend system 300, and the control device 250 receives the overhead image IMG from the backend system 300. In another example, the control device 250 may receive map information MAP and vehicle management information VCL from the backend system 300 and generate the overhead image IMG based on the map information MAP and vehicle management information VCL. In the latter case, it can be said that the information provision system 500 is a concept that also includes the user terminal 200.

[0087] The control device 250 stores the acquired overhead image IMG in the storage device 252. The control device 250 also displays the overhead image IMG on the display device 230.

[0088] 5. Example of a backend system configuration Figure 11 is a block diagram showing an example configuration of the backend system 300 according to this embodiment. The backend system 300 includes a communication device 310, one or more processors 320 (hereinafter simply referred to as processor 320), and one or more storage devices 330 (hereinafter simply referred to as storage devices 330).

[0089] The communication device 310 communicates with each vehicle 100. It also communicates with each user's user terminal 200. Furthermore, the communication device 310 communicates with the parking system 400 of each parking lot.

[0090] The processor 320 performs various processes. Examples of the processor 320 include general-purpose processors, application-specific processors, CPUs, GPUs, ASICs, FPGAs, integrated circuits, and / or combinations thereof. The processor 320 can also be called processing circuitry. The storage device 330 stores various information. Examples of storage devices 330 include volatile memory, non-volatile memory, HDDs, SSDs, etc.

[0091] The management program 340 is a computer program for managing the AVP in the parking lot. The functions of the backend system 300 may be realized through the cooperation of the processor 320, which executes the management program 340, and the storage device 330. The management program 340 is stored in the storage device 330. The management program 340 may be recorded on a computer-readable recording medium.

[0092] The processor 320 communicates with the vehicle 100, the user terminal 200, and the parking system 400 via the communication device 310.

[0093] The storage device 330 stores management information 350. The management information 350 may include user information and reservation information for each user. The management information 350 may also include facility information and reservation status information for each parking lot.

[0094] The management information 350 may include map information MAP of the parking lot. The management information 350 may also include vehicle management information VCL. The processor 320 may provide the functions of the information provision system 500. Specifically, the processor 320 receives request information REQ from the user terminal 200. The processor 320 also receives information on the target time specified by the user from the user terminal 200. The processor 320 also generates an overhead image IMG based on the map information MAP and the vehicle management information VCL. Furthermore, the processor 320 sends the generated overhead image IMG to the user terminal 200.

[0095] 6. Example of a parking system configuration Figure 12 is a block diagram showing an example configuration of a parking system 400 according to this embodiment. The parking system 400 includes a communication device 410, one or more processors 420 (hereinafter simply referred to as processor 420), and one or more storage devices 430 (hereinafter simply referred to as storage devices 430).

[0096] The communication device 410 communicates with each vehicle 100. The communication device 410 also communicates with the backend system 300. Furthermore, the communication device 410 may communicate with the infrastructure camera CAM installed in the parking lot.

[0097] The processor 420 performs various processes. Examples of the processor 420 include general-purpose processors, application-specific processors, CPUs, GPUs, ASICs, FPGAs, integrated circuits, and / or combinations thereof. The processor 420 can also be called processing circuitry. The storage device 430 stores various information. Examples of storage devices 430 include volatile memory, non-volatile memory, HDDs, SSDs, etc.

[0098] The management program 440 is a computer program for managing the parking lot. The functions of the parking system 400 may be realized through the cooperation of the processor 420 that executes the management program 440 and the storage device 430. The management program 440 is stored in the storage device 430. The management program 440 may be recorded on a computer-readable recording medium.

[0099] The processor 420 communicates with the vehicle 100 and the backend system 300 via the communication device 410. The processor 420 may also communicate with the user terminal 200 via the communication device 410 and the backend system 300.

[0100] Furthermore, the storage device 430 stores management information 450 for managing the parking lot. The management information 450 includes map information MAP of the parking lot. The processor 420 may provide the map information MAP to the vehicle 100 via the communication device 410. The management information 450 also indicates the usage status (availability) of parking spaces within the parking lot. Based on the management information 450, the processor 420 can assign an available parking space (destination) to the vehicle 100.

[0101] The management information 450 may include location information for each vehicle 100 in the parking lot. The processor 420 may communicate with each vehicle 100 via the communication device 410 and collect location information from each vehicle 100. Alternatively, the processor 420 may acquire images captured by infrastructure cameras CAM installed in the parking lot and estimate the location of each vehicle 100 based on those images. The management information 450 may include a travel route TP assigned to each vehicle 100. The processor 420 can determine the travel route TP assigned to each vehicle 100 based on the location information of the vehicle 100, the destination, and map information MAP. The processor 420 may provide the travel route TP information to the vehicle 100 via the communication device 410.

[0102] The management information 450 may include vehicle management information VCL. The processor 420 may provide the functions of the information provision system 500. Specifically, the processor 420 receives request information REQ from the user terminal 200. The processor 420 also receives information on the target time specified by the user from the user terminal 200. The processor 420 also generates an overhead image IMG based on the map information MAP and the vehicle management information VCL. Furthermore, the processor 420 sends the generated overhead image IMG to the user terminal 200.

[0103] 7. Example of an information provision system configuration The information provision system 500 is configured to share information with the user terminal 200. The information provision system 500 can receive various requests from the user via the user terminal 200 and provide various information to the user. For example, the information provision system 500 includes a backend system 300. Another example is that the information provision system 500 may include a parking system 400. Yet another example is that the information provision system 500 may include the user terminal 200 itself. In any case, the information provision system 500 can receive various requests from the user and provide various information to the user.

[0104] In general, the information provision system 500 has the configuration shown in Figure 13. The information provision system 500 includes a user interface 510, one or more processors 520 (hereinafter simply referred to as processor 520), and one or more storage devices 530 (hereinafter simply referred to as storage devices 530).

[0105] The user interface 510 provides information to the user and receives information from the user. For example, the user interface 510 includes a communication device 310 (communication interface) of the backend system 300. In another example, the user interface 510 may include an input device 220 and a display device 230 of the user terminal 200.

[0106] The processor 520 performs various processes. Examples of the processor 520 include general-purpose processors, application-specific processors, CPUs, GPUs, ASICs, FPGAs, integrated circuits, and / or combinations thereof. The processor 520 can also be called processing circuitry. The storage device 530 stores various information. Examples of storage devices 530 include volatile memory, non-volatile memory, HDDs, SSDs, etc.

[0107] The information provision program 540 is a computer program for information provision processing. The functions of the information provision system 500 may be realized through the cooperation of a processor 520 that executes the information provision program 540 and a storage device 530. The information provision program 540 is stored in the storage device 530. The information provision program 540 may also be recorded on a computer-readable recording medium.

[0108] The storage device 530 stores map information MAP and vehicle management information VCL. The processor 520 receives request information REQ from the user via the user interface 510. The processor 520 also receives information about the target time specified by the user via the user interface 510. The processor 520 generates an overhead image IMG based on the map information MAP and vehicle management information VCL. Furthermore, the processor 520 provides the overhead image IMG to the user via the user interface 510. [Explanation of symbols]

[0109] 10. Automatic Valet Parking (AVP) System 100 vehicles 200 user terminals 300 backend systems 400 Parking System 500 Information Provision System MAP Map Information VCL Vehicle Management Information IMG overhead view

Claims

1. An information provision system applicable to automated valet parking in a parking lot, Equipped with one or more processors, The one or more processors described above are: Vehicle management information is acquired that includes at least one of the driving and parking records and schedules of each vehicle in the aforementioned parking lot. We accept requests for the target time from the target users of the target vehicles. Based on the aforementioned vehicle management information, an overhead image is generated that shows the positions of the target vehicle and other vehicles within the parking lot at the specified time, along with a map of the parking lot. The overhead image is provided to the target user. It is configured in such a way Information provision system.

2. The information provision system according to claim 1, The one or more processors further include: The overhead image is displayed along with a time seek bar on the screen of the terminal operated by the target user. The time specified by operating the time seek bar on the aforementioned screen is accepted as the target time. It is configured in such a way Information provision system.

3. The information provision system according to claim 1, The one or more processors generate the overhead image so that the target vehicle can be distinguished from other vehicles. Information provision system.

4. An information provision system according to any one of claims 1 to 3, The one or more processors are further configured to receive reservation requests for the automated valet parking in the parking lot from the target user. The virtual target vehicle is the target vehicle that is assumed to drive and park in accordance with the reservation request, The vehicle management information includes schedule information indicating the schedule for the driving and parking of the virtual target vehicle and the other vehicle. The one or more processors are configured to estimate the positions of the virtual target vehicle and other vehicles in the parking lot during the target time based on the schedule information, and to generate the overhead view image. Information provision system.

5. The information provision system according to claim 4, The one or more processors further include: Based on the schedule information, determine whether the virtual target vehicle may interfere with the other vehicle. If the virtual target vehicle may interfere with other vehicles, the user will be provided with a reservation rejection notice indicating that the reservation request cannot be accepted. It is configured in such a way Information provision system.

6. The information provision system according to claim 5, The one or more processors are further configured to receive changes to the reservation request from the target user. Information provision system.

7. The information provision system according to claim 6, The aforementioned overhead image is displayed on the screen of the terminal operated by the target user. The display position of the virtual target vehicle on the screen can be changed by the operation of the target user. The one or more processors are further configured to receive changes in the display position of the virtual target vehicle on the screen as changes to the reservation request. Information provision system.

8. The information provision system according to claim 5, The one or more processors further include: If the virtual target vehicle may interfere with the first vehicle among the other vehicles, the target user will receive an adjustment request requesting adjustment of the schedule of the first vehicle. Based on the schedule information, it is determined whether the schedule of the first vehicle can be adjusted so that the virtual target vehicle does not interfere with the first vehicle. It is configured in such a way Information provision system.

9. The information provision system according to claim 8, The aforementioned overhead image is displayed on the screen of the terminal operated by the target user. The display position of the first vehicle on the screen can be changed by the operation of the target user. The one or more processors are further configured to receive changes in the display position of the first vehicle on the screen as adjustment requests. Information provision system.

10. A method for providing information, which is performed by a computer and is applicable to automated valet parking in a parking lot, To acquire vehicle management information including at least one of the driving and parking records and schedules of each vehicle in the aforementioned parking lot, We accept requests for the target time from the target users of the target vehicles, Based on the aforementioned vehicle management information, an overhead image is generated that shows the positions of the target vehicle and other vehicles within the parking lot at the specified time, along with a map of the parking lot. To provide the aforementioned overhead image to the target user. including Information provision method.

Images