Vehicle information distribution device, vehicle information distribution method, and computer program for vehicle information distribution

The vehicle information distribution device addresses user anxiety during unmanned parking by transmitting real-time vehicle status and position information to users, thereby improving user convenience and trust in the parking system.

JP7666338B2Active Publication Date: 2025-04-22TOYOTA JIDOSHA KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022003227
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-01-12
Publication Date
2025-04-22
Estimated Expiration
2042-01-12

AI Technical Summary

Technical Problem

During unmanned parking, vehicle users may feel anxious about the situation of their vehicle moving unmanned, as they are not present in the parking area.

Method used

A vehicle information distribution device that generates a vehicle-related image indicating the situation of a vehicle moving unmanned in a target area based on camera images and transmits this information to a user's display terminal, providing real-time updates on the vehicle's position and status.

Benefits of technology

The solution effectively alleviates user anxiety by providing real-time information about the vehicle's status and position during unmanned parking, enhancing user convenience and trust in the parking system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007666338000001
    Figure 0007666338000001
  • Figure 0007666338000002
    Figure 0007666338000002
  • Figure 0007666338000003
    Figure 0007666338000003
Patent Text Reader

Abstract

To provide a user of an unmanned moving vehicle with information on the vehicle when unmanned parking of the vehicle is carried out.SOLUTION: A vehicle information distribution device comprises: an image processing unit that, based on a camera image taken in a predetermined target area where unmanned parking is carried out, generates a vehicle-related image for showing a situation of an unmanned moving vehicle in the target area; and an information transmission unit that transmits distribution information including the vehicle-related image to a display terminal which is visually recognized by a user of the vehicle.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a vehicle information distribution device, a vehicle information distribution method, and a computer program for vehicle information distribution. [Background technology]

[0002] Patent Document 1 describes a parking facility that performs unmanned parking for autonomous vehicles and non-autonomous vehicles. The autonomous vehicles move to the parking space by autonomous driving, and the non-autonomous vehicles are transported to the parking space by an automatic transport device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-204373 A Summary of the Invention [Problem to be solved by the invention]

[0004] When such unmanned parking is implemented, the vehicle is delivered in a specified entry / exit area, and the vehicle user does not enter the parking area. This relieves the vehicle user from the troublesome work involved in parking, but the vehicle user may feel uneasy about the situation of the vehicle moving without a driver.

[0005] Therefore, an object of the present invention is to provide a user of a vehicle with information about a vehicle that is moving without a driver when unmanned parking of the vehicle is performed. [Means for solving the problem]

[0006] The gist of the present disclosure is as follows.

[0007] (1) A vehicle information distribution device comprising: an image processing unit that generates vehicle-related images showing the status of vehicles moving unmanned in a specified target area where unmanned parking is performed, based on camera images taken in the target area; and an information transmission unit that transmits distribution information including the vehicle-related images to a display terminal viewed by a user of the vehicle.

[0008] (2) The vehicle information distribution device according to (1) above, wherein the display terminal is a mobile terminal of the user.

[0009] (3) The vehicle information distribution device according to (1) or (2) above, wherein the vehicle-related image is a video showing the status of the vehicle and whose playback speed is changed.

[0010] (4) The vehicle information distribution device according to any one of (1) to (3) above, wherein the information transmission unit transmits the distribution information to the display terminal when the movement of the vehicle is completed.

[0011] (5) The vehicle information distribution device according to any one of (1) to (4) above, wherein the camera image includes an exterior image of the vehicle.

[0012] (6) A vehicle information distribution device described in any one of (1) to (5) above, wherein the vehicle is transported in the target area by a vehicle transport device, and the camera image is an image taken by a camera installed in the vehicle transport device.

[0013] (7) A vehicle information distribution device as described in any one of (1) to (6) above, further comprising an abnormality diagnosis unit that performs abnormality diagnosis on the vehicle, the vehicle being transported in the target area by a vehicle transport device, and the abnormality diagnosis unit performing abnormality diagnosis on the vehicle based on an image of the bottom of the vehicle captured by a camera provided on the vehicle transport device.

[0014] (8) The vehicle information distribution device according to (7) above, wherein the abnormality diagnosis unit transmits a result of the abnormality diagnosis to a mobile terminal of a user of the vehicle when an abnormality is found in the vehicle.

[0015] (9) A vehicle information distribution device according to any one of (1) to (8) above, further comprising a location information acquisition unit that acquires location information of the vehicle, wherein the distribution information includes the location information of the vehicle.

[0016] (10) A vehicle information distribution device as described in any one of (1) to (9) above, further comprising a location information acquisition unit that acquires location information of the vehicle, the location information acquisition unit calculating an estimated time required for the vehicle to complete its movement based on the location information, and the distribution information including the estimated time required.

[0017] (11) The vehicle information distribution device described in (10) above, wherein the location information acquisition unit determines whether the movement of the vehicle for leaving the facility will be completed by the scheduled time based on the estimated required time, and the information transmission unit transmits the distribution information to the display terminal when it is determined that the movement of the vehicle for leaving the facility will not be completed by the scheduled time.

[0018] (12) A vehicle information distribution device as described in any one of (1) to (11) above, further comprising an abnormality detection unit that detects an abnormality regarding the movement of the vehicle, and the information transmission unit transmits the distribution information to the display terminal when an abnormality regarding the movement of the vehicle is detected.

[0019] (13) The vehicle information distribution device described above in (12), wherein the vehicle is transported in the target area by a vehicle transport device, and the abnormality detection unit detects an abnormality in the vehicle transport device as an abnormality related to the movement of the vehicle.

[0020] (14) A vehicle information distribution method executed by a computer, the vehicle information distribution method including: generating a vehicle-related image showing the status of a vehicle moving unmanned in a specified target area where unmanned parking is performed based on a camera image taken in the target area; and transmitting distribution information including the vehicle-related image to a display terminal viewable by a user of the vehicle.

[0021] (15) A computer program for vehicle information distribution, which causes a computer to generate vehicle-related images showing the status of unmanned vehicles moving in a specified target area where unmanned parking is performed, based on camera images taken in the target area, and transmit distribution information including the vehicle-related images to a display terminal viewed by a user of the vehicle. Effect of the Invention

[0022] According to the present invention, when unmanned parking of a vehicle is performed, information about the vehicle that is moving without a driver can be provided to the user of the vehicle. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a schematic configuration diagram of an automatic parking system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a situation in which unmanned parking is being carried out in a predetermined target area. [Diagram 3] FIG. 3 is a schematic configuration diagram of a vehicle information distribution system according to the first embodiment of the present invention. [Figure 4] FIG. 4 is a diagram illustrating a schematic configuration of the information distribution server. [Diagram 5] FIG. 5 is a functional block diagram of the processor of the information distribution server in the first embodiment. [Figure 6] FIG. 6 is a flowchart showing a control routine for camera image processing in the first embodiment. [Figure 7] FIG. 7 is a flowchart showing a control routine of the information transmission process in the first embodiment. [Figure 8] FIG. 8 is a schematic configuration diagram of an automatic parking system according to the second embodiment of the present invention. [Figure 9] FIG. 9 is a diagram showing an example of a situation in which unmanned parking is being carried out in a predetermined target area. [Figure 10] FIG. 10 is a diagram illustrating a vehicle transport device used in the third embodiment. [Figure 11] FIG. 11 is a functional block diagram of a processor of an information distribution server in the third embodiment. [Figure 12] FIG. 12 is a flowchart showing a control routine for the abnormality diagnosis process in the third embodiment. [Figure 13] FIG. 13 is a functional block diagram of a processor of an information distribution server in the fourth embodiment. [Figure 14] FIG. 14 is a flowchart showing a control routine of the position information acquisition process in the fourth embodiment. [Figure 15] FIG. 15 is a flowchart showing a control routine of the information transmission process in the fourth embodiment. [Figure 16] FIG. 16 is a functional block diagram of a processor of an information distribution server in the fifth embodiment. [Figure 17] FIG. 17 is a flowchart showing a control routine of the information transmission process in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, like components are designated by like reference numerals.

[0025] First Embodiment First, a first embodiment of the present invention will be described with reference to Figs. 1 to 7. Fig. 1 is a schematic configuration diagram of an automatic parking system 100 according to the first embodiment of the present invention. As shown in Fig. 1, the automatic parking system 100 includes a parking control server 10 and at least one vehicle 20, and realizes unmanned parking. The parking control server 10 is capable of communicating with the vehicle 20 via a wireless base station 30 such as a macrocell or a small cell, and a communication network 40 such as the Internet network or a carrier network.

[0026] The vehicle 20 is an autonomous vehicle in which all of the acceleration, steering, and deceleration (braking) of the vehicle 20 are performed automatically, and has known configurations for achieving autonomous driving (such as an on-board camera 21, a GNSS receiver, a drive motor, a brake actuator, and a steering motor). The vehicle 20 can travel unmanned, and performs unmanned parking in a specified target area according to instructions from the parking control server 10.

[0027] 2 is a diagram showing an example of a situation in which unmanned parking is implemented in a predetermined target area 500. The target area 500 is, for example, a parking lot of a facility such as an airport, a station, an amusement park, a hospital, a stadium, or a shopping center. The target area 500 has a plurality of boarding and alighting spaces 510 where users (passengers) of the vehicle 20 get on and off, and a plurality of parking spaces 520 where the vehicle 20 is parked. In the target area 500, the vehicle 20 moves unmanned to enter or leave the parking lot.

[0028] In this embodiment, four boarding and alighting spaces 510 are provided near the entrance of the target area, and one vehicle 20 is parked in each boarding and alighting space 510. When the vehicle 20 is entered, the user of the vehicle 20 gets off the vehicle 20 in the boarding and alighting space 510. On the other hand, when the vehicle 20 is taken out, the user of the vehicle 20 gets on the vehicle 20 in the boarding and alighting space 510. The boarding and alighting space 510 may be an open space or a space such as a garage that can be opened and closed. In addition, in the target area 500, a get-off space where the user of the vehicle 20 gets off the vehicle 20 to enter the vehicle 20 and a boarding space where the user of the vehicle 20 gets on the vehicle 20 to leave the vehicle may be provided separately.

[0029] In this embodiment, 30 parking spaces 520 are provided in an area in front of the boarding / disembarking space 510, and one vehicle 20 is parked in each parking space 520. When the vehicle 20 enters the parking lot, the vehicle 20 moves unmanned by autonomous driving from the boarding / disembarking space 510 to the parking space 520. On the other hand, when the vehicle 20 leaves the parking lot, the vehicle 20 moves unmanned by autonomous driving from the parking space 520 to the boarding / disembarking space 510.

[0030] The parking control server 10 is disposed in a parking management center 530 provided, for example, near the boarding and disembarking space 510. The parking control server 10 includes a communication interface, a storage device, a memory, a processor, etc., and manages unmanned parking in the target area 500. For example, when the vehicle 20 enters the parking lot, the parking control server 10 instructs the vehicle 20 on the parking space 520 in which the vehicle 20 should be parked, and when the vehicle 20 leaves the parking lot, the parking control server 10 instructs the vehicle 20 on the boarding and disembarking space 510 in which the vehicle 20 should be stopped.

[0031] When unmanned parking as described above is implemented, the vehicle 20 is handed over in the boarding and disembarking space 510, and the user of the vehicle 20 does not enter the parking area where the vehicle 20 moves unmanned. Therefore, it is not necessary to secure a space in the parking area for the user of the vehicle 20 to board and disembark, and many parking spaces 520 can be provided within a given range. In addition, the user of the vehicle 20 can be freed from troublesome tasks associated with parking, such as searching for the parking space 520 and operating the vehicle for parking.

[0032] On the other hand, the user of the vehicle 20 who gets out of the vehicle 20 may feel uneasy about the status of the vehicle 20 in the target area 500. For this reason, in this embodiment, as described in detail below, the status of the unmanned vehicle 20 moving in the target area 500 is monitored, and information indicating the status of the vehicle 20 is delivered to the user of the vehicle 20 as necessary.

[0033] 3 is a schematic configuration diagram of a vehicle information distribution system 200 according to a first embodiment of the present invention. The vehicle information distribution system 200 includes an information distribution server 1 and at least one camera 2. The information distribution server 1 is capable of communicating with the camera 2 and the vehicle 20 via a wireless base station 30 such as a macrocell or a small cell, and a communication network 40 such as the Internet network or a carrier network.

[0034] The camera 2 captures an image of the target area 500 to generate an image of the target area 500. For example, the camera 2 is a fixed camera arranged in the target area 500. In the example of FIG. 2, multiple (four) fixed cameras 540 are arranged at the four corners of the target area 500 and cooperate to capture the entire target area 500. The number and positions of the fixed cameras 540 are set so that no blind spots are generated in the target area 500. The fixed cameras are also referred to as infrastructure cameras.

[0035] The information distribution server 1 uses the camera 2 to distribute information about the vehicle 20 in the target area 500 to the user of the vehicle 20. The information distribution server 1 is an example of a vehicle information distribution device. As shown in Fig. 2, the information distribution server 1 is disposed in, for example, a parking management center 530. Note that the information distribution server 1 and the parking control server 10 may be the same server.

[0036] 4 is a diagram showing a schematic configuration of the information distribution server 1. The information distribution server 1 includes a communication interface 11, a storage device 12, a memory 13, and a processor 14. The communication interface 11, the storage device 12, and the memory 13 are connected to the processor 14 via signal lines. The information distribution server 1 may further include input devices such as a keyboard and a mouse, and an output device such as a display. The information distribution server 1 may also be composed of multiple computers.

[0037] The communication interface 11 has an interface circuit for connecting the information distribution server 1 to the communication network 40. The information distribution server 1 communicates with the camera 2 and the vehicle 20 via the communication network 40. The communication interface 11 is an example of a communication unit of the information distribution server 1.

[0038] The storage device 12 includes, for example, a hard disk drive (HDD), a solid state drive (SDD), or an optical recording medium and an access device therefor. The storage device 12 stores various data, and for example, stores computer programs for the processor 14 to execute various processes. The storage device 12 is an example of a storage unit of the information distribution server 1.

[0039] The memory 13 includes a non-volatile semiconductor memory (e.g., RAM). The memory 13 temporarily stores various data and the like used when various processes are executed by the processor 14. The memory 13 is another example of a storage unit of the information distribution server 1.

[0040] The processor 14 has one or more CPUs and their peripheral circuits, and executes various processes. The processor 14 may further include other arithmetic circuits, such as a logic arithmetic unit, a numerical arithmetic unit, or a graphic processing unit.

[0041] 5 is a functional block diagram of the processor 14 of the information distribution server 1 in the first embodiment. In this embodiment, the processor 14 has an image processing unit 15 and an information transmission unit 16. The image processing unit 15 and the information transmission unit 16 are functional modules that are realized by the processor 14 of the information distribution server 1 executing a computer program stored in the memory 13 of the information distribution server 1. Note that these functional modules may each be realized by a dedicated arithmetic circuit provided in the processor 14.

[0042] The image processing unit 15 processes the camera images taken in the target area 500. Specifically, the image processing unit 15 generates a vehicle-related image showing the status of the vehicle 20 moving unmanned in the target area 500, based on the camera images taken in the target area 500.

[0043] The information transmission unit 16 transmits the distribution information including the vehicle-related image to a display terminal viewed by the user of the vehicle 20. In this embodiment, as shown in Fig. 3, the information distribution server 1 can communicate with a mobile terminal 3 of the user of the vehicle 20 via a wireless base station 30 and a communication network 40, and the information transmission unit 16 transmits the distribution information to the mobile terminal 3. The mobile terminal 3 is, for example, a smartphone, a tablet terminal, a watch-type terminal (smart watch), etc.

[0044] As described above, by transmitting distribution information including vehicle-related images showing the status of vehicle 20 moving unmanned to a display terminal, information about vehicle 20 can be provided to the user of vehicle 20, thereby reducing the user's anxiety regarding unmanned parking.

[0045] Particularly, in this embodiment, when the movement of the vehicle 20 is completed, the information transmission unit 16 transmits the distribution information to the mobile terminal 3 of the user of the vehicle 20. This eliminates the need for the user of the vehicle 20 to frequently check the status of the vehicle 20, thereby improving user convenience.

[0046] The control flow when distribution information is transmitted to the display terminal will be described in detail below with reference to Fig. 6 and Fig. 7. Fig. 6 is a flowchart showing a control routine for camera image processing in the first embodiment. This control routine is executed by the processor 14 of the information distribution server 1 according to a computer program stored in the memory 13 of the information distribution server 1.

[0047] First, in step S101, the image processing unit 15 determines whether or not the vehicle 20 is moving unattended in the target area 500, that is, whether or not the vehicle 20 is entering or leaving the target area 500. For example, the image processing unit 15 makes this determination based on the position information of the vehicle 20 transmitted from the vehicle 20 to the information distribution server 1 (for example, the output of a GNSS receiver provided in the vehicle 20). Note that the image processing unit 15 may also make this determination based on information from the parking control server 10. If it is determined in step S101 that the vehicle 20 is not moving unattended, this control routine ends. On the other hand, if it is determined that the vehicle 20 is moving unattended, this control routine proceeds to step S102.

[0048] In step S102, the image processing unit 15 acquires camera images captured in the target area 500. For example, the image processing unit 15 acquires camera images captured by a plurality of fixed cameras 540 arranged in the target area 500. In this case, the camera images include exterior images of the vehicle 20, and the state of the vehicle 20 is directly represented by the camera images.

[0049] Next, in step S103, the image processing unit 15 generates a vehicle-related image showing the situation of the vehicle 20 moving unmanned in the target area 500 based on the camera image. For example, the image processing unit 15 generates the vehicle-related image by extracting an image showing the vehicle 20 moving unmanned from the camera image using a known detection method such as background subtraction, frame-to-frame subtraction, or machine learning. The vehicle-related image generated by the image processing unit 15 is stored in the storage device 12 or memory 13 of the information distribution server 1 together with identification information of the vehicle 20 (e.g., license plate number). After step S103, this control routine ends.

[0050] In step S102, the image processing unit 15 may acquire a camera image taken by the on-board camera 21 provided in the vehicle 20 as the camera image taken in the target area 500. In this case, the image of the surroundings of the vehicle 20 taken by the on-board camera 21 is stored as it is in the storage device 12 or memory 13 of the information distribution server 1 as a vehicle-related image.

[0051] 7 is a flowchart showing a control routine for information transmission processing in the first embodiment. This control routine is executed by the processor 14 of the information distribution server 1 in accordance with a computer program stored in the memory 13 of the information distribution server 1.

[0052] First, in step S201, the information transmission unit 16 determines whether or not the user of the vehicle 20 has requested transmission of vehicle information. For example, when the user of the vehicle 20 wishes to obtain vehicle information, the user operates the mobile terminal 3 to request transmission of vehicle information. As a result, an information request notice including identification information (e.g., license plate number) of the vehicle 20 registered in advance by the user of the vehicle 20 is transmitted from the mobile terminal 3 to the information distribution server 1, and the information transmission unit 16 determines that transmission of vehicle information about the vehicle 20 corresponding to the identification information has been requested. If it is determined in step S201 that transmission of vehicle information has been requested, this control routine proceeds to step S203.

[0053] In step S203, the information transmitting unit 16 transmits the distribution information to the mobile terminal 3 of the user of the vehicle 20. For example, the information transmitting unit 16 transmits vehicle-related images showing the current status of the vehicle 20 as the distribution information to the mobile terminal 3. Note that the information transmitting unit 16 may transmit vehicle-related images (e.g., videos) in a time series showing the status of the vehicle 20 from when the vehicle 20 started moving to the present as the distribution information to the mobile terminal 3. After step S203, this control routine ends.

[0054] On the other hand, if it is determined in step S201 that transmission of vehicle information has not been requested, this control routine proceeds to step S202. In step S202, the information transmission unit 16 determines whether or not the movement of the vehicle 20 for entering or leaving the parking lot has been completed. For example, the information transmission unit 16 makes this determination based on the position information of the vehicle 20 transmitted from the vehicle 20 to the information distribution server 1 (for example, the output of a GNSS receiver provided in the vehicle 20). Note that the information transmission unit 16 may make this determination based on information from the parking control server 10 or a camera image taken in the target area 500.

[0055] If it is determined in step S202 that the movement of the vehicle 20 has not been completed, this control routine ends. On the other hand, if it is determined in step S202 that the movement of the vehicle 20 has been completed, this control routine proceeds to step S203.

[0056] In step S203, the information transmitting unit 16 transmits distribution information to the mobile terminal 3 of the user of the vehicle 20 that has completed its movement. The correspondence between the vehicle 20 and the mobile terminal 3, i.e., information linking the vehicle 20 and the mobile terminal 3, is stored in advance in, for example, the storage device 12 or the memory 13 of the information distribution server 1.

[0057] In this case, in step S203, the information transmission unit 16 transmits, as the distribution information, to the mobile terminal 3, for example, vehicle-related images (e.g., video) in a time series showing the state of the vehicle 20 from when the movement of the vehicle 20 starts to when the movement of the vehicle 20 is completed. When the movement of the vehicle 20 for entering the parking lot is completed, the information transmission unit 16 may transmit, as the distribution information, a vehicle-related image showing the state of the vehicle 20 when the vehicle 20 is parked in the parking space 520 to the mobile terminal 3. When the movement of the vehicle 20 for leaving the parking lot is completed, the information transmission unit 16 may transmit, as the distribution information, a vehicle-related image showing the state of the vehicle 20 when the vehicle 20 is parked in the boarding / alighting space 510 or the boarding space. After step S203, this control routine ends.

[0058] In addition, in step S203, when a video showing the moving status of the vehicle 20 is transmitted to the mobile terminal 3, the playback speed of the transmitted video may be made faster than the actual speed. That is, the information transmitting unit 16 may transmit a video showing the moving status of the vehicle 20 and played at a faster speed than the actual speed to the mobile terminal 3 as a vehicle-related image. In this case, the playback speed of the video is set to, for example, 1.2 times to 3 times. This allows the user of the vehicle 20 to quickly check the moving status of the vehicle 20.

[0059] Second Embodiment The vehicle information distribution device according to the second embodiment is basically the same as the vehicle information distribution device according to the first embodiment, except for the points described below. Therefore, the second embodiment of the present invention will be described below, focusing on the differences from the first embodiment.

[0060] Fig. 8 is a schematic configuration diagram of an automatic parking system 100' according to a second embodiment of the present invention. As shown in Fig. 1, the automatic parking system 100' includes a parking control server 10' and at least one vehicle transport device 50, and realizes unmanned parking. The parking control server 10 can communicate with the vehicle transport device 50 via a wireless base station 30 such as a macrocell or small cell, and a communication network 40 such as the Internet network or a carrier network.

[0061] The vehicle transport device 50 is a self-propelled vehicle transport device and has a known configuration for transporting the vehicle 20' by autonomous driving (for example, see U.S. Pat. No. 10,590,669, JP 2018-204373 A, etc.). For example, the vehicle transport device 50 enters the space between the bottom of the vehicle 20' and the road surface from the front or rear of the vehicle 20' and supports and transports the vehicle 20' by lifting up the four tires of the vehicle 20'.

[0062] The vehicle transport device 50 is provided with a camera 51, which photographs the vehicle 20' as well as the surroundings of the vehicle 20' when the vehicle transport device 50 transports the vehicle 20'. That is, the camera image taken by the camera 51 includes an exterior image of the vehicle 20', and the state of the vehicle 20' is directly represented by the camera image. The camera 51 is disposed on the vehicle transport device 50 such that the entire vehicle 20' fits within the angle of view in the vehicle width direction, for example.

[0063] The vehicle transport device 50 performs unmanned parking in a predetermined target area according to instructions from the parking control server 10'. Fig. 9 is a diagram showing an example of a situation in which unmanned parking is performed in a predetermined target area 500'. The target area 500' is similar to the target area 500 shown in Fig. 2, and has multiple boarding and alighting spaces 510' where users (passengers) of the vehicle 20' board and alight, and multiple parking spaces 520' where the vehicle 20' is parked.

[0064] In the target area 500', the vehicle transport device 50 transports the vehicle 20' for entering or leaving the vehicle 20'. Specifically, the vehicle transport device 50 transports the vehicle 20' from the boarding / alighting space 510' to the parking space 520' when the vehicle 20' is entered, and transports the vehicle 20' from the parking space 520' to the boarding / alighting space 510' when the vehicle 20' is removed. Therefore, even if the vehicle 20' is a non-automatic driving compatible vehicle (manually driven vehicle) that does not have an automatic driving function, the vehicle 20' can move unmanned for entering or leaving the vehicle, thereby realizing unmanned parking. In addition, in the target area 500', a disembarking space where a user of the vehicle 20' disembarks from the vehicle 20' for entering the vehicle and a boarding space where a user of the vehicle 20' gets on the vehicle 20' for leaving the vehicle may be provided separately.

[0065] The parking control server 10' is disposed in, for example, a parking management center 530' provided near the boarding / disembarking space 510'. The parking control server 10' includes a communication interface, a storage device, a memory, a processor, and the like, and manages unmanned parking in the target area 500'. For example, when the vehicle 20' enters or leaves the parking lot, the parking control server 10' selects a vehicle transport device 50 that transports the vehicle 20', and transmits a vehicle transport instruction to the vehicle transport device 50. The vehicle transport instruction includes, for example, the current position of the vehicle 20' to be transported (e.g., the identification number of the boarding / disembarking space 510' or the parking space 520'), information on the transport destination (e.g., the identification number of the parking space 520' or the boarding / disembarking space 510'), and the like.

[0066] Even when the vehicle 20' is transported by the vehicle transporter 50, the user of the vehicle 20' may feel uneasy about the situation of the vehicle 20' in the target area 500', as in the case when the vehicle 20 is parked by autonomous driving. For this reason, also in the second embodiment, the information distribution server 1 functioning as a vehicle information distribution device distributes information about the vehicle 20' in the target area 500' to the user of the vehicle 20'.

[0067] That is, the image processing unit 15 of the information distribution server 1 generates a vehicle-related image showing the status of the vehicle 20' moving unmanned in the target area 500' based on a camera image taken in the target area 500'. Then, the information transmitting unit 16 of the information distribution server 1 transmits the distribution information including the vehicle-related image to a display terminal (e.g., the user's mobile terminal 3) visually recognized by the user of the vehicle 20'.

[0068] In the second embodiment, similarly to the first embodiment, the control routine of the camera image processing in FIG. 6 and the control routine of the information transmission processing in FIG. 7 are executed. At this time, in step S102 in FIG. 6, an image taken by the camera 51 provided in the vehicle transport device 50 is acquired as a camera image taken in the target area 500, and in step S103, this image is stored in the storage device 12 or memory 13 of the information distribution server 1 as a vehicle-related image. In addition, in step S203 in FIG. 7, the image taken by the camera 51 is transmitted to the mobile terminal 3 of the user of the vehicle 20' as distribution information. Therefore, in the second embodiment, a realistic image of the vehicle 20' taken near the vehicle 20' by the camera 51 of the vehicle transport device 50 can be provided to the user of the vehicle 20'.

[0069] <Third embodiment> The vehicle information distribution device according to the third embodiment is basically the same as the vehicle information distribution device according to the second embodiment, except for the points described below. Therefore, the third embodiment of the present invention will be described below, focusing on the differences from the first embodiment.

[0070] In the third embodiment, similarly to the second embodiment, the vehicle transporting device transports the vehicle, thereby realizing unmanned parking of the vehicle. Fig. 10 is a diagram showing a vehicle transporting device 50' used in the third embodiment.

[0071] In the third embodiment, as shown in Fig. 10, a vehicle transporting device 50' is provided with two cameras (a first camera 51' and a second camera 52). The first camera 51' is similar to the camera 51 shown in Fig. 8, and captures the vehicle 20' as well as the surroundings of the vehicle 20' when the vehicle transporting device 50' transports the vehicle 20'. On the other hand, the second camera 52 captures the bottom of the vehicle 20' when the vehicle transporting device 50' enters the space between the bottom of the vehicle 20' and the road surface.

[0072] 11 is a functional block diagram of the processor 14 of the information distribution server 1 in the third embodiment. In the third embodiment, the processor 14 has an abnormality diagnosis unit 17 in addition to the image processing unit 15 and the information transmission unit 16. The image processing unit 15, the information transmission unit 16, and the abnormality diagnosis unit 17 are functional modules that are realized by the processor 14 of the information distribution server 1 executing a computer program stored in the memory 13 of the information distribution server 1. Note that each of these functional modules may be realized by a dedicated arithmetic circuit provided in the processor 14.

[0073] The abnormality diagnosis unit 17 performs abnormality diagnosis on the vehicle 20' supported by the vehicle transport device 50' based on the bottom image of the vehicle 20' captured by the second camera 52. This makes it possible to easily perform abnormality diagnosis on the bottom of the vehicle 20', which is difficult to see, when the vehicle 20' is unmannedly parked, and ultimately to provide additional services to the user of the vehicle 20'.

[0074] Furthermore, when an abnormality is found in the vehicle 20', the abnormality diagnosis unit 17 transmits the result of the abnormality diagnosis to the mobile terminal 3 of the user of the vehicle 20'. In this way, when an abnormality occurs in the bottom of the vehicle 20', the user of the vehicle 20' can be made aware of the abnormality and can be prompted to inspect the vehicle, etc. Abnormalities in the bottom (undercarriage) of the vehicle 20' include, for example, rust, corrosion or damage to parts, oil leakage, etc.

[0075] In the third embodiment, in addition to the control routines for the camera image processing in Fig. 6 and the information transmission processing in Fig. 7, a control routine for an abnormality diagnosis processing in Fig. 12 is executed. Fig. 12 is a flowchart showing the control routine for the abnormality diagnosis processing in the third embodiment. This control routine is executed by the processor 14 of the information distribution server 1 in accordance with a computer program stored in the memory 13 of the information distribution server 1.

[0076] First, in step S301, the abnormality diagnosis unit 17 determines whether or not a camera image captured by the second camera 52 has been received from the vehicle transport device 50'. For example, when starting the transport of the vehicle 20' for entry into the boarding / alighting space 510', the vehicle transport device 50' captures an image of the bottom of the vehicle 20' by the second camera 52 and transmits the camera image captured by the second camera 52 to the information distribution server 1. Note that, when starting the transport of the vehicle 20' for exit from the parking space 520', the vehicle transport device 50' may also capture an image of the bottom of the vehicle 20' by the second camera 52 and transmit the camera image captured by the second camera 52 to the information distribution server 1.

[0077] If it is determined in step S301 that a camera image has not been received, this control routine ends. On the other hand, if it is determined in step S301 that a camera image has been received, this control routine proceeds to step S302.

[0078] In step S302, the abnormality diagnosis unit 17 performs an abnormality diagnosis of the vehicle 20' based on the camera image captured by the second camera 52. For example, the abnormality diagnosis unit 17 performs an abnormality diagnosis of the vehicle 20' using a classifier that has been trained in advance to output the presence or absence of an abnormality in the vehicle 20' from the camera image. Examples of such a classifier include machine learning models such as a neural network, a support vector machine, and a random forest.

[0079] Next, in step S303, the abnormality diagnosis unit 17 determines whether or not an abnormality has been found in the vehicle 20'. If it is determined that no abnormality has been found in the vehicle 20', this control routine ends. On the other hand, if it is determined that an abnormality has been found in the vehicle 20', this control routine proceeds to step S304.

[0080] In step S304, the abnormality diagnoser 17 transmits the result of the abnormality diagnosis to the portable terminal 3 of the user of the vehicle 20', and notifies the user of the abnormality of the vehicle 20' via the portable terminal 3. After step S304, this control routine ends.

[0081] <Fourth embodiment> The vehicle information distribution device according to the fourth embodiment is basically the same as the vehicle information distribution device according to the first embodiment, except for the points described below. Therefore, the fourth embodiment of the present invention will be described below, focusing on the differences from the first embodiment.

[0082] 13 is a functional block diagram of the processor 14 of the information distribution server 1 in the fourth embodiment. In the fourth embodiment, the processor 14 has a location information acquisition unit 18 in addition to the image processing unit 15 and the information transmission unit 16. The image processing unit 15, the information transmission unit 16, and the location information acquisition unit 18 are functional modules that are realized by the processor 14 of the information distribution server 1 executing a computer program stored in the memory 13 of the information distribution server 1. Note that each of these functional modules may be realized by a dedicated arithmetic circuit provided in the processor 14.

[0083] The position information acquisition unit 18 acquires position information of the vehicle 20 moving unmanned in the target area 500, and the information transmission unit 16 transmits distribution information including the position information of the vehicle 20 in addition to the vehicle-related image to the mobile terminal 3 of the user of the vehicle 20. This makes it possible to inform the user of the position of the vehicle 20 in the target area 500, further enhancing the user's sense of security.

[0084] Furthermore, the location information acquisition unit 18 calculates an estimated time required for the movement of the vehicle 20 to be completed based on the location information of the vehicle 20, and the information transmission unit 16 transmits distribution information including the estimated time required in addition to the vehicle-related image to the mobile terminal 3 of the user of the vehicle 20. This enables the user of the vehicle 20 to more accurately grasp the movement status of the vehicle 20, further improving convenience for the user.

[0085] Furthermore, the location information acquisition unit 18 determines whether the movement of the vehicle 20 to leave the depot will be completed by the scheduled time based on the estimated required time, and when it is determined that the movement of the vehicle 20 to leave the depot will not be completed by the scheduled time, the information transmission unit 16 transmits distribution information including the estimated required time in addition to the vehicle-related image to the mobile terminal 3 of the user of the vehicle 20. This makes it possible to notify the user of the vehicle 20 in advance that the movement of the vehicle 20 to leave the depot will not be completed by the scheduled time, and reduces the user's anxiety due to the non-arrival of the vehicle 20.

[0086] In the fourth embodiment, in addition to the camera image processing of Fig. 6 and the control routine of the information transmission processing of Fig. 15 described later, a control routine of the location information acquisition processing of Fig. 14 is executed. Fig. 14 is a flowchart showing the control routine of the location information acquisition processing in the fourth embodiment. This control routine is executed by the processor 14 of the information distribution server 1 in accordance with a computer program stored in the memory 13 of the information distribution server 1.

[0087] First, in step S401, the location information acquisition unit 18 determines whether or not the vehicle 20 is moving without a driver in the target area 500, that is, whether or not the vehicle 20 is entering or leaving the target area 500. This determination is performed in the same manner as in step S101 in Fig. 6, and if it is determined that the vehicle 20 is moving without a driver, this control routine proceeds to step S402.

[0088] In step S402, the position information acquisition unit 18 acquires position information of the vehicle 20 (for example, the output of a GNSS receiver provided in the vehicle 20).

[0089] Next, in step S403, the position information acquisition unit 18 calculates an estimated time required for the movement of the vehicle 20 to be completed, based on the position information of the vehicle 20. For example, the position information acquisition unit 18 calculates the estimated time required by dividing the travel distance from the current position of the vehicle 20 to the movement completion point of the vehicle 20 (the parking space 520 or the boarding / alighting space 510) by a predetermined travel speed.

[0090] Next, in step S404, the position information acquisition unit 18 determines whether or not the vehicle 20 is moving to leave the warehouse. If it is determined that the vehicle 20 is moving to leave the warehouse, this control routine proceeds to step S405.

[0091] In step S405, the position information acquisition unit 18 determines whether or not the movement of the vehicle 20 for leaving the parking lot will be completed by the scheduled time based on the estimated time required for the movement of the vehicle 20 to be completed. The scheduled time is set, for example, by the user of the vehicle 20 or the parking control server 10 when the vehicle 20 is entered into the parking lot. If it is determined that the movement of the vehicle 20 will not be completed by the scheduled time, this control routine proceeds to step S406.

[0092] In step S406, the position information acquisition unit 18 sets the flag F to 1. After step S406, this control routine ends.

[0093] On the other hand, if the determination in step S401 or S404 is negative or the determination in step S405 is positive, the control routine proceeds to step S407. In step S407, the position information acquisition unit 18 resets the flag F to zero. After step S407, this control routine ends.

[0094] 15 is a flowchart showing a control routine of information transmission processing in the fourth embodiment. This control routine is executed by the processor 14 of the information distribution server 1 in accordance with a computer program stored in the memory 13 of the information distribution server 1.

[0095] First, in step S501, the information transmission unit 16 determines whether or not the flag F is set to 1. If it is determined that the flag F is set to 1, this control routine proceeds to step S504.

[0096] In step S504, the information transmission unit 16 transmits the distribution information to the mobile terminal 3 of the user of the vehicle 20. For example, the information transmission unit 16 transmits, as the distribution information, a vehicle-related image showing the current status of the vehicle 20, the position information of the vehicle 20, and an estimated time required for the movement of the vehicle 20 to be completed to the mobile terminal 3 of the user of the vehicle 20. When the position information of the vehicle 20 is transmitted, for example, the current position of the vehicle 20 on the map is displayed together with a map of the target area 500. Note that the position information of the vehicle 20 may be omitted from the distribution information. After step S504, this control routine ends.

[0097] On the other hand, if it is determined in step S501 that the flag F is set to zero, this control routine proceeds to step S502. In this case, steps S502 to S504 are executed similarly to steps S201 to S203 in Fig. 7. If the determination in step S502 is positive, at least one of position information of the vehicle 20 and an estimated time required for the movement of the vehicle 20 to be completed may be transmitted as the distribution information in addition to the vehicle-related image. Also, if the determination in step S503 is positive, the position information of the vehicle 20 may be transmitted as the distribution information in addition to the vehicle-related image.

[0098] <Fifth embodiment> The vehicle information distribution device according to the fifth embodiment is basically the same as the vehicle information distribution device according to the first embodiment, except for the points described below. Therefore, the fifth embodiment of the present invention will be described below, focusing on the differences from the first embodiment.

[0099] 16 is a functional block diagram of the processor 14 of the information distribution server 1 in the fifth embodiment. In the fourth embodiment, the processor 14 has an anomaly detection unit 19 in addition to the image processing unit 15 and the information transmission unit 16. The image processing unit 15, the information transmission unit 16, and the anomaly detection unit 19 are functional modules that are realized by the processor 14 of the information distribution server 1 executing a computer program stored in the memory 13 of the information distribution server 1. Note that these functional modules may each be realized by a dedicated arithmetic circuit provided in the processor 14.

[0100] The abnormality detection unit 19 detects an abnormality regarding the movement of the vehicle 20, and the information transmission unit 16 transmits distribution information to the mobile terminal 3 of the user of the vehicle 20 when an abnormality regarding the movement of the vehicle 20 is detected. This makes it possible to quickly inform the user of the vehicle 20 that an abnormality has occurred in the movement of the vehicle 20.

[0101] For example, the abnormality detection unit 19 detects an abnormality regarding the movement of the vehicle 20 based on a camera image captured in the target area 500. As a specific example, when the abnormality detection unit 19 detects based on the camera image that the vehicle 20 has not moved for a predetermined time or more in a place other than the boarding / alighting space 510 and the parking space 520, the abnormality detection unit 19 determines that an abnormality has occurred in the movement of the vehicle 20. Furthermore, when the abnormality detection unit 19 detects based on the camera image that the vehicle 20 has come into contact with an obstacle (e.g., another vehicle, a fallen object, etc.), the abnormality detection unit 19 determines that an abnormality has occurred in the movement of the vehicle 20. Note that the abnormality detection unit 19 may detect an abnormality regarding the movement of the vehicle 20 based on information (e.g., position information of the vehicle 20, etc.) transmitted from the vehicle 20 to the information distribution server 1.

[0102] 17 is a flowchart showing a control routine of information transmission processing in the fifth embodiment. This control routine is executed by the processor 14 of the information distribution server 1 in accordance with a computer program stored in the memory 13 of the information distribution server 1.

[0103] First, in step S601, the information transmission unit 16 determines whether or not an abnormality related to the movement of the vehicle 20 has been detected by the abnormality detection unit 19. If it is determined that an abnormality related to the movement of the vehicle 20 has been detected, this control routine proceeds to step S604. In step S604, the information transmission unit 16 transmits distribution information to the mobile terminal 3 of the user of the vehicle 20. For example, the information transmission unit 16 transmits a vehicle-related image showing the current situation of the vehicle 20 to the mobile terminal 3 of the user of the vehicle 20 as the distribution information. Note that the information transmission unit 16 may transmit the content of the abnormality of the vehicle 20 (stopping due to a malfunction, a contact accident, etc.) in addition to the vehicle-related image as the distribution information. After step S604, this control routine ends.

[0104] On the other hand, if it is determined in step S601 that no abnormality regarding the movement of the vehicle 20 has been detected, this control routine proceeds to step S602. In this case, steps S602 to S604 are executed in the same manner as steps S201 to S203 in FIG.

[0105] <Other embodiments> Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the claims.

[0106] For example, the information transmission unit 16 may transmit distribution information to an output device (such as a display or digital signage) installed in a predetermined location (such as near the boarding and disembarking spaces 510, 510', a predetermined facility adjacent to the target area 500', etc.) instead of the mobile terminal 3 of the user of the vehicle 20, 20'. Furthermore, unmanned parking of both autonomously driven vehicles and non-autonomous driving compatible vehicles may be implemented in the target areas 500, 500'.

[0107] In the second embodiment, the camera images captured in the target area 500' may be acquired by a plurality of fixed cameras 540' (see FIG. 9) arranged in the target area 500'. In the second embodiment, the camera 51 may be provided in the vehicle transport device 50 so as to capture only the surroundings of the vehicle 20'.

[0108] Furthermore, a computer program that causes a computer to realize the functions of each unit of the processor 14 of the information distribution server 1 may be provided in a form stored in a computer-readable recording medium. The computer-readable recording medium is, for example, a magnetic recording medium, an optical recording medium, or a semiconductor memory.

[0109] In addition, the above-mentioned embodiments can be implemented in any combination. For example, when the second embodiment is combined with the fourth embodiment, in the fourth embodiment, the vehicle 20' is transported by the vehicle transporter 50. In this case, in step S402 of FIG. 14, for example, the position information acquisition unit 18 acquires the output of a GNSS receiver provided in the vehicle transporter 50 from the vehicle transporter 50 as the position information of the vehicle 20.

[0110] Furthermore, in the case where the second embodiment is combined with the fifth embodiment, in the fifth embodiment, the abnormality detection unit 19 detects an abnormality in the vehicle transport device 50 as an abnormality related to the movement of the vehicle 20'. For example, based on a camera image taken in the target area 500 or information transmitted from the vehicle transport device 50 to the information distribution server 1, the abnormality detection unit 19 determines that an abnormality has occurred in the movement of the vehicle 20' when it detects that the vehicle transport device 50 has come into contact with an obstacle (e.g., another vehicle transport device, a fallen object, etc.).

[0111] Furthermore, when the third embodiment is combined with the fourth or fifth embodiment, in the fourth or fifth embodiment, the vehicle 20' is transported by the vehicle transport device 50, and the control routine for the abnormality diagnosis processing of FIG. 12 is executed. [Explanation of symbols]

[0112] 1 Information distribution server 3. Mobile devices 14 processors 15 Image processing section 16 Information transmission section 20, 20' vehicle 500, 500' Target Area

Claims

1. an image processing unit that generates a vehicle-related image showing a status of a vehicle being transported by a vehicle transport device in a predetermined target area where unmanned parking is performed, based on a camera image taken in the target area; an information transmission unit that transmits distribution information including the vehicle-related image to a display terminal viewed by a user of the vehicle; an abnormality detection unit that detects an abnormality related to the movement of the vehicle; Equipped with the abnormality detection unit determines that an abnormality has occurred in the movement of the vehicle when it is detected that the vehicle transporter has come into contact with an obstacle; The vehicle information distribution device, wherein the information transmission unit transmits the distribution information to the display terminal when an abnormality regarding movement of the vehicle is detected.

2. 2. The vehicle information distribution device according to claim 1, wherein the display terminal is a mobile terminal of the user.

3. 3. The vehicle information distribution device according to claim 1, wherein the vehicle-related image is a moving image showing a moving state of the vehicle and reproduced at a speed faster than an actual speed.

4. The vehicle information distribution device according to claim 1 , wherein the information transmitting unit transmits the distribution information to the display terminal when the movement of the vehicle is completed.

5. The vehicle information distribution device according to claim 1 , wherein the camera image includes an exterior image of the vehicle.

6. the vehicle is transported in the target area by a vehicle transport device; The vehicle information distribution device according to claim 1 , wherein the camera image is an image taken by a camera provided in the vehicle transport device.

7. An abnormality diagnosis unit that performs an abnormality diagnosis for the vehicle is further provided, the vehicle is transported in the target area by a vehicle transport device; The vehicle information distribution device according to claim 1 , wherein the abnormality diagnosing unit performs abnormality diagnosis of the vehicle based on an image of a bottom of the vehicle taken by a camera provided in the vehicle transport device.

8. 8. The vehicle information distribution device according to claim 7, wherein the abnormality diagnosis unit transmits a result of the abnormality diagnosis to a mobile terminal of a user of the vehicle when an abnormality is found in the vehicle.

9. A location information acquisition unit that acquires location information of the vehicle is further provided. The vehicle information distribution device according to claim 1 , wherein the distribution information includes position information of the vehicle.

10. A location information acquisition unit that acquires location information of the vehicle is further provided. The location information acquisition unit calculates an estimated required time until the movement of the vehicle is completed based on the location information, The vehicle information distribution device according to claim 1 , wherein the distribution information includes the estimated required time.

11. The location information acquisition unit determines whether or not the movement of the vehicle for leaving the garage will be completed by a scheduled time based on the estimated required time, The vehicle information distribution device according to claim 10 , wherein the information transmitting unit transmits the distribution information to the display terminal when it is determined that the movement of the vehicle for leaving the garage will not be completed by a scheduled time.

12. 1. A vehicle information distribution method executed by a computer, comprising: generating a vehicle-related image showing a status of a vehicle being transported by a vehicle transport device in a predetermined target area where unmanned parking is performed, based on a camera image taken in the target area; transmitting distribution information including the vehicle-related image to a display terminal viewed by a user of the vehicle; determining that an abnormality has occurred in the movement of the vehicle when it is detected that the vehicle transport device has come into contact with an obstacle; transmitting the distribution information to the display terminal when an abnormality regarding the movement of the vehicle is detected; A vehicle information distribution method comprising:

13. generating a vehicle-related image showing a status of a vehicle being transported by a vehicle transport device in a predetermined target area where unmanned parking is performed, based on a camera image taken in the target area; transmitting distribution information including the vehicle-related image to a display terminal viewed by a user of the vehicle; determining that an abnormality has occurred in the movement of the vehicle when it is detected that the vehicle transport device has come into contact with an obstacle; transmitting the distribution information to the display terminal when an abnormality regarding the movement of the vehicle is detected; A computer program for vehicle information distribution, which causes a computer to execute the above.

Citation Information

Patent Citations

  • Method and apparatus for monitoring automatic parking of vehicles

    JP2017535991A

  • Truck control system

    JP2018203468A

  • Parking facility available for various type cars

    JP2018204373A

  • Vehicle transport device

    JP2020138617A

  • Vehicle control device, vehicle control method, and program

    JP2020144698A