Navigation system and navigation method
The navigation system uses vehicle-mounted cameras to detect and guide to parking positions, addressing the high cost of central database-based systems by providing low-cost route guidance to parking locations.
Patent Information
- Application Number
- JP2020119400
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-07-10
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2040-07-10
AI Technical Summary
Existing navigation systems requiring a central device to collect and construct a database of parking information are costly to implement.
A navigation system that utilizes vehicle-mounted cameras to detect parking positions near a destination, guiding a route to these positions using an image acquisition unit, route guide unit, and destination change unit, allowing for low-cost route guidance to parking locations.
Enables low-cost route guidance to available parking positions near destinations by using vehicle-mounted cameras to detect and change destinations to parking locations.
Smart Images

Figure 0007585636000001 
Figure 0007585636000002 
Figure 0007585636000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a navigation system and a navigation method. [Background technology]
[0002] Patent Document 1 (Patent Publication No. 6404638) discloses a center device that, upon receiving a destination set in a destination guidance section of a vehicle, transmits to the vehicle a list of candidate parking locations close to the destination. The center device collects information on parking locations from multiple vehicles in advance to construct a database, and when providing the candidate list to the vehicle, searches the database for parking locations close to the destination and extracts them. Summary of the Invention [Problem to be solved by the invention]
[0003] The configuration of Patent Document 1 requires a center device that collects information on parking and stopping positions from a plurality of vehicles in advance and builds a database, which makes system construction expensive.
[0004] An object of the present invention is to provide a technique for realizing route guidance to a parking location close to a destination at low cost. [Means for solving the problem]
[0005] According to a first aspect of the present invention, there is provided a navigation system including an image acquisition unit that acquires images from an on-board camera that images the outside of the vehicle, a route guidance unit that provides guidance on a route to a destination, a parking position detection unit that detects a parking position where the vehicle can be parked based on the images when the vehicle is close to the destination, and a destination change unit that changes the destination to the parking position, wherein after the destination is changed by the destination change unit, the route guidance unit provides guidance on a route to the changed destination.
[0006] According to a second aspect of the present invention, there is provided a navigation method which obtains images from an on-board camera that captures images of the outside of the vehicle, provides guidance on a route to a destination, and when the vehicle is close to the destination, detects a parking location where the vehicle can be parked based on the images, changes the destination to the parking location, and after the destination is changed, provides guidance on a route to the changed destination. Effect of the Invention
[0007] According to the present invention, route guidance to a parking location close to a destination can be realized at low cost. [Brief description of the drawings]
[0008] [Figure 1] FIG. 2 is a functional block diagram of the navigation system. [Diagram 2] FIG. 2 is a plan view showing the mounting positions and angles of view of each vehicle-mounted camera. [Diagram 3] 1 is an example of an image captured by an in-vehicle camera. [Figure 4] 1 is an example of an image captured by an in-vehicle camera. [Diagram 5] 1 is an example of an image captured by an in-vehicle camera. [Figure 6] 1 is a control flow of a navigation system. [Figure 7] FIG. 4 corresponds to FIG. 3 and shows a state in which the vehicle has reached a position where parking and stopping is possible. [Figure 8] FIG. 5 corresponds to FIG. 4 and shows a state in which the vehicle has reached a position where parking and stopping is possible. [Figure 9] FIG. 6 corresponds to FIG. 5 and shows a state in which the vehicle has reached a position where parking and stopping is possible. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0010] Fig. 1 shows a functional block diagram of the navigation system 1. Fig. 2 shows the mounting positions and angles of view of each vehicle-mounted camera.
[0011] The navigation system 1 is a system mounted on and used in a vehicle V. As shown in FIG. 1, the navigation system 1 includes a central processing unit (CPU) 1a as a central processing unit, a random access memory (RAM) 1b that is readable and writable, and a read only memory (ROM) 1c. The CPU 1a reads and executes a control program stored in the ROM 1c, causing the control program to cause hardware such as the CPU 1a to function as a vehicle information acquisition unit 2, a current location acquisition unit 3, an image acquisition unit 4, a possible parking position detection unit 5, a route guidance unit 6, and a destination change unit 7. The navigation system 1 further includes a touch display 8. The touch display 8 is a specific example of an input / output means in which a liquid crystal display and a touch panel are arranged one on top of the other.
[0012] In this embodiment, the navigation system 1 is realized by one in-vehicle device. However, instead of this, the navigation system 1 may be realized by multiple devices mounted on the same vehicle V and capable of two-way communication. In this case, the multiple devices typically include a drive recorder device and a car navigation device.
[0013] 2, a vehicle V is equipped with a front camera 10, a right side camera 11, a left side camera 12, and a rear camera 13. The front camera 10, the right side camera 11, the left side camera 12, and the rear camera 13 are specific examples of in-vehicle cameras that capture images of the outside of the vehicle.
[0014] The front camera 10 is typically disposed on the front grill, front bumper, or front window of the vehicle V, and captures an image of the area outside and in front of the vehicle V. A viewing angle 10P of the front camera 10 is indicated by a two-dot chain line.
[0015] The right side camera 11 is typically disposed on the right door mirror of the vehicle V, thereby capturing an image of the area outside the vehicle V to the right. The angle of view 11P of the right side camera 11 is indicated by a two-dot chain line. If the vehicle V does not have a right door mirror, the right side camera 11 is disposed on the right outer surface of the vehicle V, typically on the right front door.
[0016] The left side camera 12 is typically disposed on the left door mirror of the vehicle V, thereby capturing an image of the area outside the vehicle V to the left. The angle of view 12P of the left side camera 12 is indicated by a two-dot chain line. If the vehicle V does not have a left door mirror, the left side camera 12 is disposed on the left outer surface of the vehicle V, typically on the left front door.
[0017] The rear camera 13 is typically disposed on a rear window or a rear bumper of the vehicle V, and captures an image of the area outside and behind the vehicle V. A viewing angle 13P of the rear camera 13 is indicated by a two-dot chain line.
[0018] Returning to Fig. 1, the front camera 10, the right side camera 11, the left side camera 12, and the rear camera 13 are connected to the navigation system 1. However, any one or all of the right side camera 11, the left side camera 12, and the rear camera 13 may be omitted.
[0019] The vehicle information acquisition unit 2 receives a vehicle speed signal, a parking brake signal, and a gear selector signal from the ECU to acquire the vehicle speed of the vehicle V, the operating state of the parking brake, and the gear position selected by the gear selector. The gear positions include a parking range selected when parking or stopping the vehicle, a drive range selected when driving forward, and a reverse range selected when driving backward.
[0020] The current location acquisition unit 3 acquires the current location of the vehicle V using, for example, a GPS (Global Positioning System) module.
[0021] The image acquisition unit 4 acquires images from the front camera 10 or the like.
[0022] The route guidance unit 6 generates a route from the current location of the vehicle V to a destination set by the user. The route guidance unit 6 provides route guidance to the destination via the touch display 8 based on the generated route.
[0023] When the host vehicle is close to the destination, the possible parking position detection unit 5 detects a possible parking position where the host vehicle can be parked based on the image acquired by the image acquisition unit 4. Specifically, the possible parking position detection unit 5 detects a possible parking position where the host vehicle can be parked by detecting parking lane lines in the image using, for example, Faster R-CNN, YOLO (You only Look Once), or SSD (Single Shot Detector).
[0024] In FIG. 3, the result of detecting the parking space lines is shown by a bounding box B1. The parking space lines enclosed by the bounding box B1 are made up of four straight white lines that are connected to form a rectangle. The possible parking position detection unit 5 detects a possible parking position where the host vehicle can be parked based on the bounding box B1. The possible parking position can typically be expressed by the longitude and latitude of the center of the possible parking area.
[0025] In FIG. 4, the result of detecting the parking stall lines is shown by a bounding box B2, and the result of detecting the road signs indicating that parking is possible is shown by a bounding box B3. The parking stall lines enclosed by the bounding box B2 are composed of three straight white lines, and the three white lines are connected to form a U-shape. As shown in FIG. 4, if it is not possible to detect consecutive parking stall lines forming a rectangle, the detection accuracy of the possible parking position may be slightly reduced. Therefore, if it is not possible to detect consecutive parking stall lines forming a rectangle, the possible parking position detection unit 5 can accurately detect the possible parking position where the host vehicle can be parked by detecting road signs related to parking in addition to detecting the parking stall lines.
[0026] The above road signs include regulatory signs, directional signs, and guide signs.
[0027] Regulatory signs include time-limited parking zone signs indicating that the time during which parking is possible is limited, parallel parking signs indicating that vehicles must park parallel to the edge of the road, right-angle parking signs indicating that vehicles must park perpendicular to the edge of the road, and diagonal parking signs indicating that vehicles must park diagonally to the edge of the road. In Figure 4, a parallel parking sign is detected.
[0028] Indicative signs include signs indicating that vehicles may be parked or stopped.
[0029] Guide signs include signs indicating the location of parking lots.
[0030] In FIG. 5, the result of detecting the parking stall lines is shown by a bounding box B4, and the result of detecting the wheel stopper is shown by a bounding box B5. The parking stall lines enclosed by the bounding box B4 are made up of two straight white lines that run parallel to each other. As shown in FIG. 5, if consecutive parking stall lines cannot be detected to form a rectangle, the detection accuracy of the possible parking position may be slightly reduced. Therefore, if consecutive parking stall lines cannot be detected to form a rectangle, the possible parking position detection unit 5 can accurately detect the possible parking position where the host vehicle can be parked by detecting the wheel stopper in addition to detecting the parking stall lines.
[0031] The destination change unit 7 changes the destination to a location where parking and stopping is possible.
[0032] After the destination is changed by the destination change unit 7, the route guidance unit 6 regenerates a route to the changed destination, provides guidance along the regenerated route, and ends the guidance when the vehicle arrives at a position where parking and stopping is possible.
[0033] Next, the control flow of the navigation system 1 will be described with reference to FIG.
[0034] S100: First, the user operates the touch display 8 to set a destination.
[0035] S110: Next, the current location acquisition unit 3 acquires the current location.
[0036] S120: Next, the route guidance unit 6 generates a route from the current location to the destination.
[0037] S130: Next, the route guidance unit 6 starts providing route guidance to the destination via the touch display 8 based on the generated route.
[0038] S140: Next, the possible parking position detection unit 5 judges whether the current location is close to the destination. Specifically, the possible parking position detection unit 5 judges that the current location is close to the destination when the distance from the current location to the destination is 100 m or less. If S140 is YES, the possible parking position detection unit 5 advances the process to S150, and if S140 is NO, the process of S140 is repeated. 100 m is one specific example of the first threshold value.
[0039] S150: Next, the possible parking position detection unit 5 determines whether the vehicle V is in a low-speed state. Specifically, the possible parking position detection unit 5 determines that the vehicle V is in a low-speed state when the vehicle speed of the vehicle V is 20 km / h or less. If S150 is YES, the possible parking position detection unit 5 advances the process to S160, and if S150 is NO, the process returns to S140. 20 km / h is a specific example of the second threshold value.
[0040] S160: Next, the image acquisition unit 4 acquires an image from the front camera 10 or the like.
[0041] S170: Next, the parking / stopping position detection unit 5 detects a parking / stopping position where the vehicle can be parked / stopped, based on the image acquired by the image acquisition unit 4.
[0042] S180: Next, the destination change unit 7 changes the destination to the parking / stopping position. When the destination change unit 7 detects a plurality of parking / stopping positions, the destination change unit 7 may change the destination to the parking / stopping position that is closest to the current location among the plurality of parking / stopping positions.
[0043] S190: Next, the route guidance unit 6 regenerates a route from the current location to the destination changed by the destination change unit 7. Then, the route guidance unit 6 provides guidance on the route to the changed destination via the touch display 8 based on the regenerated route.
[0044] S200: Next, the route guidance unit 6 determines whether the vehicle has arrived at the changed destination, i.e., the parking available position. Specifically, the route guidance unit 6 determines that the vehicle has arrived at the changed destination when the distance from the current location to the changed destination is 10 m or less. Alternatively, as shown in Figs. 7 to 9, the route guidance unit 6 may determine that the vehicle has arrived at the changed destination when at least a part of the vehicle V is within the parking area C defined by the parking space lines detected by the parking available position detection unit 5. In this case, the route guidance unit 6 may determine whether at least a part of the vehicle V is within the parking area C based on the image acquired by the image acquisition unit 4. When the result of S200 is YES, the route guidance unit 6 advances the process to S210, and when the result of S200 is NO, the route guidance unit 6 repeats the process of S200.
[0045] S210: Next, the route guidance unit 6 determines whether a parking operation has been performed. Examples of parking operations include switching the parking brake from the released side to the engaged side, switching the gear position to the parking range by the gear selector, and switching the ignition to off. If S210 is YES, the route guidance unit 6 advances the process to S220, and if S210 is NO, the process of S210 is repeated.
[0046] S220: Then, the route guidance unit 6 ends the route guidance.
[0047] The preferred embodiment of the present invention has been described above, and the above embodiment has the following features.
[0048] The navigation system 1 includes an image acquisition unit 4 that acquires images from a front camera 10 that captures images outside the vehicle, a route guidance unit 6 that provides guidance on a route to a destination, a possible parking position detection unit 5 that detects a possible parking position where the vehicle can be parked based on the images when the vehicle is close to the destination, and a destination change unit 7 that changes the destination to the possible parking position. After the destination is changed by the destination change unit 7, the route guidance unit 6 provides guidance on a route to the changed destination. With the above configuration, route guidance to a possible parking position close to the destination can be realized at low cost.
[0049] The navigation system 1 further includes a vehicle information acquisition unit 2 serving as a vehicle speed acquisition unit that acquires the vehicle speed of the vehicle. The possible parking position detection unit 5 detects a possible parking position when the distance from the current location of the vehicle to the destination is equal to or less than a first threshold value and the vehicle speed of the vehicle is equal to or less than a second threshold value. With the above configuration, it is possible to detect a possible parking position at an appropriate time and change the destination to the possible parking position.
[0050] Also, the possible parking / stopping position detection unit 5 detects possible parking / stopping positions by detecting parking stall lines based on the image. According to the above configuration, possible parking / stopping positions can be detected at low cost.
[0051] In addition, the parking / stopping position detection unit 5 detects parking space lines and road signs indicating that parking or stopping is possible based on the image, thereby detecting parking / stopping positions. With the above configuration, it is possible to suppress erroneous detection of parking / stopping positions.
[0052] As shown in FIG. 6, the navigation method includes the following processes. An image is acquired from the front camera 10 or the like that captures an image of the outside of the vehicle (S160). · Provide route guidance to the destination (S130). When the host vehicle is close to the destination (S140: YES), a parking position where the host vehicle can be parked is detected based on the image (S170). · Change the destination to a location where parking is possible (S180). After the destination has been changed, the route to the changed destination is guided (S190). According to the above method, route guidance to a parking location close to a destination can be realized at low cost.
[0053] The above navigation system 1 can be modified, for example, as follows.
[0054] That is, in the above embodiment, when the vehicle is close to the destination, the destination is automatically changed to a parking possible location. However, the user may be allowed to set whether to allow or prohibit the automatic change of the destination.
[0055] Alternatively, the parking / stopping position detection unit 5 may detect parking / stopping positions by detecting parking stall lines and parking meters based on the image.
[0056] In the above embodiment, the possible parking position detection unit 5 detects a possible parking position when the vehicle is close to the destination. Therefore, the possible parking position detection unit 5 may detect a possible parking position when the vehicle is close to the destination and approaching the destination, or may detect a possible parking position when the vehicle is close to the destination and moving away from the destination.
[0057] The parking / stopping position detection unit 5 may detect a parking / stopping position where the vehicle can be parked based on the parking / stopping positions of other parked vehicles. The parking / stopping position detection unit 5 may detect a parking / stopping position where the vehicle can be parked by other known methods.
[0058] In the above example, the control program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives) and magneto-optical recording media (e.g., magneto-optical disks). Examples of the non-transitory computer readable media further include CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM. Examples of the non-transitory computer readable media further include PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, and RAM (random access memory). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or via a wireless communication path. [Explanation of symbols]
[0059] 1. Navigation system 2 Vehicle information acquisition unit 3 Current location acquisition section 4. Image acquisition section 5 Parking and stopping position detection section 6 Route Guidance Section 7 Destination Change Section 8 Touch Display 10. Front Camera 11 Right side camera 12 Left side camera 13 Rear camera C Parking area V Vehicle
Claims
1. an image acquisition unit that acquires images from an on-board camera that captures images of the outside of the vehicle; a route guidance unit that provides guidance on a route to a destination; a vehicle speed acquisition unit that acquires a vehicle speed of the host vehicle; a possible parking position detection unit that detects a possible parking position where the vehicle can be parked based on at least one of a regulatory sign indicating that the parking time or the parking direction with respect to the side of the road is restricted, an instruction sign indicating that the vehicle can be parked or stopped, and a guide sign indicating the location of a parking lot, which are detected from the image when a distance from a current location of the vehicle to the destination is equal to or less than a first threshold value and the vehicle speed of the vehicle is equal to or less than a second threshold value; a destination change unit that changes the destination to the parking / stopping possible location; Including, The route guidance unit provides guidance on a route to the changed destination after the destination change unit has changed the destination. Navigation system.
2. The parking / stopping position detection unit detects the parking / stopping position by detecting a parking space line based on the image. The navigation system of claim 1 .
3. Acquire images from an onboard camera that captures images of the outside of the vehicle, Provides directions to your destination, Acquire the vehicle speed of the vehicle; when a distance from a current location of the vehicle to the destination is equal to or less than a first threshold value and the vehicle speed of the vehicle is equal to or less than a second threshold value, a parking possible position where the vehicle can be parked is detected based on at least one of a regulatory sign indicating that a parking time or a parking orientation relative to a road edge is restricted, an instruction sign indicating that a vehicle can be parked or stopped, and a guide sign indicating a location of a parking lot, which are detected from the image; Change the destination to the parking available location, After the destination is changed, a route to the changed destination is provided. Navigation methods.
Citation Information
Patent Citations
Vehicle security system
JP2009193141A
Parking support device
JP2018184149A
Parking position extraction device
JP2019132683A
Stop position controller
JP2019168370A
Method and apparatus for providing goal-directed navigation instructions
JP2019525185A
