Device and method for displaying a target parking space of a vehicle

The device and method enhance parking assistance by displaying target parking spaces using a parking assistance system and top view imaging, addressing the challenge of selecting optimal parking spots and preventing collisions.

DE102017128617B4Active Publication Date: 2024-11-14HYUNDAI MOTOR CO LTD +1
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102017128617
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2017-10-13
Filing Date
2017-12-01
Publication Date
2024-11-14
Estimated Expiration
2037-12-01

AI Technical Summary

Technical Problem

Conventional parking assistance systems fail to provide drivers with an image of a target parking space within empty parking areas, making it difficult for novice or poor drivers to select an optimal parking spot, which can lead to collisions or difficulty opening vehicle doors due to inadequate distance prediction from nearby vehicles, especially at night.

Method used

A device and method that utilize a parking assistance system and a top view imaging system to identify and display a target parking space on a top view image, using sensors and cameras to predict and visualize the optimal parking area based on parking reference points, allowing drivers to select the best parking spot.

Benefits of technology

Enables drivers to easily identify and park in optimal parking spaces, reducing the risk of collisions and door opening issues by providing a clear visual representation of available parking areas, enhancing parking accuracy and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Device for displaying a target parking space of a vehicle, the device comprising: an information collector (81) that collects a parking reference point and a width of a search space from a parking assistance system (10), an image sensor (82) which captures a top view image, a control unit (83) which detects the parking area information corresponding to the parking reference point from the plan view image and which detects a target parking space to be occupied by the vehicle based on the detected parking area information, the parking reference point and the width of the search space, and a display (84) that displays the detected target parking space on the top view image, wherein the parking area information includes a width of a parking area and the number of parking area dividing lines, wherein the control unit (83) calculates a width of a detection area corresponding to each parking area dividing line using the width of the parking area and the width of the search area, and wherein the control unit (83) calculates the width of the detection area based on equation A below: w = ( α − ( β × 0.5 ) ) × 2 where w is the width of the detection area, α represents the width of the parking area and β represents the width of the search space.
Need to check novelty before this filing date? Find Prior Art

Description

Technical field of the invention

[0001] The present disclosure / invention relates to an apparatus and a method for displaying a target parking space of a vehicle, and more particularly, to a technology for displaying a target parking space of a vehicle on a plan view image by predicting the target parking space (space substantially occupied by the vehicle) within an empty parking area in cooperation with a parking assist system and a plan view imaging system when the empty parking area is detected during automatic parking (e.g., parking in). Background of the invention

[0002] In general, when a novice driver or a driver who parks poorly (e.g., back-parks) a vehicle into a narrow space (e.g., square, parking space), the driver may fail to accurately predict distances (e.g., headways) to other vehicles parked at the front and rear or both sides of a target parking space, and may therefore park (e.g., back-park) the vehicle by driving the vehicle forward and backward several times.

[0003] If the distance (e.g., headway) to a nearby vehicle is inadequately predicted, a minor collision with the parked vehicle may occur, or a vehicle door may not open normally because the distance (e.g., headway) to the nearby vehicle is short (e.g., small). In particular, since it is difficult to ensure visibility through a side mirror (e.g., exterior mirror) or rearview mirror at night compared to day, parking (e.g., parking in) may be more difficult at night.

[0004] To solve these problems, a parking assistance system can generate a parking trajectory (e.g., a parking trajectory, a parking path, a parking path) based on information collected from various sensors and arrange the vehicle in a desired space (e.g., square, parking space) while following the corresponding trajectory (e.g., the corresponding path).

[0005] After searching a plurality of empty parking areas (in which no other vehicles are parked), a conventional parking assist system cannot provide a driver with an image (image obtained by predicting a state in which the vehicle is parked) of a target parking space within each parking area, and therefore, it may be difficult for the driver to select an optimal empty parking area from the plurality of empty parking areas.

[0006] In other words, the conventional parking assistance system cannot provide the driver with the image of the target parking space within each parking area, thus failing to allow the driver to select the optimal parking area.

[0007] US 2016 / 0 078 764 A1 discloses a parking assistance system.

[0008] JP 2015 - 227 139 A discloses an on-vehicle image processing device. Explanation of the invention

[0009] The present disclosure / invention has been made to solve the above-mentioned problems encountered in the prior art while keeping intact advantages achieved by the prior art.

[0010] The present disclosure / invention is based on the object of providing an apparatus and a method for displaying a target parking space of a vehicle, which are capable of predicting a target parking space (space substantially occupied by (e.g., with) the vehicle) within an empty parking area based on a parking reference point detected by a parking assist system (e.g., parking assist system) and a top view image detected by a top view imaging system, and displaying the target parking space on the top view image, thereby allowing the driver to select an optimal empty parking area.

[0011] The object of the present disclosure / invention is not limited to the aforementioned object, and any other objects and advantages not mentioned herein will be clearly understood from the following description. The present inventive concept will be more clearly understood from exemplary embodiments of the present disclosure / invention. Furthermore, it will be apparent that the objects and advantages of the present disclosure / invention can be achieved (e.g., obtained) by means of elements and features claimed in the claims and a combination thereof.

[0012] The invention provides a device for displaying a target parking space of a vehicle according to claim 1 and a method for displaying a target parking space of a vehicle according to claim 7. Further embodiments are defined in the subclaims. Brief description of the drawings

[0013] The above and other objects, features and advantages of the present disclosure / invention will become more apparent from the following detailed description with reference to the accompanying drawings: Fig. 1 illustrates the configuration of a system for displaying a target parking space of a vehicle to which a target parking space display device according to an exemplary embodiment of the present disclosure / invention is applied (e.g., in which a target parking space display device according to an exemplary embodiment of the present disclosure / invention is used), Fig. 2 illustrates a top view image generated by a top view imaging system according to an exemplary embodiment of the present invention, Fig. 3 illustrates a width of a parking area and a width of a search space according to an exemplary embodiment of the present disclosure / invention, Fig. 4 illustrates a determination area generated by a target parking space display device in perpendicular parking according to an exemplary embodiment of the present disclosure / invention, Fig. 5 illustrates a determination area generated by a target parking space display device in perpendicular parking according to another exemplary embodiment of the present disclosure / invention, Fig. 6 illustrates a determination area generated by a target parking space display device during parallel parking according to an exemplary embodiment of the present disclosure / invention, Fig. 7 illustrates a determination area generated by a target parking space display device during parallel parking according to another exemplary embodiment of the present disclosure / invention, Fig. 8 illustrates the configuration of an apparatus for displaying a target parking space of a vehicle according to an exemplary embodiment of the present disclosure / invention, and Fig. 9 illustrates a flowchart of a method for displaying a target parking space of a vehicle according to an exemplary embodiment of the present disclosure / invention. Detailed description

[0014] Hereinafter, exemplary embodiments of the present disclosure / invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used throughout to denote the same or equivalent elements. Furthermore, a detailed description of well-known techniques associated with the present disclosure / invention will be omitted in order not to unnecessarily obscure the gist of the present disclosure / invention.

[0015] Terms such as first, second, A, B, (a), and (b) may be used to describe the elements in exemplary embodiments of the present disclosure / invention. These terms are used only to distinguish one element from another, and the intrinsic characteristics, sequence, or order, and the like, of the corresponding elements are not limited by these terms. Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meanings as those understood by one of ordinary skill in the art to which the present disclosure / invention belongs.Such terms as those defined in a commonly used dictionary are to be interpreted as having meanings equivalent to the contextual meanings in the relevant field of technology and are not to be interpreted as having ideal or overly formal meanings unless they are clearly defined in the present application as having such.

[0016] According to an exemplary embodiment of the present disclosure / invention, a parking area refers to an area of ​​a roadway (e.g., a driveway, a street) in which parking is legally permitted. The parking area may include a plurality of area dividing lines (in white painted lines) that represent a boundary between vehicles. Furthermore, a target parking space refers to an area occupied by the vehicle within a single parking area (e.g., to be occupied by the vehicle within a single parking area, to be occupied by the vehicle within a single parking area), or an area occupied by the vehicle across a plurality of parking spaces (e.g., to be occupied by the vehicle across a plurality of parking spaces, to be occupied by the vehicle across a plurality of parking spaces).The target parking space may be predicted based on reference point information acquired by a parking assist system and parking area information (the width of the parking area, the number of parking area dividing lines, and the like) detected from a top-view image acquired by a top-view imaging system. The predicted target parking space may be represented by a vehicle-shaped symbol.

[0017] According to exemplary embodiments of the present invention, the parking assist system may include a smart parking assist system (SPAS), and the top view imaging system may include an around view monitoring (AVM) system and a surround view monitoring (SVM) system.

[0018] Fig. 1 illustrates the configuration of a system for displaying a target parking space of a vehicle to which a target parking space display device according to an exemplary embodiment of the present disclosure / invention is applied (e.g., in which a target parking space display device according to an exemplary embodiment of the present disclosure / invention is used).

[0019] As in Fig. 1, the target parking space display system may include a parking assistance system 10, a top view imaging system 20, and a target parking space display device 30.

[0020] The parking assistance system 10 is a system that calculates a parking trajectory (e.g., a parking trajectory, a parking path, a parking path) to automatically move the vehicle into a parking area. The parking assistance system 10 can be activated by a driver, search for empty parking areas in which no other vehicles are parked, generate information about a parking reference point with respect to the searched empty parking areas, and automatically park the vehicle in an empty parking area (e.g., park into an empty parking area) selected by the driver using the corresponding parking reference point information. Here, the parking reference point information can indicate a point (coordinates) at (e.g., at) which the vehicle is to be located within the empty parking area (e.g., the vehicle is to be located within the empty parking area). When the vehicle is parked (e.g.,parked), a specific position (e.g. a specific location) (point C. 1 in Fig. 4 during vertical parking, point C 2 in Fig. 6 during parallel parking) must match the parking reference point within an error range.

[0021] For example, the parking assist system 10 may include a plurality of rear view sensors (e.g., rear view sensors) consisting of a master sensor module and a slave sensor module, a local interconnect network (LIN), a display module, and a speaker module.

[0022] The rearview sensors may generally be composed of four sensors and may be connected to the LIN and arranged on a rear bumper of the vehicle with a predetermined interval therebetween. The rearview sensors may be configured to receive necessary power from a power source that supplies power to the taillights (not shown), and therefore, their installation may be simple.

[0023] The main sensor module of the rearview sensors may be connected to the sub-sensor module through the LIN to act as a main device, and may include a CPU, an ultrasonic sensor, a transceiver (e.g., a transceiver), and a distance calculation module.

[0024] The CPU of the main sensor module can initialize each module connected to the LIN when a reverse gear signal is input. Then, the CPU can control the ultrasonic sensor to detect reflected waves from an obstacle at a predetermined time (e.g., distance). When the detected result from the ultrasonic sensor is transmitted to the CPU, the CPU can transmit the detected result to the distance calculation module. Furthermore, when a result is transmitted from the sub-sensor module through the transceiver, the CPU can transmit the detected result to the distance calculation module.

[0025] The ultrasonic sensor of the main sensor module can emit ultrasonic waves under the control of the CPU, detect the reflected waves reflected by the obstacle, and transmit the detected result to the CPU. In the exemplary embodiment of the present disclosure / invention, the ultrasonic sensor is illustrated as a sensor for measuring distance (e.g., pitch), but the inventive concept is not limited thereto. It will be apparent to those skilled in the art that various sensors, such as an infrared sensor, may be used.

[0026] The transceiver of the main sensor module can act as a communication interface with the LIN.

[0027] The distance calculation module of the main sensor module can calculate a distance (e.g., a distance) to the obstacle based on the detection result of the ultrasonic sensor. The calculated result can be transmitted to the display module or the speaker module.

[0028] The sub-sensor module of the rearview sensors may be connected to the main sensor module through the LIN to act as a sub-device, and may include a CPU, an ultrasonic sensor, and a transceiver.

[0029] The CPU of the sub-sensor module may be initialized according to an initialization command input from the main sensor module. Then, the CPU may control the ultrasonic sensor to detect reflected waves from an obstacle at a predetermined time (e.g., distance). Once the detected result from the ultrasonic sensor is transmitted to the CPU, the CPU may transmit the detected result to the main sensor module through the transceiver.

[0030] The ultrasonic sensor of the sub-sensor module can emit ultrasonic waves under the control of the CPU and detect the reflected waves reflected by the obstacle.

[0031] The transceiver of the secondary sensor module can act as a communication interface with the LIN.

[0032] The LIN may be a network protocol developed based on a controller area network (CAN) and used for system decentralization of CAN communication terminals of a vehicle network. According to exemplary embodiments of the present disclosure, the LIN may be directly connected to the plurality of rearview sensors, the display module, and the speaker module.

[0033] The display module may be a liquid crystal display device mounted in front of the driver's seat of the vehicle. When the distance to the obstacle is transmitted from the main sensor module, the display module may inform the driver of the distance using a visualization method.

[0034] Meanwhile, when the distance to the obstacle is transmitted from the main sensor module, the speaker module can inform the driver of the distance via sound. Specifically, the speaker module can emit three levels of sound (e.g., sounds at three different volumes) depending on the distance.

[0035] The top view imaging system 20 may use images captured by cameras mounted on the front, rear, left, and right sides of the vehicle to create an image (top view image) as if the driver were looking at the vehicle from above, as in Fig. 2 shown.

[0036] For example, the top-view imaging system 20 may include a signal processor, a camera, a communicator (e.g., a communication device), a memory, and an image converter (e.g., an image converter). The signal processor processes signals transmitted between the aforementioned elements of the top-view imaging system 20.

[0037] The camera may be mounted on the vehicle to capture images of the vehicle's surroundings. A plurality of cameras may be provided. For example, the cameras may be mounted on the front, rear, left, and right sides of the vehicle. The images of the front, rear, left, and right sides of the vehicle captured by the cameras may be transmitted to the image converter to generate the top-view image.

[0038] The communicator may support a vehicle-to-vehicle (V2V) communication interface. Furthermore, the communicator may communicate with at least one nearby vehicle around an oncoming vehicle to receive the top-view image and information of the nearby vehicle. Furthermore, the communicator may support a differential GPS (DGPS) communication interface. Therefore, the communicator may receive position information between the oncoming vehicle and the nearby vehicle through DGPS communication.

[0039] In addition, the communicator may include a mobile communication module, a wireless internet module, a short-range communication module, and the like.

[0040] The mobile communication module can transmit (e.g. send) and receive a wireless signal to / from at least one of a base station, an external terminal and a server in a mobile communication network established according to communication standards or communication methods for mobile communication (e.g. Global System for Mobile Communication (GSM), Code Division Multiple Access (CDMA), Code Division Multiple Access 2000 (CDMA2000), Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (EV-DO), Wideband Code Division Multiple Access (WCDMA), High Speed ​​Downlink Packet Access (HSDPA)).High Speed ​​Downlink Packet Access (HSUPA), High Speed ​​Uplink Packet Access (LTE), Long Term Evolution (LTEA), Long Term Evolution-Advanced (LTEA), and the like. Here, the wireless signal may contain various types of data according to transmission (e.g., sending) / reception of a voice call signal, a video call signal, or a text / multimedia message.

[0041] The wireless internet module refers to a module for wireless internet access and can be configured to transmit (e.g., send) and receive wireless signals in a communications network according to wireless internet technologies.

[0042] For example, wireless internet technologies include: Wireless LAN (WLAN), Wireless Fidelity (Wi-Fi), Wi-Fi Direct (Wi-Fi Direct), Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), Worldwide Interoperability for Microwave Access (WiMAX), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A) and the like. The wireless internet module can transmit data (e.g.transmit) and receive in accordance with at least one wireless Internet technology in an area that has Internet technologies not listed above.

[0043] Considering that wireless Internet access is made by means of WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A and the like through the mobile communication network, the wireless Internet module that performs wireless Internet access (e.g., Internet access) through the mobile communication network can be understood as a kind of wireless Internet module.

[0044] The short-range communication module may support short-range communication using at least one of Bluetooth®, radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB), ZigBee, near-field communication (NFC), wireless fidelity (Wi-Fi), Wi-Fi Direct, wireless universal serial bus (Wireless USB), and the like.

[0045] The memory may store a setting value for operations of the top-view imaging system, as well as status information and results for each operation. For example, the memory may store the top-view image of the opposing vehicle and the top-view image of the near vehicle, and may also store a synthetic (e.g., artificial) image of the top-view image of the opposing vehicle and the top-view image of the near vehicle. Furthermore, the memory may store an image synthesis algorithm (e.g., image production algorithm) for synthesizing (e.g., producing) the top-view images.

[0046] The memory may comprise at least one storage medium selected from a flash memory, a hard disk, a solid-state drive (SSD), a silicon disk drive (SDD), a multimedia card micro-type memory, a card-type memory (e.g. SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory (e.g. magnetic memory), a magnetic disk (e.g. magnetic disc) and an optical disk (e.g. disc).

[0047] The image converter can generate the top-view image from the images of the surroundings of the opposing vehicle captured by the cameras. To generate the top-view image, the image converter can convert (e.g., convert) the images of the surroundings of the opposing vehicle into the top-view image.

[0048] The target parking space display device 30 can predict the target parking space (space occupied by the vehicle during parking) within the empty parking area based on the parking reference point information acquired by the parking assist system 10 and the parking area information obtained from the top-view image acquired by the top-view imaging system 20, and display the predicted result on the top-view image. Here, the target parking space display device 30 can acquire the parking area information from the top-view imaging system 20.

[0049] The target parking space display device 30 can predict the target parking space within the parking area based on a width of the parking area in the parking area information detected from the plan view image and a width of a search space acquired by the parking assist system 10.

[0050] Below, the width of the parking area and the width of the search area are described in detail with reference to Fig. 3 described.

[0051] As in Fig. 3, α represents a width of a parking area for perpendicular parking (e.g., perpendicular parking, i.e., perpendicular to the direction of travel), and β represents a width of a search area for perpendicular parking. Here, C 1 a center point of β and denotes a parking reference point for vertical parking.

[0052] γ represents a width of a parking area for parallel parking (e.g., parking along the roadway), and δ represents a width of a search space for parallel parking. Here, C 2 a center point of δ and denotes a parking reference point for parallel parking.

[0053] Furthermore, the target parking space display device 30 may calculate a width of a determination area used to predict a target parking space within an empty parking area. For example, a width w 1 of the detection area used in vertical parking can be calculated based on equation 1 below. w1=(α−(β×0.5))×2

[0054] The calculated width w 1 The detection area refers to the size of an area (e.g. the area) that is defined with a parking area dividing line as the center, whereby the parking area dividing line forms a boundary between vehicles.

[0055] Hereinafter, a process of calculating a width of a detection area when there are other vehicles on (e.g., on) both sides of an empty parking area will be explained in detail with reference to Fig. 4 described. In Fig. 4, "401" denotes an icon (virtual image) representing a target parking space, and the icon can be displayed by the target parking space display device 30 in a final operation. Therefore, the operation of calculating the width of the detection area should be understood in a state where the icon 401 is not displayed. In other words, the operation of calculating the width of the detection area will be described without considering the icon 401.

[0056] As in Fig. As shown in Figure 4, Condition #1 indicates that the width of the parking area is 2.5 m, the width of the search area is 3.5 m, and two parking area dividing lines are detected. The detection area is formed to have a width of 1.5 m based on each parking area dividing line (dashed line) of the empty parking area. Here, the parking area dividing line represents a line that forms a boundary between vehicles.

[0057] Condition #2 specifies that the width of the parking area is 2.5 m, the width of the search space is 3.0 m, and a parking area boundary line is detected. The detection area is formed to have a width of 2 m based on a lower parking area boundary line (dashed line) of the empty parking area. Here, an upper parking area boundary line is not detected because it is covered (e.g., obscured) by another vehicle, and therefore the width of the corresponding detection area is not calculated.

[0058] Condition #3 specifies that the width of the parking area is 2.5 m, the width of the search area is 3.0 m, and a parking area dividing line is detected. The detection area is formed to have a width of 2 m based on a lower parking area dividing line (dashed line) of the empty parking area. Condition #3 differs from Condition #2 in that the parking reference point C 1is included in the investigation area.

[0059] Condition #4 specifies that the width of the parking area is 2.5 m, the width of the search area is 2.7 m, and two parking area dividing lines are detected. The detection area is formed to have a width of 2.3 m based on each parking area dividing line (dashed line) of the empty parking area.

[0060] Condition #5 specifies that the width of the parking area is 2.5 m, the width of the search area is 2.7 m, and a parking area dividing line is detected. The detection area is formed to have a width of 2.3 m based on an upper parking area dividing line (dashed line) of the empty parking area. Condition #5 differs from Condition #4 in that the parking reference point C 1 is included in the investigation area.

[0061] Hereinafter, a process of calculating a width of a detection area when there is another vehicle at (e.g., on) one side of an empty parking area will be explained in detail with reference to Fig. 5. In Fig. 5, "501" denotes an icon (virtual image) representing a target parking space, and the icon can be displayed by the target parking space display device 30 in a final process. Therefore, the process of calculating the width of the determination area should be understood in a state where the icon 501 is not displayed. In other words, the process of calculating the width of the determination area will be described without considering the icon 501.

[0062] As in Fig. 5, Condition #6 indicates that the width of the parking area is 2.5 m, the width of the search area is 4.0 m, and two parking area dividing lines are detected. The detection area is formed to have a width of 1 m based on each parking area dividing line (dashed line) of the empty parking area.

[0063] Condition #7 specifies that the width of the parking area is 2.5 m, the width of the search space is 4.0 m, and a parking area boundary line is detected. The detection area is formed to have a width of 1 m based on a lower parking area boundary line (dashed line) of the empty parking area. Here, an upper parking area boundary line is not detected because it is covered (e.g., obscured) by another vehicle, and therefore the width of the corresponding detection area is not calculated.

[0064] Condition #8 denotes that the width of the parking area is 2.5 m, the width of the search space is 4.0 m, and a parking area dividing line is / is detected. The detection area is formed to have a width of 1 m based on a lower parking area dividing line (dashed line) of the empty parking area. Here, an upper parking area dividing line is / is not detected because it is / is covered by another vehicle. Condition #8 differs from Condition #7 in that the parking reference point C 1 is included in the investigation area.

[0065] Condition #9 specifies that the width of the parking area is 2.5 m, the width of the search area is 4.0 m, and a parking area boundary line is detected. The detection area is formed to have a width of 1 m based on the upper parking area boundary line (dashed line) of the empty parking area.

[0066] Condition #10 specifies that the width of the parking area is 2.5 m, the width of the search area is 4.0 m, and a parking area dividing line is detected. The detection area is formed to have a width of 1 m based on an upper parking area dividing line (dashed line) of the empty parking area. Condition #10 differs from Condition #9 in that the parking reference point C 1 is included in the investigation area.

[0067] For example, a width w 2 of the detection area used for parallel parking can be calculated based on equation 2 below. w2=(γ−(δ×0.5))×2

[0068] The calculated width w 2 The detection area refers to the size of an area (e.g. the area) that is defined with a parking area dividing line as the center, whereby the parking area dividing line forms a boundary between vehicles.

[0069] Hereinafter, a process of calculating a width of a detection area when there are other vehicles on (e.g., on) both sides of an empty parking area will be explained in detail with reference to Fig. 6 described. In Fig. 6, "601" denotes an icon (virtual image) representing a target parking space, and the icon can be displayed by the target parking space display device 30 in a final operation. Therefore, the operation of calculating the width of the determination area should be understood in a state where the icon 601 is not displayed. In other words, the operation of calculating the width of the determination area will be described without considering the icon 601.

[0070] As in Fig. As shown in Figure 6, Condition #1 indicates that the width of the parking area is 6m, the width of the search space is 7m, and two parking area dividing lines are detected. The detection area is formed to have a width of 5m based on each parking area dividing line (dashed line) of the empty parking area.

[0071] Condition #2 denotes that the width of the parking area is 6m, the width of the search space is 7m, and two parking area dividing lines are detected. The determination area is formed to have a width of 5m based on each parking area dividing line (dashed line) of the empty parking area. Here, Condition #2 differs from Condition #1 in that the other vehicles are parked at different positions (e.g., locations). However, since Conditions #1 and #2 are the same in that the parking reference point is not included in the determination area, the same target parking space is determined.

[0072] Condition #3 specifies that the width of the parking area is 6 m, the width of the search space is 6.4 m, and a parking area boundary line is detected. The detection area is formed to have a width of 4.6 m based on the upper parking area boundary line (dashed line) of the empty parking area. Here, a lower parking area boundary line is not detected because it is covered (e.g., obscured) by another vehicle, and therefore the width of the corresponding detection area is not calculated.

[0073] Condition #4 specifies that the width of the parking area is 6 m, the width of the search space is 6.2 m, and a parking area boundary line is detected. The detection area is formed to have a width of 5.8 m based on a lower parking area boundary line (dashed line) of the empty parking area. Here, an upper parking area boundary line is not detected because it is covered (e.g., obscured) by another vehicle, and therefore the width of the corresponding detection area is not calculated.

[0074] Condition #5 means that no parking area dividing lines of the empty parking area are detected and therefore the width of the detection area is not calculated.

[0075] Hereinafter, a process of calculating a width of a detection area when there is another vehicle at (e.g., on) one side of an empty parking area will be explained in detail with reference to Fig. 7. In Fig. In FIG. 7, "701" denotes an icon (virtual image) representing a target parking space, and the icon can be displayed by the target parking space display device 30 in a final process. Therefore, the process of calculating the width of the determination area should be understood in a state where the icon 701 is not displayed. In other words, the process of calculating the width of the determination area will be described without considering the icon 701.

[0076] As in Fig. As shown in Figure 7, Condition #6 indicates that the width of the parking area is 6m, the width of the search space is 7m, and two parking area dividing lines are detected. The detection area is formed to have a width of 5m based on each parking area dividing line (dashed line) of the empty parking area.

[0077] Condition #7 specifies that the width of the parking area is 6m, the width of the search space is 7m, and a parking area boundary line is detected. The detection area is formed to have a width of 5m based on a lower parking area boundary line (dashed line) of the empty parking area. Here, an upper parking area boundary line is not detected because it is covered (e.g., obscured) by another vehicle, and therefore the width of the corresponding detection area is not calculated.

[0078] Condition #8 denotes that the width of the parking area is 6 m, the width of the search space is 7 m, and a parking area dividing line is / is detected. The determination area is formed to have a width of 5 m based on a lower parking area dividing line (dashed line) of the empty parking area. Here, an upper parking area dividing line is / is not detected because it is / is covered by another vehicle, and therefore the width of the corresponding determination area is not calculated. In this case, Condition #8 differs from Condition #7 in that the parking reference point C 2 is included in the investigation area.

[0079] Condition #9 specifies that the width of the parking area is 6m, the width of the search area is 7m, and a parking area boundary line is detected. The detection area is formed to have a width of 5m based on the upper parking area boundary line (dashed line) of the empty parking area.

[0080] Condition #10 means that no parking area dividing lines of the empty parking area are detected and therefore the width of the detection area is not calculated.

[0081] Meanwhile, the target parking space display device 30 may display the target parking space icon 401 or 501 in a single parking area or in a plurality of parking areas based on the calculated determination area (condition #1-10) and the parking reference point in perpendicular parking.

[0082] As in Fig. 4, since the parking reference point C 1is not included in the determination area in (e.g., of) Condition #1, the target parking space symbol 401 may be displayed between both parking space dividing lines (e.g., (in, on) the middle) of the empty parking space.

[0083] Since the parking reference point C 1 is not included in the determination area in (e.g., of) Condition #2, the target parking space icon 401 may be displayed to be located a predetermined distance (e.g., 30 cm) apart from the one parking space dividing line of the empty parking space.

[0084] Since the parking reference point C 1 is included in the determination area in (e.g., of) Condition #3, the target parking space symbol 401 can be determined based on the parking reference point C 1 In other words, the target parking space icon 401 may be displayed to guide to the parking reference point C 1 to correspond.

[0085] Since the parking reference point C1 is not included in the determination area in (e.g., of) Condition #4, the target parking space symbol 401 may be displayed between both parking space dividing lines (e.g., (in, on) the middle) of the empty parking space.

[0086] Since the parking reference point C 1 is included in the determination range in (e.g., of) Condition #5, the target parking space symbol 401 can be determined based on the parking reference point C 1 be / will be displayed.

[0087] As in Fig. 5, since the parking reference point C 1 is not included in the determination area in (e.g., of) Condition #6, the target parking space symbol 501 may be displayed between both parking space dividing lines (e.g., (in, on) the center) of the empty parking space.

[0088] Since the parking reference point C 1is not included in the determination area in (e.g., of) Condition #7, the target parking space icon 501 may be displayed to be located a predetermined distance (e.g., 30 cm) apart from the one parking space dividing line of the empty parking space.

[0089] Since the parking reference point C 1 is included in the determination range in (e.g., of) Condition #8, the target parking space symbol 501 can be determined based on the parking reference point C 1 be / will be displayed.

[0090] Since the parking reference point C 1 is not included in the determination range in (e.g., of) Condition #9, the target parking space icon 501 may be displayed to be located a predetermined distance (e.g., 30 cm) apart from the one parking space dividing line of the empty parking space.

[0091] Since the parking reference point C 1is included in the determination range in (e.g., of) Condition #10, the target parking space symbol 501 can be determined based on the parking reference point C 1 be / will be displayed.

[0092] Meanwhile, the target parking space display device 30 may display the target parking space icon 601 or 701 in a single parking area or in a plurality of parking areas based on the calculated determination area (condition #1-10) and the parking reference point in parallel parking.

[0093] As in Fig. 6, since the parking reference point C 2 is not included in the determination area in (e.g., of) Condition #1, the target parking space icon 601 may be displayed between both parking space dividing lines (e.g., (in, on) the center) of the empty parking space.

[0094] Since the parking reference point C 2is not included in the determination area in (e.g., of) Condition #2, the target parking space symbol 601 may be displayed between both parking space dividing lines (e.g., (in, on) the center) of the empty parking space.

[0095] Since the parking reference point C 2 is not included in the determination area in (e.g., of) Condition #3, the target parking space icon 601 may be displayed to be located a predetermined distance (e.g., 50 cm) apart from the one parking space dividing line of the empty parking space.

[0096] Since the parking reference point C 2 is included in the determination range in (e.g., of) Condition #4, the target parking space symbol 601 can be determined based on the parking reference point C 2 be / will be displayed.

[0097] Since no parking area dividing lines of the empty parking area are detected in (e.g., at) Condition #5, the target parking space symbol 601 can be determined based on the parking reference point C 2 In other words, the target parking space icon 601 may be displayed to guide to the parking reference point C 2 to correspond. This case indicates that the parking assistance system 10 determines that parking is possible even though the other vehicles occupy minor (e.g., light) sections of the empty parking area.

[0098] As in Fig. 7, since the parking reference point C 2 is not included in the determination area in (e.g., of) Condition #6, the target parking space symbol 701 may be displayed between both parking space dividing lines (e.g., (in, on) the center) of the empty parking space.

[0099] Since the parking reference point C 2is not included in the determination area in (e.g., of) Condition #7, the target parking space icon 701 may be displayed to be located a predetermined distance (e.g., 50 cm) apart from the one parking space dividing line of the empty parking space.

[0100] Since the parking reference point C 2 is included in the determination range in (e.g., of) Condition #8, the target parking space symbol 701 can be determined based on the parking reference point C 2 be / will be displayed.

[0101] Since the parking reference point C 2 is not included in the determination range in (e.g., of) Condition #9, the target parking space icon 701 may be displayed to be located a predetermined distance (e.g., 50 cm) apart from the one parking space dividing line of the empty parking space.

[0102] Since no parking area dividing lines of the empty parking area are detected in (e.g., at) Condition #10, the target parking space symbol 701 can be determined based on the parking reference point C 2 be / will be displayed.

[0103] In the exemplary embodiment of the present disclosure / invention, the configuration of the target parking space display device 30 and the top view imaging system 20 as separate elements was described as an example. However, alternatively, the target parking space display device 30 may be provided within the top view imaging system 20 to be operated by a control unit of the top view imaging system 20.

[0104] Fig. 8 illustrates the configuration of a target parking space display device according to an exemplary embodiment of the present disclosure / invention. In the following exemplary embodiment of the present disclosure / invention, the configuration of respective elements as separate individual units will be described as an example. Alternatively, a control unit 83 may be configured to perform the functions of an information collector (e.g., an information collection unit) 81 and a plan view image pickup (e.g., an image capturing unit) 82.

[0105] As in Fig. 8, the target parking space display device according to the exemplary embodiment of the present disclosure / invention includes the information collector 81, the plan view image pickup 82, the control unit 83, and a display (e.g., display unit) 84.

[0106] With respect to each of the aforementioned elements, the information collector 81 may provide an interface with the parking assistance system 10 and may interact (e.g., be connected) with the parking assistance system 10 to collect information about the parking reference point (coordinates) and the width of the search space.

[0107] The top-view imager 82 may interface with the top-view imaging system and engage (e.g., be connected) with the top-view imaging system to capture the top-view image. Here, the top-view imager 82 may be a camera, an image sensor, or the like to capture parking area information (the width of the parking area, the number of parking area dividing lines, and the like).

[0108] The control unit 83 can detect the parking area information corresponding to the parking reference point information from the plan view image acquired by the plan view image pickup 82, and detect a space (the target parking space) occupied by the vehicle (e.g., to be occupied by the vehicle) based on the detected parking area information and the information about the parking reference point and the width of the search space collected by the information collector 82.

[0109] Furthermore, the control unit 83 may control the display 84 to display the detected target parking space on the plan view image.

[0110] In other words, the control unit 83 may calculate a width of a determination area for each parking area dividing line based on Equation 1 and Equation 2.

[0111] Furthermore, the control unit 83 may determine whether or not the parking reference point is included in the determination range for each parking area dividing line. If the parking reference point is not included in the determination range for each parking area dividing line, the control unit 83 may control the display 84 to display the target parking space based on the parking area dividing line. If two parking area dividing lines of the empty parking area in which the vehicle is to be parked are detected, the display 84 may display the target parking space between the two parking area dividing lines. Furthermore, if one parking area dividing line of the empty parking area in which the vehicle is to be parked is detected, the display 84 may display the target parking space separated from the parking area dividing line by a predetermined distance (e.g.,The display 84 may indicate the target parking space, which is to be located a predetermined distance apart from the parking area dividing line. The predetermined distance may be 30 cm for perpendicular parking and 50 cm for parallel parking.

[0112] Furthermore, when the parking reference point is included in the determination range for each parking area dividing line, the control unit 83 may control the display 84 to display the target parking space based on the parking reference point.

[0113] Moreover, when no parking area dividing line from the parking area information corresponding to the parking reference point is detected on the plan view image, the control unit 83 may control the display 84 to display the target parking space based on the parking reference point.

[0114] Fig. 9 illustrates a flowchart of a method for displaying a target parking space of a vehicle according to an exemplary embodiment of the present disclosure / invention.

[0115] First, the information collector 81 may collect a parking reference point and a width of a search space from the parking assist system in operation 901.

[0116] Next, the imager 82 may capture (e.g., acquire) a top view image in operation 902.

[0117] Thereafter, the control unit 83 may detect parking area information corresponding to the parking reference point from the plan view image and detect a target parking space occupied by the vehicle (e.g., to be occupied by the vehicle) based on the detected parking area information, the parking reference point, and the width of the search space in operation 903.

[0118] Then, the control unit 83 may control the display 84 to display the detected target parking space on the plan view image in operation 904.

[0119] As set forth above, the target parking space display device and method according to exemplary embodiments of the present disclosure / invention may be capable of predicting the target parking space (space substantially occupied by the vehicle) within the empty parking area based on the parking reference point information acquired by the parking assist system and the top view image acquired by the top view imaging system, and displaying the target parking space on the top view image, thereby allowing the driver to select an optimal empty parking area. List of reference symbols

[0120] Drawings Fig. 1 10 Parking Assistance System 20 Top view imaging system 30 Destination parking space display device Fig. 8 81 Information Collection Unit 82 Image recording unit 83 Control unit 84 Display unit Fig. 9 901 Collect park reference point and width of search space 902 Capture top view image 903 Detect parking area information corresponding to parking reference point from plan view image and detect target parking space to be occupied by vehicle based on parking area information, parking reference point and width of search space 904 Display detected target parking space on top view image

Claims

[1] A device for displaying a target parking space of a vehicle, the device comprising: an information collector (81) that collects a parking reference point and a width of a search space from a parking assistance system (10), an image sensor (82) which captures a top view image, a control unit (83) which detects the parking area information corresponding to the parking reference point from the plan view image and which detects a target parking space to be occupied by the vehicle based on the detected parking area information, the parking reference point and the width of the search space, and a display (84) that displays the detected target parking space on the top view image, wherein the parking area information includes a width of a parking area and the number of parking area dividing lines, wherein the control unit (83) calculates a width of a detection area corresponding to each parking area dividing line using the width of the parking area and the width of the search area, and wherein the control unit (83) calculates the width of the detection area based on equation A below: w=(α−(β×0.5))×2 where w is the width of the detection area, α represents the width of the parking area and β represents the width of the search space. [2] The apparatus according to claim 1, wherein the control unit (83) controls the display (84) to display the target parking space based on the parking reference point when no parking area dividing line from the parking area information corresponding to the parking reference point is detected on the plan view image. [3] The apparatus according to claim 1, wherein the control unit (83) controls the display (84) to display the target parking space based on the parking reference point when the parking reference point is included in the detection area. [4] The apparatus according to any one of claims 1 to 3, wherein the control unit (83) controls the display (84) to display the target parking space based on the parking area dividing line when the parking reference point is not included in the determination area. [5] The apparatus according to any one of claims 1 to 4, wherein, when the number of parking area dividing lines is two, the control unit (83) controls the display (84) to display the target parking space between the two parking area dividing lines. [6] The apparatus according to any one of claims 1 to 4, wherein, when the number of parking area dividing lines is one, the control unit (83) controls the display (84) to display the target parking space separated from the parking area dividing line by a predetermined distance. [7] A method for displaying a target parking space of a vehicle, the method comprising the following steps: Collecting (901), by means of an information collector (81), a parking reference point and a width of a search space from a parking assistance system (10), Capturing (902), by means of an image sensor (82), a top view image, Detecting (903), by means of a control unit (83), parking area information corresponding to the parking reference point from the plan view image and detecting (903) a target parking space to be occupied by the vehicle based on the detected parking area information, the parking reference point and the width of the search space and Controlling (904), by means of the control unit (83), a display (84) to display the target parking space on the plan view image wherein the parking area information includes a width of a parking area and the number of parking area dividing lines, wherein the step of detecting (903) the target parking space comprises: calculating a width of a determination area corresponding to each parking area dividing line using the width of the parking area and the width of the search area, wherein the step of detecting (903) the target parking space comprises: calculating the width of the detection area based on equation A below: w=(α−(β×0.5))×2 where w is the width of the detection area, α represents the width of the parking area and β represents the width of the search space. [8] The method of claim 7, wherein the controlling step (904) comprises: Controlling the display (84) to display the target parking space based on the parking reference point when no parking area dividing line from the parking area information corresponding to the parking reference point is detected on the plan view image. [9] The method according to claim 7, wherein the controlling step (904) comprises controlling the display (84) to display the target parking space based on the parking reference point when the parking reference point is included in the determination area. [10] The method according to any one of claims 7 to 9, wherein the controlling step (904) comprises: controlling the display (84) to display the target parking space based on the parking area dividing line when the parking reference point is not included in the determination area. [11] The method according to any one of claims 7 to 10, wherein the controlling step (904) comprises: controlling the display (84) to display the target parking space between two parking area dividing lines when the number of parking area dividing lines is two. [12] The method according to any one of claims 7 to 10, wherein the controlling step (904) comprises: controlling the display (84) to display the target parking space separated from the parking area dividing line by a predetermined distance when the number of parking area dividing lines is one.

Citation Information

Patent Citations

  • On-vehicle image processing apparatus

    JP2015227139A

  • Parking assist system

    US20160078764A1

  • JP002015227139A