System and method for controlling a vehicle

Abstract

Disclosed is a system and method for controlling a vehicle. The system includes a vehicle that obtains driving information and a blind spot image, and transmits the driving information and the blind spot image, and a wearable device that receives the driving information and the blind spot image from the vehicle, and outputs the blind spot image based on the driving information and gaze information of a driver.

Description

[0001] Cross-citation of related applications

[0002] This application claims the benefit of priority to Korean Patent Application No. 10-2021-0098635, filed on July 27, 2021, with the Korean Intellectual Property Office, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a system and method for controlling a vehicle. Background Technology

[0004] Normally, drivers ensure their driving field of vision through the vehicle's front windshield, and their rear or rear-facing driving field of vision through the rearview mirror (interior mirror) or side mirrors, and their side driving field of vision through the windows on the doors. However, blind spots are created by the front pillar (A-pillar) located in the middle between the vehicle's front and side windows, and the driver's driving field of vision may be obstructed by blind spots in front and to the sides.

[0005] Therefore, to ensure the driver's field of vision in blind spots, a solution has been proposed that involves mounting cameras on the outer side of the A-pillar to capture images of the front or sides of the vehicle and displaying the captured images on the AVN screen inside the vehicle. However, this makes it impossible to output the images to the position desired by the driver. Furthermore, to improve driver convenience, a solution has been proposed that involves mounting monitors near the A-pillar to output the captured images; however, this solution increases material costs and thus the overall cost burden.

[0006] The information disclosed in the background section above is intended to help understand the background of this disclosure and should not be construed as an admission that such information forms any part of the prior art. Summary of the Invention

[0007] This disclosure has been made to address the aforementioned problems in the prior art while maintaining the advantages achieved by the prior art.

[0008] One aspect of this disclosure provides a system and method for controlling a vehicle, which can output a blind spot image of the vehicle at a location desired by the driver or identify objects located in the blind spot.

[0009] The technical problems to be solved by the present invention are not limited to those described above, and any other technical problems not mentioned herein will be clearly understood by those skilled in the art from the following description.

[0010] According to one aspect of this disclosure, a system for controlling a vehicle includes: a vehicle that acquires driving information and blind spot images and transmits the driving information and blind spot images; and a wearable device that receives the driving information and blind spot images from the vehicle and outputs the blind spot images based on the driver's driving information and gaze information.

[0011] The wearable device may include: one or more cameras for acquiring driver gaze information; an output device for outputting blind spot images; and a controller for determining the output location of the blind spot images based on the size of the device positioned in the area where the driver's field of vision needs to be ensured.

[0012] The controller can determine the output location of the blind spot image based on the distance from the center between one or more cameras to the device positioned in the area where the driver's field of vision needs to be ensured.

[0013] The controller can adjust the transparency of the output device based on driving information.

[0014] The vehicle can determine the image capture location based on the steering angle, whether the turn signals are on, and the vehicle's position determined based on driving information.

[0015] Wearable devices can be controlled to output images obtained at a determined shooting location.

[0016] When a blind spot image is not obtained and an object is detected within a specified distance from the vehicle, the vehicle can send the object's location information to the wearable device.

[0017] Wearable devices can receive location information of an object and output the location information in one or more forms, such as images, voice, and vibration.

[0018] The vehicle can acquire images of its surroundings to generate a panoramic image; calculate the distance from the vehicle to the parking line based on the panoramic image; and send the distance from the vehicle to the parking line, the position of the vehicle and the parking line to a wearable device.

[0019] The wearable device can output the location of the vehicle and the parking line, as well as the distance from the vehicle to the parking line.

[0020] According to one aspect of this disclosure, a method for controlling a vehicle includes: obtaining driving information and blind spot images from the vehicle; sending the driving information and blind spot images to a wearable device; receiving the driving information and blind spot images from the vehicle by the wearable device; and outputting the blind spot images based on the driver's driving information and gaze information.

[0021] The output blind spot image may include: obtaining the driver's gaze information through one or more cameras disposed in the wearable device; determining the output location of the blind spot image based on the size of the device disposed in the area where the driver's field of vision needs to be ensured; and outputting the blind spot image by an output device disposed in the wearable device.

[0022] Determining the output location may include determining the output location of the blind spot image based on the distance from the center between one or more cameras to a device positioned in the area where the driver's field of vision needs to be ensured.

[0023] Outputting blind spot images may include adjusting the transparency of the output device based on driving information.

[0024] Obtaining driving information and blind spot images may include: determining the image capture location based on the steering angle, whether the turn signals are on, and the vehicle's position determined based on the driving information, and obtaining the blind spot image at the determined capture location.

[0025] Outputting blind spot images can include: outputting images obtained at the determined shooting location.

[0026] The method may further include: when no blind spot image is obtained and an object is detected within a specified distance from the vehicle, determining the location information of the object, and sending the location information of the object to the wearable device.

[0027] The method may further include: receiving location information of an object by a wearable device, and outputting the location information in one or more forms, such as image, voice and vibration.

[0028] The method may further include: acquiring images of the vehicle's surroundings to generate a panoramic image; calculating the distance from the vehicle to the parking line based on the panoramic image; and sending the distance from the vehicle to the parking line, the vehicle's position, and the parking line to a wearable device.

[0029] The method may also include: outputting the vehicle's position and parking line from the wearable device, and outputting the distance from the vehicle to the parking line. Attached Figure Description

[0030] The above and other objects, features, and advantages of this disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings:

[0031] Figure 1 This is a block diagram illustrating the configuration of a system for controlling a vehicle according to an embodiment of the present disclosure;

[0032] Figure 2 This is a block diagram illustrating the configuration of a vehicle according to an embodiment of the present disclosure;

[0033] Figure 3 This is a schematic diagram illustrating a camera for determining the driver's gaze according to an embodiment of the present disclosure;

[0034] Figure 4 This is a diagram showing the angle and distance from the vehicle to the parking line calculated according to an embodiment of the present disclosure;

[0035] Figure 5 This is a block diagram illustrating the configuration of a wearable device according to an embodiment of the present disclosure;

[0036] Figure 6A and Figure 6B This is a diagram illustrating the input device of a wearable device according to an embodiment of the present disclosure;

[0037] Figure 7 This is a schematic diagram illustrating a camera and output device disposed in a wearable device according to an embodiment of the present disclosure;

[0038] Figure 8 A diagram illustrating the location of markings according to one embodiment of the present disclosure;

[0039] Figure 9 This is a diagram illustrating the distance from the wearable device to the device according to an embodiment of the present disclosure;

[0040] Figure 10 This is a schematic diagram illustrating the output mode of a wearable device according to an embodiment of the present disclosure;

[0041] Figure 11 This is a diagram illustrating the transparency adjustment of a wearable device according to an embodiment of the present disclosure;

[0042] Figure 12 This is a diagram showing the parking lines and vehicle positions output via a wearable device according to an embodiment of the present disclosure;

[0043] Figure 13 This is a flowchart illustrating a method for controlling a vehicle according to an embodiment of the present disclosure;

[0044] Figure 14 This is a flowchart illustrating a method for controlling a vehicle according to another embodiment of the present disclosure; and

[0045] Figure 15 This is a block diagram illustrating a computing system for performing a method according to an embodiment of the present disclosure. Detailed Implementation

[0046] In the following, some embodiments of the present disclosure will be described in detail with reference to the exemplary accompanying drawings. Furthermore, when reference numerals are added to the components of each drawing, the same reference numerals are also used to indicate the same or equivalent components shown in other drawings. Additionally, when describing embodiments of the present disclosure, detailed descriptions of related known configurations or functions will be omitted if it is determined that such configurations or functions interfere with the understanding of the embodiments of the present disclosure.

[0047] In describing components according to embodiments of the present disclosure, terms such as first, second, A, B, (a), (b), etc., may be used. These terms are intended only to distinguish components from other components, and they do not limit the nature, order, or sequence of the components. Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It will be further understood that terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the context of the relevant field and will not be interpreted in an idealized or overly formal sense unless expressly defined herein.

[0048] Figure 1 This is a block diagram illustrating the configuration of a system for controlling a vehicle according to an embodiment of the present disclosure.

[0049] like Figure 1 As shown, the system 100 for controlling a vehicle according to this disclosure may include a vehicle 110 and a wearable device 120.

[0050] Vehicle 110 can transmit blind spot images and driving information outside the driver's field of vision to wearable device 120. According to embodiments of this disclosure, blind spots (areas outside the driver's field of vision due to being covered by the vehicle body) may, for example, include areas outside the driver's field of vision caused by A-pillars located between the front and side windows of vehicle 110. (See also...) Figure 2 Describe the characteristics of vehicle 110 in detail.

[0051] The wearable device 120 can receive images and driving information from the vehicle 110, and output blind spot images based on the driver's driving information and gaze information. According to embodiments of this disclosure, the wearable device 120 can be implemented in the form of glasses worn by the driver. (See also...) Figure 5 The features of wearable device 120 are described in detail.

[0052] Figure 2 This is a block diagram illustrating the configuration of a vehicle according to an embodiment of the present disclosure.

[0053] like Figure 2 As shown, vehicle 110 may include communication device 111, camera 112, sensor 113, storage device 114, navigation device 115, and controller 116.

[0054] The communication device 111 can transmit images and driving information acquired by the camera 112 to the wearable device 120. According to embodiments, the communication device 111 can communicate with the wearable device 120 using various wireless communication schemes (such as Wi-Fi, WiBro, Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), etc.). The communication device 111 can be a hardware device implemented using various electronic circuits for transmitting and receiving signals via, but is not limited to, the wireless connections listed above.

[0055] According to an embodiment of this disclosure, camera 112 can obtain blind spot images by capturing images of the driver's blind spots according to an embodiment of this disclosure. For this purpose, camera 112 can be mounted on the exterior of the A-pillar or the left and right side mirrors. According to an embodiment, images captured by the vehicle's black box can be used as the blind spot images obtained by capturing images of the driver's blind spots.

[0056] In addition, camera 112 can acquire an image of the driver's face to obtain the driver's gaze information. (Refer to...) Figure 3 Describe the details.

[0057] Figure 3 This is a schematic diagram illustrating a camera for determining the driver's gaze according to an embodiment of the present disclosure.

[0058] like Figure 3 As shown, camera 112 can acquire an image of the driver's face, but it can be configured to acquire the area between the driver's lips 4 and eyebrows 1. Therefore, according to an embodiment of this disclosure, camera 112 is most preferably positioned above the upper guard of the steering column.

[0059] Camera 112 can be positioned at a location where an image of the driver's face can be obtained. However, according to embodiments of this disclosure, it is not preferable to position camera 112 on the sun visor because it is not easy to ensure the viewing angle of camera 112 and light enters from the front. Furthermore, it is not preferable to position camera 112 in the interior mirror (vehicle interior mirror) because it is not easy to ensure the driver's left-hand gaze and it is not easy to operate camera 112.

[0060] In addition, cameras 112 can be positioned at the front, rear, left and right sides of vehicle 110 to obtain images of the area around vehicle 110 (such as front, rear, left and right images) to generate panoramic images.

[0061] Sensor 113 can acquire driving information of vehicle 110. According to an embodiment, sensor 113 may include a steering sensor capable of acquiring steering angle information through steering wheel rotation. Furthermore, sensor 113 may include: an azimuth sensor to acquire direction information of vehicle 110 corresponding to the illumination of a turn indicator; a position sensor to acquire position information; and an illuminance sensor to acquire illuminance information around vehicle 110. Additionally, sensor 113 may include radar and lidar for detecting objects around vehicle 110.

[0062] Storage device 114 may store at least one algorithm for calculating or executing various commands for operating a vehicle 110 according to embodiments of the present disclosure. Storage device 114 may include, but is not limited to, at least one storage medium selected from flash memory, hard disk, memory card, read-only memory (ROM), random access memory (RAM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0063] The navigation device 115 may include a GPS receiver for receiving the current location of the vehicle 110, and may provide map image information of a specified area based on the current location of the vehicle 110, vehicle speed information, destination information, etc.

[0064] The controller 116 can be implemented using various processing devices such as processors (e.g., computers, microprocessors, CPUs, ASICs, circuits, logic circuits, etc.), in which semiconductor chips capable of executing various commands are embedded, and according to embodiments of the present disclosure, the controller 116 can control the operation of the vehicle 110.

[0065] The controller 116 can determine whether a mode for outputting blind spot images to the wearable device 120 is set. When it is determined that the mode for outputting blind spot images to the wearable device 120 is set, the controller 116 can determine whether a route to the destination has been set in the navigation device, and when it is determined that a route to the destination has been set, the controller 116 can determine whether the vehicle 110 has entered a specific area. In this case, the specific area may include areas where the driver is required to see the blind spot, and may include, for example, intersections, left and right turning sections, pedestrian protection zones, etc.

[0066] When the vehicle 110 is determined to enter a specific area, the controller 116 can determine the shooting position of the blind spot image obtained by the camera 112 based on the steering angle and whether the turn indicator is on. The steering angle is determined based on driving information, and the blind spot image obtained at the determined shooting position can be sent to the wearable device 120.

[0067] According to the implementation, when the vehicle 110 operates its turn indicator to change lanes, a camera positioned in the side mirror in the direction the vehicle 110 intends to move can be operated to capture a blind spot image. For example, when the right turn indicator is operated, the controller 116 can determine the shooting position as the camera positioned in the right side mirror, control the camera in the right side mirror to acquire a blind spot image, and send the acquired blind spot image to the wearable device 120.

[0068] In addition, the controller 116 can determine whether the steering angle of the vehicle 110 exceeds a reference value. When the steering angle of the vehicle 110 exceeds the reference value, the controller 116 can operate the camera installed in the A-pillar in the direction in which the vehicle 110 intends to turn, control the camera to obtain a blind spot image, and send the obtained blind spot image to the wearable device 120.

[0069] When it is determined that no route to the destination is set in the navigation device 115, the controller 116 can determine whether the vehicle 110 has entered a pedestrian area, whether the steering angle exceeds a reference value, and whether the turn signals are on. Additionally, the controller 116 can determine the image capture location based on the determination results and control the camera 112 to acquire a blind spot image at the determined location. Furthermore, the controller 116 can control the transmission of the blind spot image acquired by the camera 112 at the determined location to the wearable device 120.

[0070] According to embodiments of this disclosure, the controller 116 can acquire a blind spot image and send it to the wearable device 120. Furthermore, when a blind spot image is not acquired, the controller 116 can send location information of objects detected in the blind spot.

[0071] When an object is determined to be within a first specified distance from vehicle 110, controller 116 can determine that an object has been detected in the blind spot and send location information indicating that the object is within the first specified distance from vehicle 110 to wearable device 120. In this case, the location information may include information about whether the object is located on the right or left side of vehicle 110, and the distance between the object and vehicle 110.

[0072] According to embodiments of this disclosure, the controller 116 can generate a panoramic image by acquiring images of the surroundings of the vehicle 110, and calculate the distance from the vehicle 110 to the parking line based on the panoramic image. (Refer to...) Figure 4 Describe the details.

[0073] Figure 4 This is a diagram showing the angle and distance from the vehicle to the parking line calculated according to an embodiment of the present disclosure.

[0074] like Figure 4As shown, controller 116 can calculate the distance "A" or "B" from the driver's seat handle or passenger seat handle to the parking line. Furthermore, when vehicle 110 is not parallel to the parking line, controller 116 can calculate the angle "α" between the outermost edge of vehicle 110 and the parking line. Additionally, controller 116 can send the distances "A" and "B" from vehicle 110 to the parking line to wearable device 120, or send the angle "α" between vehicle 110 and the parking line to wearable device 120.

[0075] Figure 5 This is a block diagram illustrating the configuration of a wearable device according to an embodiment of the present disclosure.

[0076] like Figure 5 As shown, the wearable device 120 may include a communication device 121, an input device 122, a camera 123, an output device 124, a storage device 125, and a controller 126.

[0077] The communication device 121 can receive blind spot images and driving information obtained by the vehicle 110. According to embodiments, the communication device 121 can communicate with the vehicle 110 using various wireless communication schemes (such as Wi-Fi, WiBro, Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), etc.). The communication device 121 can be a hardware device implemented with various electronic circuits for transmitting and receiving signals via, but is not limited to, the wireless connections listed above.

[0078] Input device 122 can receive input signals corresponding to driver manipulation, movement, or voice, and controller 126 can activate at least one function in response to the input signal. According to embodiments, input device 122 can be implemented as a button, touchpad, etc., operable by a driver or passenger, or at least one of a motion sensor and a voice recognition sensor that detects passenger movement (gestures) and voice, or a combination thereof. (See also...) Figure 6A and Figure 6B Describe the details.

[0079] Figure 6A and Figure 6B This is a diagram illustrating the input device of a wearable device according to an embodiment of the present disclosure.

[0080] According to embodiments of this disclosure, the input device 122 can be disposed on the left temple 120c and the right temple 120c of the glasses, and the input device 122 may include, for example: Figure 6A The touch mode input device 122a shown is a touch-sensitive input device for sensing the driver's touch input and, as shown, a touch mode ... Figure 6BThe sliding mode input unit 122b shown is for sensing the driver's touch swipe. The click mode input device 122a and the sliding mode input unit 122b are arranged separately.

[0081] Cameras 1, 2, and 3 can obtain information about the driver's gaze. For details, please refer to... Figure 7 Describe the features of camera 123. Figure 7 This diagram schematically illustrates a camera and output device provided in a wearable device according to an embodiment of the present disclosure. According to the embodiment, such as... Figure 7 As shown, based on the driver's attire, camera 123 may include a first camera 123L disposed on the upper left end of the eyeglasses frame 120a and a second camera 123R disposed on the upper right end of the eyeglasses frame 120a.

[0082] The output device 124 can output blind spot images received from the vehicle 110. For this purpose, as... Figure 7 As shown, the output device 124 can be disposed in the lens portion 120b of the eyeglasses. Furthermore, according to an embodiment of this disclosure, the output device 124 can output position information of objects around the vehicle 110 received from the vehicle 110. In this case, the position information of the objects can be output through the lens portion via separate identification markers (images), but is not limited thereto. Although not shown, it can be output through the left and right leg positions (of the eyeglasses frame 120a). Figure 6A and Figure 6B The speaker or vibration output device in 120c) outputs position information. Therefore, the output device 124 according to the embodiments of this disclosure may include, but is not limited to, the lens portion 120b of the eyeglasses, the speaker, and the vibration output device.

[0083] According to embodiments of the present disclosure, the lens portion 120b may include a thin film comprising a polymer-dispersed liquid crystal layer (PDLC).

[0084] Storage device 125 may store operations or at least one algorithm for executing different commands for operating a wearable device according to embodiments of the present disclosure. Storage device 125 may include, but is not limited to, at least one storage medium selected from flash memory, hard disk, memory card, read-only memory (ROM), random access memory (RAM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0085] The controller 126 may be implemented using various processing devices such as processors (e.g., computers, microprocessors, CPUs, ASICs, circuits, logic circuits, etc.), which embed semiconductor chips capable of executing various commands, and may control the operation of the wearable device 120 according to embodiments of the present disclosure.

[0086] The controller 126 can change the operating mode based on the touch of the input device 122. According to an embodiment, the controller 126 can change the operating mode when the input device 122 is touched for a specified time or longer. According to embodiments of this disclosure, the operating mode may include an image output mode, an audio output mode, a vibration output mode, a call mode, etc.

[0087] Controller 126 can receive signals from the navigation device ( Figure 1 The controller 126 can receive the blind spot image obtained by the vehicle 110 and output the blind spot image received from the vehicle 110 through the output device 124. When no blind spot image is obtained from the vehicle 110, the controller 126 can receive the position information of objects around the vehicle 110 and control the output device 124 to output the position information in one or more forms, such as image, sound, and vibration. In addition, the controller 126 can activate a call mode to perform a call function.

[0088] According to embodiments of this disclosure, when the image output mode is activated, the click mode input device (…) Figure 6A When inputting once via mode input device 122a, controller 126 can control the image output mode to be turned on / off, and when inputting twice, controller 126 can control the images output to the left lens portion and the right lens portion respectively.

[0089] In addition, when the call mode is activated, the mode input device is clicked ( Figure 6A When input 122a) is made once, controller 126 can initiate a call and terminate the call when input is made twice. Furthermore, when the sliding mode input unit (122a) is activated simultaneously with the call mode, the controller can also initiate a call. Figure 6B When 122b) is in use, controller 126 can increase or decrease the call volume.

[0090] The controller 126 can output images received from the vehicle 110 via the output device 124, but when recognizing a marker set in at least one position preset by the driver, it can output an image in the space corresponding to the position of the marker. (Refer to...) Figure 8 Describe the details.

[0091] Figure 8 A diagram illustrating the location of markers according to one embodiment of the present disclosure.

[0092] like Figure 8As shown, according to an embodiment of the present disclosure, the first mark M1 may be located on the left A-pillar of the vehicle 110, the second mark M2 may be located on the navigation device of the vehicle 110, and the third mark M3 may be located on the right A-pillar of the vehicle 110.

[0093] When camera 123 identifies a marker located in vehicle 110 at at least one preset position corresponding to the driver's gaze, controller 126 can output an image to the space corresponding to the position of the identified marker.

[0094] For example, when camera 123 recognizes Figure 8 When the camera 123 identifies the first marker M1, the controller 126 can output the image (received from the vehicle 110) to the first space (space 1) corresponding to the position of the first marker M1. Similarly, when the camera 123 identifies the second marker M2, the controller 126 can output the image (received from the vehicle 110) to the second space (space 2) corresponding to the position of the second marker M2. When the camera 123 identifies the third marker M3, the controller 126 can control the output of the image (received from the vehicle 110) to the third space (space 3) corresponding to the position of the third marker M3. When the images output to the second and third spaces overlap in the driver's gaze direction, the controller 126 can determine, based on the space priority set by the driver, to fix the position of the space with higher priority and determine the position to move the remaining space.

[0095] As in Figure 8 As shown in “A”, when an image is output to a space corresponding to the location of the identified marker and the image obscures a device (e.g., dashboard) located in an area that must ensure the driver’s field of vision, the controller 126 can determine the location of the space (the location of the output image) so that the location does not cover the device because this violates the law.

[0096] According to embodiments of this disclosure, controller 126 can determine the position of the output image based on the distance from camera 123 to the dashboard and the size of the dashboard. (Refer to...) Figure 9 Describe the details.

[0097] Figure 9 This is a diagram showing the distance from the wearable device to the device according to an embodiment of the present disclosure.

[0098] like Figure 9As shown, controller 126 can calculate the distance "B" between the first camera 123L and the second camera 123R. Furthermore, controller 126 can calculate "x" and "x'" based on the points where the lines connecting the first camera 123L to device 800 and the second camera 123R to device 800 intersect with the lines connecting the focal points of the first camera 123L and the second camera 123R, respectively. Using the "x", "x'", "B", and "f" calculated in the above manner, controller 126 can calculate the distance "R" from the center between the first camera 123L and the second camera 123R to device 800 based on Equation 1, where f is the focal length.

[0099] [Equation 1]

[0100] x-x'=B*f / R

[0101] The controller 126 can determine the position of the output image based on the distance "R" calculated by Equation 1 and the size of the device.

[0102] As in Figure 8 As shown in “A”, when an image is output to a space corresponding to the location of the identified marker and the image obscures a device (e.g., dashboard) located in an area where the driver’s field of vision must be ensured, the controller 126 can adjust the transparency of the image to prevent the device from being obscured by the image.

[0103] When no blind spot image is received from vehicle 110, controller 126 can control the output of the position information of objects detected in the blind spot received from vehicle 110 in one or more forms: image, voice, and vibration. (See reference...) Figure 10 Describes details of blind spot images or object location information received from vehicle 110.

[0104] Figure 10 This is a diagram schematically illustrating the output mode of a wearable device according to an embodiment of the present disclosure.

[0105] like Figure 10 As shown, the controller 126 can output distance information 910 of devices (e.g., instrument panel) located in an area where the driver's field of vision must be ensured through the output device (lens portion), as well as an image 920 showing the position information of objects. Although not shown, the controller 126 can output in one or more forms, such as voice and vibration. Figure 10 Image 920 and the location information of the object.

[0106] The controller 126 can adjust the transparency of the output device (lens device) based on driving information received from the vehicle 110. When the illuminance value of the vehicle 110 exceeds a threshold, the controller 126 can control the lens device to be opaque and function as sunglasses by adjusting the transparency. According to embodiments of this disclosure, the lens device may include a polymer-dispersed liquid crystal layer (PDLC), and the PDLC can change its liquid crystal transmittance in response to an applied voltage. Therefore, the controller 126 can adjust the transparency by applying a voltage to the lens device using the characteristics of the PDLC. (Refer to...) Figure 11 Describe the details.

[0107] Figure 11 This is a diagram illustrating the transparency adjustment of a wearable device according to an embodiment of the present disclosure.

[0108] like Figure 11 As shown, the controller 126 can adjust the transparency of the lens device based on driving information (illuminance information) received from the vehicle 110. According to an embodiment, the controller 126 can divide the transparency into four stages by bundling the illumination stages (1 to 20) of the vehicle 110 corresponding to the illumination information of the vehicle 110 according to specified stages (e.g., five stages), and adjust the transparency accordingly. Furthermore, by providing a transparency adjustment section, the controller 126 can prevent the transparency from frequently changing between transparency stages. For example, when the illumination value of the vehicle 110 changes and the illumination stage of the vehicle 110 changes from stage 5 to stage 6, the transparency of the lens device does not change from stage 1 to stage 2; instead, when the illumination stage of the vehicle 110 changes to stage 7, the transparency of the lens device changes from stage 1 to stage 2. Therefore, the controller 126 can prevent frequent changes in transparency, thereby reducing driver eye fatigue.

[0109] In addition to the above-described scheme for controlling the transparency of the lens device, the controller 126 can also store transparency according to the driver's preference and adjust the transparency of the lens device according to the driver's preference.

[0110] The controller 126 can receive from the vehicle 110 the distance to the parking line and the angle between the vehicle 110 and the parking line calculated based on the panoramic image generated from the vehicle 110, and can output the distance and angle through an output device (lens device). (See reference...) Figure 12 Describe the details.

[0111] Figure 12 This is a diagram showing the parking line and the position of the vehicle output via a wearable device according to an embodiment of the present disclosure.

[0112] like Figure 12As shown, when the distance between vehicle 110 and the parking line is received from vehicle 110, controller 126 can output the vehicle line (vehicle line) L1 and the parking line L2 located on vehicle 110 in different colors, allowing the driver to visually identify them. According to an embodiment, when the driver is wearing the wearable device and looking to the right, controller 126 can output the red vehicle line L1 and the white parking line L2, allowing the driver to visually identify them. Furthermore, controller 126 can output the distance between vehicle line L1 and parking line L2 together.

[0113] Figure 13 This is a flowchart illustrating a method for controlling a vehicle according to an embodiment of the present disclosure.

[0114] like Figure 13 As shown, vehicle 110 can determine whether wearable device 120 is set to image output mode. In S110, when wearable device 120 is set to image output mode, vehicle 110 can determine whether a route to the destination has been set in the navigation device.

[0115] In S120, when a route (Y) to the destination has been set in the navigation device, in S160, vehicle 110 can determine whether vehicle 110 has entered a specific area. In S160, the specific area may include areas requiring the driver's blind spot vision, and may include, for example, intersections, left-turn sections and right-turn sections, pedestrian protection zones, etc.

[0116] In S160, when it is determined that the vehicle 110 has entered a specific area (Y), in S170, the vehicle 110 can determine and obtain the shooting position of the blind spot image obtained by the camera 112 based on the steering angle and whether the turn indicator is on, and can send the blind spot image obtained at the determined shooting position to the wearable device 120.

[0117] According to the implementation, in S170, when the vehicle 110 operates the vehicle 110's turn indicator to change lanes, a camera positioned in the side mirror in the direction the vehicle 110 intends to move can be controlled to capture a blind spot image. For example, when the right turn indicator is operated, the vehicle 110 can determine the camera positioned in the right side mirror, control the camera in the right side mirror to obtain a blind spot image, and send the obtained blind spot image to the wearable device 120.

[0118] Furthermore, in S170, vehicle 110 can determine whether the steering angle of vehicle 110 exceeds a reference value. When the steering angle of vehicle 110 exceeds the reference value, vehicle 110 can operate a camera installed in the A-pillar in the direction in which vehicle 110 intends to turn, control the camera to obtain a blind spot image, and send the obtained blind spot image to wearable device 120.

[0119] When the wearable device 120 receives a blind spot image from the vehicle 110, in S180, the wearable device 120 can determine the location where the received image should be output based on the driver's gaze information, and control the output of the image to the determined location. In S180, the wearable device 120 can refer to... Figures 8 to 12 The described method controls the output of images received from vehicle 110.

[0120] In S120, when it is determined that no route (N) to the destination is set in the navigation device, vehicle 110 can determine whether vehicle 110 has entered a pedestrian area (S130), whether the steering angle exceeds a reference value (S140), and whether the turn indicator light is on (S150). Additionally, controller 116 can determine the image capture position based on the determined results and control camera 112 to acquire a blind spot image at the determined position. Furthermore, vehicle 110 can control the transmission of the blind spot image acquired by camera 112 at the determined position to wearable device 120.

[0121] In S170, when no blind spot image is obtained, vehicle 110 can send the location information of objects detected in the blind spot. (Refer to...) Figure 14 Describe the details.

[0122] Figure 14 This is a flowchart illustrating a method for controlling a vehicle according to another embodiment of the present disclosure.

[0123] like Figure 14 As shown, when it is determined in S210 that no blind spot image has been obtained, in S220, the vehicle 110 can detect objects around the vehicle and determine the position of the objects.

[0124] In S230, vehicle 110 can determine whether the detected object is close to the vehicle. When it is determined that the detected object is close to the vehicle (Y), in S240, vehicle 110 can determine whether the object is within a first specified distance from the vehicle.

[0125] In S240, when it is determined that the object is within a first specified distance (Y) from the vehicle, in S250, the vehicle 110 can determine that the object is in the blind spot and send the object's location information to the wearable device.

[0126] When the wearable device 120 receives the location information of the object from the vehicle 110, in S260, the wearable device 120 can output the location of the object in one or more forms, such as image, voice and vibration.

[0127] If it is determined in S240 that the target is not within the first specified distance from the vehicle (No), in S270, the vehicle 110 may determine whether the target is outside the second specified distance from the main vehicle. In this case, the value of the first specified distance may be less than the value of the second specified distance.

[0128] In S270, when it is determined that the target is beyond the second specified distance (Y) from the vehicle, the vehicle may terminate the operation. In S270, when it is determined that the target is not beyond the second specified distance from the vehicle, the vehicle may execute S220.

[0129] Figure 15 This is a block diagram illustrating a computing system for performing a method according to an embodiment of the present disclosure.

[0130] Reference Figure 15 The computing system 1000 may include at least one of a processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, a storage device 1600, and a network interface 1700 connected via a bus 1200.

[0131] Processor 1100 may be a central processing unit (CPU) or semiconductor device that processes instructions stored in memory 1300 and / or storage device 1600. Memory 1300 and storage device 1600 may include various types of volatile or non-volatile storage media. For example, memory 1300 may include read-only memory (ROM) 1310 and random access memory (RAM) 1320.

[0132] Therefore, the processes of the methods or algorithms described in conjunction with embodiments of this disclosure can be directly implemented by hardware, software modules, or combinations thereof executed by processor 1100. Software modules may reside in storage media (i.e., memory 1300 and / or storage device 1600), such as RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, solid-state drive (SSD), removable disk, or CD-ROM. An exemplary storage medium is coupled to processor 1100, and processor 1100 can read information from and write information to the storage medium. In another approach, the storage medium may be integrated with processor 1100. The processor and storage medium may reside in an application-specific integrated circuit (ASIC). The ASIC may reside in a user terminal. In yet another approach, the processor and storage medium may reside as separate components in the user terminal.

[0133] The system and method for controlling a vehicle according to embodiments of the present disclosure can improve user convenience by outputting blind spot images of the vehicle at locations desired by the driver, and can help the driver identify objects located in the blind spot, thereby contributing to safe driving.

[0134] Although exemplary embodiments of this disclosure have been described for illustrative purposes, those skilled in the art will recognize that various modifications, additions, and substitutions are possible without departing from the scope and spirit of this disclosure.

[0135] Therefore, the exemplary embodiments disclosed in this disclosure are provided for descriptive purposes and not for limiting the technical concepts of this disclosure, and it should be understood that these exemplary embodiments are not intended to limit the scope of the technical concepts of this disclosure. The scope of protection of this invention should be determined by the scope of the appended claims, and all technical concepts within the equivalent scope should be determined by the scope of the appended claims.

Claims

1. A system for controlling a vehicle, the system comprising: The vehicle is configured to acquire driving information and blind spot images, and to transmit the driving information and the blind spot images; as well as A wearable device is configured to receive the driving information and the blind spot image from the vehicle, and to output the blind spot image based on the driving information and the driver's gaze information. When the wearable device identifies a mark placed in at least one location preset by the driver, the wearable device outputs the blind spot image in the space corresponding to the at least one location of the identified mark.

2. The system according to claim 1, wherein, The wearable device includes: One or more cameras are configured to acquire the driver's gaze information; An output device is configured to output the blind spot image; and The controller is configured to determine the output location of the blind spot image based on the size of a device positioned in the area where the driver's field of vision needs to be ensured.

3. The system according to claim 2, wherein, The controller is configured to determine the output position of the blind spot image based on the distance from the center position between the one or more cameras to the device positioned in the area where the driver's field of vision needs to be ensured.

4. The system according to claim 2, wherein, The controller is configured to adjust the transparency of the output device based on the driving information.

5. The system according to claim 1, wherein, The vehicle is configured to determine the location for capturing the blind spot image based on the steering angle, whether the turn indicator lights are on, and the vehicle's position determined based on the driving information.

6. The system according to claim 5, wherein, The wearable device is configured to be controlled to output the blind spot image obtained at the determined shooting location.

7. The system according to claim 1, wherein, The vehicle is configured to send the location information of the object to the wearable device when the blind spot image is not obtained and an object is detected within a specified distance from the vehicle.

8. The system according to claim 7, wherein, The wearable device is configured to receive the location information of the object and output the location information in one or more forms, such as image, voice, and vibration.

9. The system according to claim 1, wherein, The vehicle is configured to acquire images of its surroundings to generate a panoramic image; The distance from the vehicle to the parking line is calculated based on the panoramic image; and the distance from the vehicle to the parking line, the position of the vehicle and the parking line are sent to the wearable device.

10. The system according to claim 9, wherein, The wearable device is configured to output the positions of the vehicle and the parking line, and to output the distance from the vehicle to the parking line.

11. A method for controlling a vehicle, the method comprising: The vehicle obtains driving information and blind spot images; The vehicle sends the driving information and the blind spot image to the wearable device; The wearable device receives the driving information and the blind spot image from the vehicle; and The wearable device outputs the blind spot image based on the driving information and the driver's gaze information. When the wearable device identifies a mark placed in at least one location preset by the driver, the wearable device outputs the blind spot image in the space corresponding to the at least one location of the identified mark.

12. The method according to claim 11, wherein, Outputting the blind spot image includes: The driver's gaze information is obtained by one or more cameras installed in the wearable device; The output position of the blind spot image is determined based on the size of a device positioned in the area where the driver's field of vision needs to be ensured; and The blind spot image is output by an output device provided in the wearable device.

13. The method according to claim 12, wherein, Determining the output position includes: The output position of the blind spot image is determined based on the distance from the center position between the one or more cameras to the device positioned in the area where the driver's field of vision needs to be ensured.

14. The method according to claim 12, wherein, Outputting the blind spot image includes: The transparency of the output device is adjusted based on the driving information.

15. The method according to claim 11, wherein, Obtaining the driving information and the blind spot image includes: The location for capturing the blind spot image is determined based on the steering angle, whether the turn signals are on, and the vehicle's position as determined by the driving information; and The blind spot image is obtained at the determined shooting location.

16. The method according to claim 15, wherein, The output blind spot image includes: Output the blind spot image obtained at the determined shooting location.

17. The method of claim 11, further comprising: When the blind spot image is not obtained and an object is detected within a specified distance from the vehicle, the location information of the object is determined; and The location information of the object is sent to the wearable device.

18. The method of claim 17, further comprising: The wearable device receives the location information of the object, and The wearable device outputs the location information in one or more forms, namely, image, voice, and vibration.

19. The method of claim 11, further comprising: Images of the vehicle's surroundings are obtained from the vehicle to generate a panoramic image; The distance from the vehicle to the parking line is calculated by the vehicle based on the panoramic image; and The vehicle transmits the distance from the vehicle to the parking line, the position of the vehicle, and the position of the parking line to the wearable device.

20. The method of claim 19, further comprising: The wearable device outputs the positions of the vehicle and the parking line, and also outputs the distance from the vehicle to the parking line.

Images