DEVICE AND METHOD FOR OUTPUTTING A PROJECTION OF A VEHICLE

Abstract

A device for outputting a projection of a vehicle comprises a control unit configured to convert an image received from an image receiving unit of the vehicle into binary data and to control a projection output unit of the vehicle to output a projection pattern based on the binary data.

Description

BACKGROUND 1. AREA

[0001] The present disclosure relates to a device and a method for outputting a projection of a vehicle. 2. DESCRIPTION OF THE STATE OF THE ART

[0002] Recently, projection lamps, which can emit a projection, have become increasingly common in vehicles. Compared to other lamp types, projection lamps can emit light with minimal scattering over long distances, effectively providing visual information to the driver or those in the vehicle's vicinity (e.g., other vehicles on the road or pedestrians). For example, a projection lamp mounted on the vehicle can project an image (and / or a message) onto a road surface, and the projected image can positively impact the driver's efficiency (e.g., obstacle detection efficiency) or the safety of those around the vehicle (e.g., vehicle detection speed).

[0003] However, such a projection may be partially obscured, distorted, or squashed by a structure surrounding the vehicle, which may impair the projection's ability to provide visual information.

[0004] The statements in this section merely provide background information to the present disclosure and do not represent prior art. OVERVIEW

[0005] The present disclosure provides a device and a method for outputting a projection of a vehicle which can improve the performance of the provision of visual information by outputting a projection pattern adapted to a structure outside the vehicle.

[0006] According to one aspect of the present disclosure, a device for outputting a projection of a vehicle is provided. The device comprises: a control unit configured to convert an image received from an image receiver of the vehicle into binary data, and further configured to control a projection output unit of the vehicle to output a projection pattern based on the binary data.

[0007] According to another aspect of the present disclosure, a method for outputting a projection of a vehicle comprises: receiving an image outside the vehicle; converting the received image into binary data; and controlling a light source and / or an optical system to output a projection pattern from the vehicle to the outside based on the converted binary data.

[0008] According to another aspect of the present disclosure, a non-volatile, computer-readable medium contains one or more programs, including instructions for directing a processor to perform a method for outputting a projection of a vehicle. The method comprises: receiving an image from outside the vehicle; converting the received image into binary data; and controlling at least one light source or optical system to output a projection pattern from the vehicle to the outside based on the converted binary data. BRIEF DESCRIPTION OF THE DRAWING FIGURES

[0009] The above and other aspects, features and advantages of the present disclosure should be more clearly understood from the following detailed description in conjunction with the accompanying drawing figures, in which: Fig. 1A and Fig. 1B Views are showing a device for outputting a projection of a vehicle according to an embodiment of the present disclosure; Fig. Figures 2A-2C are views illustrating that by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure, an image is converted into binary data; Fig. 2D is a view illustrating that a projection pattern is output based on the binary data by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. 3A and Fig. 3B are views showing a process of detecting an edge from an image by the device and the method of outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figure 4 is a view illustrating the pixel matching processing performed by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figure 5A is a view showing that a projection output unit is controlled by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figure 5B is a view showing a method for controlling an optical system of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. 5C is a view showing a method for controlling a light source of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. 5D is a view illustrating a method for scanning a plurality of pixels of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figures 6A-6D are views showing an on / off time period of the projection pattern in the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. 7 is a flowchart showing a method for outputting a projection of a vehicle according to an embodiment of the present disclosure; Fig. 8A and Fig. Figure 8B are flowcharts illustrating that the light source is controlled based on the illuminance outside the vehicle and the projection pattern is output by the device and method for outputting a projection of a vehicle in response to a change in whether the door is open or closed, according to the embodiments of the present disclosure; and Fig. Figure 9 is a flowchart illustrating that the projection pattern is output by the device and method for outputting a vehicle projection in response to a transmission manipulation and an engine start manipulation according to the embodiments of the present disclosure.

[0010] The drawings described here are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure in any way. DETAILED DESCRIPTION

[0011] The present disclosure can be modified in various ways and has several embodiments. Therefore, certain exemplary embodiments of the present disclosure are shown in the accompanying drawings and described in detail. However, it is understood that the present disclosure is not limited to specific embodiments and includes all modifications, equivalents, and substitutions contained in the idea and scope of protection of the present disclosure.

[0012] Terms such as "first" and "second" may be used to describe different components, and the components are not to be interpreted as being limited by these terms. These terms are used only to distinguish one component from another. For example, a first component may be called a second component, and the second component may similarly be called a first component, without this exceeding the scope of the present disclosure. The term "and / or" includes a combination of several related elements or one of the several related elements.

[0013] The terms used in this description serve only to describe the specific embodiments and do not limit the present disclosure. A singular term may include the plural unless expressly stated otherwise in the context. Furthermore, it is understood that terms such as "comprise," "include," and the like, used in this description (specification), indicate the presence of features, numbers, processes, operations, components, parts mentioned in the specification, or combinations thereof, and do not preclude the presence or addition of one or more other features, numbers, processes, operations, components, parts, or combinations thereof.Insofar as a component, device, element or the like is described in the present disclosure as pursuing a purpose or performing a process, function or the like, the component, device or element should here be considered to be "configured" to fulfill that purpose or to perform that process or function.

[0014] Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meanings as those generally understood by persons with normal expertise in the field to which this disclosure relates. Terms commonly used and defined in a dictionary should be interpreted as having the same meaning as in the context of the relevant field and should not be interpreted as having ideal or overly formal meanings unless they are clearly defined differently in this specification.

[0015] In the present disclosure, each of the phrases such as “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, “at least one of A, B or C” and “at least one of A, B or C or a combination thereof” can include any or all possible combinations of the elements listed together in the corresponding phrase.

[0016] In this disclosure, "vehicles" (including electric vehicles) refers to various types of vehicles that move a transported object, such as a person, animal, or item, from a starting point to a destination. The term "vehicles" is not limited to vehicles that travel on a road or railway track.

[0017] The embodiments of the present disclosure are described in more detail below with reference to the accompanying drawings.

[0018] Fig. 1A and Fig. Figure 1B are views showing a device for outputting a projection of a vehicle according to an embodiment of the present disclosure. With reference to the Fig. 1A and Fig. 1B, a device 100 for outputting a projection of a vehicle according to an embodiment of the present disclosure may comprise a control unit 120, an image receiving unit 110 and / or a projection output unit 130.

[0019] The image receiving unit 110 can be located inside the vehicle and receive an image from outside the vehicle. For example, the image receiving unit 110 can gather visual information from the environment outside the vehicle using at least one camera. In other words, the image receiving unit 110 can include at least one camera that captures the exterior of the vehicle and receives the image in a direction opposite to the direction in which the projection output unit 130 outputs a projection pattern (e.g., in front of the vehicle). For example, the detection range (e.g., the field of view) of at least one camera can be adjusted to be close to the output range of the projection pattern of the projection output unit 130.One or more cameras can be implemented, for example, as a multitude of cameras in an autonomous driving system, a multitude of cameras in a 360° surveillance system, or a multitude of cameras in a surround-view surveillance system. The use of one or more cameras is not limited to these examples. The image receiving unit 110 can be positioned next to the projection output unit 130 or integrated into the projection output unit 130, depending on the configuration.

[0020] The projection output unit 130 can output the projection pattern. The projection pattern output by the projection output unit 130 can display a projection with a degree of specificity that allows a driver or the vehicle's surroundings (e.g., other vehicles on the road or a pedestrian) to recognize the projection pattern as specific visual information. The projection output unit 130 can, for example, include a light source and / or an optical system controlled to ensure the sharpness of a boundary (e.g., a light-dark boundary) of the output projection pattern. The projection output unit 130 can, for example, be a projection lamp arranged in the vehicle as a headlight, but is not limited to this.

[0021] The control unit 120 can convert the image received by the image receiver 110 into binary data and control the projection output unit 130 to output the projection pattern based on this binary data. The image received by the image receiver 110 can contain real-time structure / environment information outside the vehicle. This binary data can be a simplified version of the real-time structure / environment information. Therefore, the control unit 120 can efficiently reflect the real-time structure / environment information outside the vehicle in the projection pattern output by the projection output unit 130, and the projection device 100 can improve the visual information delivery performance of the projection by outputting the projection pattern adapted to a structure outside the vehicle.

[0022] For example, the detection of surrounding objects in the image received by the image receiver 110 can be implemented by the control unit 120, which converts the image into binary data. The real-time structure / environment information outside the vehicle can be variable, and accordingly, the projection pattern based on the binary data, which simplifies the real-time structure / environment information outside the vehicle, can also be variable and adaptive. In other words, the projection output unit 130 can output the variable (and / or adaptive) projection pattern.

[0023] Referring to Fig. 1A The control unit 120 can contain an image processing control 121 and / or a drive control 122. The image processing control 121 can convert the image received from the image receiving unit 110 into binary data, and the drive control 122 can control the projection output unit 130 to output the projection pattern based on the binary data.

[0024] As in Fig. As shown in Figure 1B, the control unit 120 can be implemented in the form of a computing device 500. The computing device 500 can, for example, include a processor 501, a computer-readable storage medium 502, a communication bus 503, an input / output device 504, an input / output interface 505, and a network communication interface 506. The computing device 500 can be implemented as a microcontroller. The computing device 500 can be implemented in such a way that, based on its design, it performs only predefined operations, like an embedded system.

[0025] Fig. 2A, Fig. 2B and Fig. Figure 2C are views illustrating that the image is converted into binary data by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; and Fig. 2D is a view illustrating that the projection pattern based on the binary data is output by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure.

[0026] With reference to the Fig. From 1A to 2D, the control unit 120 can recognize binary data EDG from an image IMG received by the image receiver unit 110, and the BIN1 and BIN2 parts of the binary data EDG can consist of 0 and 1. The control unit 120 can output a projection pattern PAT_OUT based on the binary data EDG.

[0027] The binary data can contain the binary data (consisting of 0 or 1) from each of the plurality of pixels in a matrix, and the control unit 120 can control the projection output unit 130 to output the projection pattern PAT_OUT, the activation / deactivation of which is determined in response to the binary data (consisting of 0 or 1) from each of the plurality of pixels. The matrix can specify a structure in which the binary data (consisting of 0 or 1) are arranged in two-dimensional units at equal intervals; the rows and columns of the matrix can be perpendicular to each other; one of the rows and columns can be arranged in a vertical direction, and the other of the rows and columns can be arranged in a horizontal direction.

[0028] The image captured by the camera of the image receiving unit 110 can also contain the multitude of pixels in the matrix structure. Therefore, the image processing control 121 of the control unit 120 can generate the multitude of pixels whose binary values ​​are determined based on a pixel value (e.g., brightness, luminance, saturation) of each of the multitude of pixels in the image, thereby generating the binary data (consisting of 0 or 1).

[0029] For example, the control unit 120 can detect an edge based on a change in the pixel value of each of the plurality of pixels in the image received by the image receiver unit 110 and generate the binary data based on the edge. For example, the change in pixel value can be implemented as a spatial frequency of each of the plurality of pixels, and the image processing control 121 of the control unit 120 can generate a spatial frequency value of each of the plurality of pixels by performing a discrete Fourier transform or a discrete cosine transform on the image.

[0030] For example, the difference in pixel values ​​on either side of an object's boundary in the image can be large, and the difference in spatial frequency between the boundary of each object in the image and the rest of it can also be large. The control unit 120 can detect a group of pixels whose spatial frequency falls within a certain range as an edge.

[0031] With reference to Fig. 1A and Fig. In 2D, the control unit 120 can control the projection output unit 130 to output the projection pattern PAT_OUT, which is intended to turn on one of the pixels corresponding to the edge and to turn off the other pixels not corresponding to the edge. Turning on and off can correspond to 1 and 0 in the binary data, and the control unit 122 of the control unit 120 can therefore determine whether light should be output to each of the multiple pixels in the projection pattern output area of ​​the projection output unit 130 in response to the binary data, and control the projection output unit 130 based on this determination of whether light should be output.

[0032] For example, the projection output unit 130 can emit light with high rectilinearity at a position corresponding to a group of pixels that are turned on among the multitude of pixels, and cannot emit light at a position corresponding to a group of pixels that are turned off among the multitude of pixels. Accordingly, the control unit 120 can control the projection output unit 130 to output the projection pattern PAT_OUT, which has the same shape as at least part of the edge.

[0033] The image received by the image receiver 110 can contain real-time structure / environment information outside the vehicle. The edge can correspond to this real-time structure / environment information and can therefore be variable (and / or adaptive). The projection pattern PAT_OUT, which has the same shape as at least part of the edge, can also be variable (and / or adaptive). For example, the variable (and / or adaptive) projection pattern PAT_OUT can be implemented to resemble an animation. Therefore, the control unit 120 can control the projection output unit 130 as if it were playing the animation through the projection output unit 130.

[0034] Fig. 3A and Fig. Figure 3B shows a process of detecting the edge from the image by the device and the method of outputting a projection of a vehicle according to the embodiments of the present disclosure.

[0035] With reference to Fig. 1A and Fig. 3A allows the control unit 120 to generate an image FIT from which noise is removed from the image IMG. For example, the image processing control 121 of the control unit 120 can generate the image FIT from which noise is removed by applying a filter such as Gaussian blur to the image IMG.

[0036] With reference to the Fig. 1A, Fig. 3A and Fig. 3B The control unit 120 can generate a gradient GRD by calculating the change in pixel value from the image FIT, from which noise has been removed. For example, the image processing control 121 of the control unit 120 can generate the gradient GRD by applying an edge detection filter (e.g., Sobel filter or Roberts filter) to the image FIT, from which noise has been removed.

[0037] With reference to Fig. 1A and Fig. 3B can use the control unit 120 to detect a strong edge NMS based on the gradient GRD according to the change in pixel value. The strong edge NMS can, for example, include certain boundary pixels. The control unit 120 can detect an edge candidate that is weaker than the strong edge NMS, detect a weak edge that extends from the strong edge NMS among the weak edge candidates, and the binary data EDG (in Fig. 2A) generate using the strong edge NMS and the weak edge.

[0038] For example, the image processing control 121 of the control unit 120 can detect the strong edge NMS by applying normalization or non-maximum suppression to the gradient GRD.

[0039] For example, the image processing control 121 of the control unit 120 can generate the gradient GRD based on a magnitude relationship between the change in pixel value and a first threshold, and detect the strong edge NMS based on a magnitude relationship between the change in pixel value and a second threshold. A combination of the first and second thresholds can be defined as a double threshold.

[0040] The sharpness of the strong edge NMS (e.g., the width and length of the edge) may be higher than that of the weak edge, and the strong edge NMS may therefore be more suitable for the real-time structure / environment information contained in the image. The weak edge may be less suitable for the real-time structure / environment information contained in the image. Therefore, the control unit 120 can first detect the candidates for the weak edge, select some of the weak edge candidates that have good connectivity with the strong edge NMS, and eliminate the remaining candidates, thereby increasing the suitability of the weak edge for the real-time structure / environment information.

[0041] Fig. Figure 4 is a view showing the pixel matching processing performed by the device and method for outputting a projection of a vehicle according to embodiments of the present disclosure. With reference to the Fig. 1A and Fig. 4. The control unit 120 can perform the pixel matching processing between the multitude of pixels in the image received by the image receiving unit 110 and the multitude of pixels in the binary data.

[0042] For example, the number of pixels in the binary data can correspond to the number of pixels in a projection output area of ​​the projection output unit 130 and can thus be determined from a specification of the projection output unit 130. On the other hand, the number of pixels in the image received by the image receiver unit 110 can be determined from a specification of the camera of the image receiver unit 110. A specification of the image receiver unit 110 and the specification of the projection output unit 130 may not match, and the control unit 120 can reconcile the specification of the image receiver unit 110 and the specification of the projection output unit 130 through pixel matching processing.

[0043] For example, the multitude of pixels in the projection output area of ​​the projection output unit 130 can comprise a 1152 x 576 structure, a 576 x 288 structure, a 480 x 240 structure, a 256 x 64 structure, a 320 x 80 structure, and a 246 x 82 structure. For example, the aspect ratio of the 1152 x 576 structure, the 576 x 288 structure, the 480 x 240 structure, or the 256 x 64 structure can be the same as the respective aspect ratio of the multitude of pixels in the image. However, the aspect ratio of the 320 x 80 structure can be higher than the respective aspect ratio of the multitude of pixels in the image, and the aspect ratio of the 246 x 82 structure can be lower than the respective aspect ratio of the multitude of pixels in the image. The control unit 120 can perform pixel matching processing by adjusting the aspect ratio of the projection output area of ​​the projection output unit 130 and the aspect ratio of the image.

[0044] Alternatively, the resolutions of the 1152 x 576 structure, the 576 x 288 structure, the 480 x 240 structure, and the 256 x 64 structure can differ from each other and from the image resolution. Therefore, the control unit 120 can perform pixel matching processing by adjusting the resolution of the projection output area of ​​the projection output unit 130 and the image resolution. The resolution change and the aspect ratio change can be achieved, for example, by merging adjacent pixels or by approximating the pixel values.

[0045] Fig. Figure 5A is a view illustrating that the projection output unit is controlled by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figure 5B is a view illustrating a method for controlling the optical system of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure; Fig. Figure 5C is a view illustrating a method for controlling the light source of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure; and Fig. 5D is a view illustrating a method for scanning the plurality of pixels of the projection output unit in the device and the method for outputting a projection of a vehicle according to the embodiments of the present disclosure.

[0046] Referring to Fig. 5A and Fig. 5B can include a projection output unit 130a, at least one light source 131, or the optical system, and the control unit 120 can control the switching on / off of at least the light source 131 or the optical system in response to the binary data of each of the multiple pixels. For example, the optical system can include at least one focusing lens 132, one variable mirror 133, and one imaging lens 134.

[0047] For example, the light source 131 can emit light, and the variable mirror 133 can reflect the light emitted by the light source 131 and reflect the light in a different direction through each reflection area, since the reflection area is divided. The imaging lens 134 can receive the light reflected by the variable mirror 133 and project it onto the projection pattern output area (e.g., the road surface).

[0048] The light source 131 can, for example, contain a light-emitting diode and be installed so that it emits light onto the variable mirror 133. The focusing lens 132 can be arranged between the light source 131 and the adjustable mirror 133 so that the light emitted by the light source 131 falls onto the adjustable mirror 133.

[0049] The variable mirror 133 can contain an array of microreflectors that are switched on and off by the control unit 120 upon input of a control signal, thereby changing their angles and thus altering the direction of the incident light. For example, the variable mirror 133 can contain a digital micromirror device (DMD) and change the direction of the incident light by adjusting the angle of the microreflector through switching it on and off.

[0050] A variety of imaging lenses 134 can be provided, and the light passing through the imaging lenses 134 can be projected using a specific angular arrangement.

[0051] For example, the variable mirror 133 of the optical system, which can be implemented as a DMD, can comprise a variable mirror substrate 133a and a variable mirror array structure 133b. The control unit 120 can generate the control signal (electrical energy) to control a tilt angle (e.g., +θ or -θ) of each of the plurality of pixels in the variable mirror array structure 133b, and control the tilt angle of the variable mirror array structure 133b using the variable mirror substrate 133a. For example, the control unit 120 can transmit the control signal to the variable mirror 133 of the optical system via wired or wireless communication.

[0052] For example, some of the multitude of pixels in the variable mirror array structure 133b can be controlled at an angle to reflect the light received from the light source 131 towards the imaging lens 134, corresponding to a 1 in the binary data and corresponding to the projection pattern output by the projection output unit 130a. For example, the remaining pixels of the multitude of pixels in the variable mirror array structure 133b can be controlled at an angle to reflect the light received from the light source 131 in a direction different from the direction towards the imaging lens 134, corresponding to a 0 in the binary data.

[0053] With reference to Fig. 1A and Fig. 5C can include a projection output unit 130b and a light source 133L. The light source 133L can comprise a light source substrate 133La and a light source array structure 133Lb. For example, the control unit 120 can generate the control signal to control the turning on / off of each of the plurality of pixels in the light source array structure 133Lb, and can control the turning on / off of the light source array structure 133Lb using the light source substrate 133La. For example, the control unit 120 can transmit the control signal to the light source 133L of the optical system via wired or wireless communication. For example, the pixels that are turned on among the multitude of pixels in the light source array structure 133Lb can correspond to a 1 in the binary data, and the pixels that are turned off among the multitude of pixels in the light source array structure 133Lb can correspond to a 0 in the binary data.

[0054] For example, the projection output unit 130b can include the imaging lens 134 and / or a heat dissipation structure 137, and the heat dissipation structure 137 can efficiently dissipate the heat generated by the light source 133L away from the projection output unit 130b. For example, the light source array structure 133Lb can contain a plurality of LED chips corresponding to the plurality of pixels.

[0055] With reference to Fig. 1A and Fig. In 5D, a projection output unit 130c can comprise a scanner 133S, which outputs the projection pattern by sequentially scanning the plurality of pixels in the light source 133L. For example, the scanner 133S can be implemented to be easily moved or tilted using MEMS (Micro Electro Mechanical System) technology, and implement the projection pattern from the plurality of pixels in the light source 133L based on the slight movement or tilt. The light source 133L can be, for example, a laser output device and / or a phosphor, and the scanner 133S can include a piezoelectric element (e.g., a piezoelectric actuator). A time interval in which the scanner 133S scans all pixels once can correspond to an output time interval of the projection pattern of the projection output unit 130c. The light source 133L can be controlled by the variable mirror 133. Fig. 5A will be replaced, which is based on its design.

[0056] Fig. Figures 6A to 6D are views showing an on / off period of the projection pattern in the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure.

[0057] With reference to the Fig. In 1A and 6A-6D, the control unit 120 can control the projection output unit 130 to periodically switch the projection pattern on and off. Accordingly, the visual information of the projection pattern output by the projection output unit 130 can contain more sampling effects, and the projection output unit 130 can thus improve the efficiency of identifying the projection pattern in the driver's or vehicle's environment (e.g., other vehicles on the road or pedestrians).

[0058] With reference to Fig. 6A-6C, the control unit 120 can control the projection output unit 130 to periodically repeat the switching on / off of each pixel in the projection pattern, and at least two pixels in the projection pattern can have at least one different switch-on period length, switch-off period length, switch-on time, or switch-off time. Accordingly, the projection output unit 130 can further improve the efficiency of identifying projection patterns in the driver's or vehicle's environment (e.g., other vehicles on the road or pedestrians).

[0059] With reference to the Fig. 1A and Fig. 6A allows a sequence (n) of the multitude of pixels in the projection pattern output area of ​​the projection output unit 130 to be set from zero “0” to “hor”, and the on / off times (2T) all The number of pixels can be the same. Switch-on times (T all XN n / N horThe number of pixels can differ from each other, switch-off times (T all + T all XN n / N hor The number of pixels can differ from each other, as can the lengths of on-time periods (T). all ) the multitude of pixels can be the same, and lengths of off-time periods (T) all ) the number of pixels can be the same.

[0060] With reference to Fig. 1A and Fig. 6B allows the sequence (n) of the multitude of pixels in the projection pattern output area of ​​the projection output unit 130 to be set from zero “0” to “hor”, and the on / off times (T all + T p The number of pixels can be the same. The switch-on times (T alle XN n / N hor The number of pixels can differ from each other, the switch-off times (T p + T alle XN n / N horThe number of pixels can differ from each other, as can the lengths of the on-time periods (T). p ) the number of pixels can be the same, and the lengths of the off-time periods (T) alle ) the number of pixels can be the same.

[0061] With reference to Fig. 1A and Fig. 6C allows the sequence (n) of the multitude of pixels in the projection pattern output area of ​​the projection output unit 130 to be set from zero “0” to “hor”, and the on / off times (2T) all The number of pixels can be the same. The switch-on times (T all XN n / N hor The number of pixels can differ from each other, the switch-off times (T all + T p ) the number of pixels can be the same, the lengths of the switch-on times (T) alle + T p - (T alle XN n / N horThe number of pixels can differ from each other, and the lengths of the switch-off times (2T) alle - (T alle + T p The number of pixels can be different from each other.

[0062] With reference to Fig. 1A and Fig. 6D allows the sequence (n) of the multitude of pixels in the projection pattern output area of ​​the projection output unit 130 to be set from zero “0” to “hor”, and the on / off times (T all The number of pixels can be the same. The turn-on times (0, T) all ) the multitude of pixels can be the same, the switch-off times (T p ) the multitude of pixels can be the same, the lengths of the on-time periods (T) p ) the multitude of pixels can be the same, and the lengths of the off-time periods (T) all - T p ) the multitude of pixels can be the same.

[0063] Fig. Figure 7 is a flowchart illustrating the method for outputting a projection of a vehicle according to an embodiment of the present disclosure. Referring to Fig. 7. The procedure for outputting a projection of a vehicle can include the following: Receiving an image IMG outside the vehicle (S110) by a control unit 120 (in Fig. 1A) and / or a calculating device 500 (in Fig. 1B); Converting the received image into binary data BIN (S120); and driving a light source and / or optical system to output a projection pattern based on the converted binary data outside the vehicle (S130). According to the procedure for outputting a vehicle projection, the performance of the projection in providing visual information can be improved by outputting a projection pattern adapted to a structure outside the vehicle.

[0064] With reference to Fig. 1B and Fig. 7. The computing device 500 can contain the processor 501 and the storage medium 502, which records one or more programs 502a that can be executed by the processor 501. One or more programs 502a can include instructions for executing the processes described above (S110, S120, and S130). The storage medium 502 can record one or more programs 502a that include instructions for executing the procedure for outputting a projection of a vehicle.

[0065] For example, the binary data can contain the binary data of each of a multitude of pixels in a matrix, and when addressing (S130, S230 in Fig. 8A, S230 in Fig. 8B or S330 in Fig. 9A) The light source and / or optical system can be controlled to output the projection pattern, the turning on / off of which is determined in response to the binary data of each of the multitude of pixels.

[0066] For example, when converting (S120, S220 to Fig. 8A, S220 in Fig. 8B or S320 in Fig. 9A) an edge can be detected based on a change in a pixel value of each of the multiple pixels of the image outside the vehicle, and the binary data can be generated based on the edge; and when driving (S130, S230 in Fig. 8A, S230 in Fig. 8B or S330 in Fig. 9A) at least one of the light source and optical system can be controlled to output the projection pattern, whereby one of the pixels corresponding to the edge is determined as switched on and the other pixels not corresponding to the edge are determined as switched off.

[0067] For example, when receiving (S110, S210 in Fig. 8A, S210 in Fig. 8B or S310 in Fig. 9A) The image can be received outside the vehicle in response to a change in whether a vehicle door is open, a change in whether the door is locked, a manipulation of the vehicle's transmission, or a manipulation of the vehicle's engine start; the vehicle's light source can be controlled to turn on when the illuminance outside the vehicle is lower than the reference illuminance; and the image can be received outside the vehicle after the light source has been turned on when the illuminance outside the vehicle is lower than the reference illuminance.

[0068] Fig. 8A and Fig. Figure 8B are flowcharts illustrating that the light source is controlled based on the illuminance outside the vehicle and the projection pattern is output by the device and method for outputting a projection of a vehicle in response to the change in whether the door is open or locked, according to the embodiments of the present disclosure.

[0069] With reference to the Fig. 1A, Fig. 8A and Fig. 8B The control unit 120 can control the projection output unit 130 (S230 or S232) to output the projection pattern in response to the change in whether the vehicle door is open or locked (S212, S221, or S231). For example, the control unit 120 can be deactivated (or put into a power-saving state) by operating it in a sleep mode (S211) when the vehicle door is locked, and activated by waking it from sleep mode (S213) when the door is unlocked.

[0070] The control unit 120 can then control the vehicle's light source so that it switches on (S215) when the illuminance outside the vehicle is lower than the reference illuminance (S214), and convert the image received by the image receiver unit 110 into binary data (S216) after the light source is switched on. Accordingly, the control unit 120 can exhibit improved conversion accuracy and / or efficiency in converting the image into binary data. For example, the control unit 120 can switch on the vehicle's light source before the image receiver unit 110 receives the image if the exterior of the vehicle is generally dark (e.g., at night or in a room with insufficient exterior lighting). For example, the image receiver unit 110 can receive the image without the control unit 120 switching on the vehicle's light source if the exterior of the vehicle is generally bright (e.g.,during the day or in an area (room) with sufficient outdoor lighting).

[0071] For example, the control unit 120 can generate an illuminance value outside the vehicle based on the image received by the image receiver unit 110 and control the output intensity of the projection output unit 130 based on the illuminance outside the vehicle. For example, the control unit 120 can use the average value of the pixel values ​​of the multitude of pixels in the image as the illuminance value outside the vehicle and control the output intensity by dimming the projection output unit 130. For example, the control unit 120 can perform the dimming control by controlling a power or current (or a pulse width in the case of pulse width modulation) supplied to the light source 131. Fig. 5A or the light source 133L in Fig. 5C is supplied.

[0072] With reference to Fig. 1A and Fig. 8A The control unit 120 can then convert the image into binary data (S222) when the door is opened and output the projection pattern (S232) when the door is closed. The control unit 120 can convert the image into binary data when the door is closed and output the projection pattern when the door is opened, based on its design. For example, the projection pattern, in response to the change whether the vehicle door is open or locked (S212, S221, or S231), can be defined as variable (or adaptive) welcome / farewell lighting based on structural / environmental information outside the vehicle and can provide the driver with visual welcome or farewell information.

[0073] Converting to binary data (S222) or outputting the projection pattern (S232) depending on whether the door is open, as in Fig. 8A shown, can be found in Fig. 8B is omitted due to the design. The in Fig. The control unit shown in 8B can automatically convert the image into binary data and automatically output the projection pattern when activated by exiting sleep mode (S213).

[0074] Fig. Figure 9 is a flowchart illustrating that the projection pattern is output in response to transmission manipulation and engine start manipulation by the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure.

[0075] With reference to Fig. 1A and Fig. 9. The control unit 120 can control the projection output unit 130 (S330 or S332) to output the projection pattern in response to the vehicle's transmission manipulation (S311) and / or engine start manipulation (S331). For example, the control unit 120 can control the projection output unit 130 (S330 or S332) when the transmission is shifted into Park (P) or Neutral (N).

[0076] The control unit 120 can then check whether there is a history of image acquisition by the image receiver unit 110 (S312), check whether the time elapsed for image acquisition is more than a certain time (e.g. 3 seconds) if there is a history of image acquisition (S313), and control the image receiver unit 110 to selectively acquire the image based on a verified result.

[0077] The control unit 120 can then filter the image (S321) and convert the image into binary data (S322), as in Fig. 3A is shown. The control unit 120 can then check whether a vehicle engine is switched off (S331) and output the projection pattern when the vehicle engine is switched off (S332). For example, the projection pattern in response to the transmission manipulation (S311) or engine start manipulation (S331) of the vehicle can be defined as variable (or adaptive) welcome / farewell lighting based on structural / environmental information outside the vehicle and can have the effect of providing the driver with visual welcome or farewell information.

[0078] Meanwhile, the computing unit 500 of the control unit 120 in the device 100 for outputting a projection of a vehicle according to an embodiment of the present disclosure can comprise at least one processor 501, the computer-readable storage medium 502 and the communication bus 503 (see Fig. 1B). The communication bus 503 can connect various other components of the computing device 500, including the processor 501 and the computer-readable storage medium 502.

[0079] The processor 501 can cause the computing device 500 to operate according to the exemplary embodiments described above. For example, the processor 501 can execute one or more programs stored on the computer-readable storage medium 502. One or more programs can contain one or more computer-executable instructions, and the computer-executable instructions can cause the computing device 500 to perform the operations according to the exemplary embodiments when executed by the processor 501.

[0080] The computer-readable storage medium 502 can store the computer-executable instructions or program code, program data, and / or another suitable form of information. The program 502a stored in the computer-readable storage medium 502 can contain a series of instructions that can be executed by the processor 501. In one embodiment, the computer-readable storage medium 502 can be a memory (e.g., volatile memory such as random-access memory, non-volatile memory, or a suitable combination thereof), at least one magnetic disk storage device, an optical disk storage device, a flash memory device, any other type of storage medium that the computing device 500 can access and store desired information on, or a suitable combination thereof.

[0081] The computing unit 500 can also include one or more input / output interfaces 505 and one or more network communication interfaces 506, which provide interfaces for one or more input / output devices 504. The input / output interface 505 and the network communication interface 506 can be connected to the communication bus 503. A network can be a cellular network, such as...Global System for Mobile Communications (GSM), Enhanced Data Rates for GSM Evolution (EDGE), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Time Division CDMA (TD-CDMA), Universal Mobile Telecommunications System (UMTS), Long Term Evolution (LTE), Generation (5G), Wireless Fidelity (Wi-Fi) or another cellular network and can also be implemented as Ethernet, Media Oriented Systems Transport (MOST), Flexray, Controller Area Network (CAN), Local Interconnect Network (LIN), Internet, Bluetooth, Near Field Communication (NFC), Zigbee, Radio Frequency (RF) or the like.

[0082] The input / output device 504 can be connected to other components of the computing device 500 via the input / output interface 505. The exemplary input / output device 504 can include an input device such as a pointing device (e.g., mouse or trackpad), a keyboard, a touch input device (e.g., touchpad or touchscreen), a speech or sound input device, various types of sensor devices, and / or a capture device, and / or an output device such as a display device, a printer, a loudspeaker, and / or a network card. The exemplary input / output device 504 can be arranged within the computing device 500 as a component contained within the computing device 500 or connected to the computing device 500 as a device separate from the computing device 500.

[0083] According to the embodiments of this disclosure, the device and the method may comprise a program for executing the methods described herein on a computer and a computer-readable recording medium containing the program. The computer-readable recording medium may contain a program instruction, a local data file, a local data structure, or the like, either alone or in combination. The medium may be specifically designed and configured for this disclosure or be generally available in the field of computer software.An example of a computer-readable recording medium can be a magnetic medium such as a hard drive, floppy disk, or magnetic tape; an optical recording medium such as a Compact Disc Read-Only Memory (CD-ROM) or a Digital Versatile Disc (DVD); or a hardware device that specifically stores and executes a program instruction, such as read-only memory (ROM), random-access memory (RAM), or flash memory. An example of a program can be high-level language code that can be executed by the computer using an interpreter or similar device, as well as machine language code generated by a compiler.

[0084] As explained above, the device and method for outputting a projection of a vehicle according to the embodiments of the present disclosure can improve the visual information provision performance by adapting the projection pattern to the structure outside the vehicle.

[0085] While the embodiments have been shown and described above, it should be obvious to those skilled in the art that modifications and variations can be made without deviating from the scope of protection of the present disclosure as defined by the attached claims.

Images