Vehicle windshield image enhancement display method, electronic device, storage medium and glass

Abstract

The present invention discloses a vehicle windshield image enhancement display method, electronic equipment, storage medium and glass. The method comprises: obtaining the target position of an external target object and the human eye position of a person in the vehicle; establishing a light path passing through the target position and the human eye position according to the target position and the human eye position; determining the intersection of the light path and the windshield as the display position of the external target object on the windshield based on the position information of the windshield; and displaying the enhancement effect of the external target object at the display position of the windshield. The present invention calculates the position of the external target object and the human eye position, establishes a light path passing through the target position and the human eye position, determines the display position of the target object on the windshield according to the light path, and displays the enhancement effect of the external target object at the display position. While displaying the enhanced effect of the target object to prompt the driver, the present invention does not add too much additional information to avoid interfering with the driver's field of vision.

Description

Technical Field

[0001] The present invention relates to the technical field of automobiles, and in particular to a vehicle windshield image enhancement display method, electronic equipment, storage medium and glass. Background Art

[0002] The existing way of displaying information on the windshield mainly uses a head up display (HUD). The existing augmented reality head up display (AR-HUD) assists the driver in driving the vehicle by displaying information on the head up display.

[0003] However, the existing head-up display displays limited conventional physical value information or virtual images, which may project too many virtual imaging signals and interfere with the driver's vision.

[0004] At the same time, the displayed virtual image needs to be displayed according to different scenarios of the vehicle. Therefore, it is necessary to continuously learn scenario recognition and gradually improve the learning speed to adapt to different requests. Therefore, the existing virtual image display method still requires a large number of samples to have a better display state.

[0005] Finally, the imaging using AR-HUD technology is not directly reflected on the windshield, that is, it is not well integrated with the windshield itself. The HUD interface is too small and the information that can be projected is too small. Even if the area of ​​​​the HUD is increased, it requires glass with a special curvature, and the curvature must change with the relative movement of the driver's eyes, which is expensive. Summary of the invention

[0006] Based on this, it is necessary to provide a vehicle windshield image enhancement display method, electronic device, storage medium and glass to address the technical problem that the existing technology of projecting virtual imaging signals to assist driving easily causes visual interference.

[0007] The present invention provides a vehicle windshield image enhancement display method, comprising:

[0008] Obtaining the target position of the target object outside the vehicle and the eye position of the human eye inside the vehicle;

[0009] Establishing a light path passing through the target object position and the human eye position according to the target object position and the human eye position;

[0010] Determining the intersection of the light path and the windshield as the display position of the external target on the windshield based on the position information of the windshield;

[0011] An enhancement effect on the external object is displayed at the display position of the windshield.

[0012] Further, the displaying of the enhancement effect on the external target at the display position of the windshield specifically includes:

[0013] Acquire a captured image of the target object outside the vehicle, and perform image processing on the captured image to obtain a display image displayed on the windshield;

[0014] The display image is displayed at the display position of the windshield.

[0015] Furthermore, displaying the display image at the display position of the windshield specifically includes:

[0016] The display image is displayed at the display position of the windshield with a preset transparency.

[0017] Furthermore, displaying the display image at the display position with a preset transparency specifically includes: displaying the display image at the display position with a preset transparency using a display color, and a first color difference between the display color and the color of the target object outside the vehicle is less than or equal to a preset first color difference threshold.

[0018] Furthermore, after displaying the display image at the display position of the windshield, the method further includes:

[0019] If the displayed image overlaps or partially overlaps with the basic information image displayed on the windshield, taking the overlapping portion of the basic information image and the displayed image as an overlapping image, and calculating a second color difference between the overlapping image and the displayed image;

[0020] If the second color difference is less than a preset second color difference threshold, the filling color of the overlapping image is increased.

[0021] Furthermore, after displaying the display image at the display position of the windshield, the method further includes:

[0022] If the second color difference is greater than or equal to a preset second color difference threshold, the brightness of the basic information image is reduced, and the brightness and / or saturation of the displayed image is increased.

[0023] Furthermore, the acquiring of the captured image of the target object outside the vehicle and performing image processing on the captured image to obtain a display image displayed on the windshield specifically includes:

[0024] Acquire a captured image of the target object outside the vehicle;

[0025] If it is detected that the captured image is blocked by an obstacle, a padding operation is performed on the captured image;

[0026] If the complementing operation is successful, image processing is performed on the complemented captured image to obtain a display image displayed on the windshield.

[0027] Furthermore, displaying the display image at the display position of the windshield specifically includes:

[0028] If multiple external objects are detected and the display images of the multiple external objects at the display position of the windshield at least partially overlap, the display image of the external object closest to the vehicle is displayed at the display position of the windshield with a preset transparency.

[0029] Furthermore, it also includes:

[0030] If a change in the position of the target object or the position of the human eye is detected, the light path is updated, the display position is recalculated, and the enhanced effect on the external target object is displayed at the updated display position of the windshield.

[0031] Furthermore, the displaying of the enhancement effect on the external target at the display position of the windshield specifically includes:

[0032] If the distance between the external object and the vehicle is greater than or equal to a preset distance threshold, the enhancement effect of the external object is displayed at the display position of the windshield, otherwise the enhancement effect of the external object is not displayed.

[0033] Furthermore, obtaining the target position of the target object outside the vehicle specifically includes:

[0034] Get the current vehicle geographic location of the vehicle;

[0035] If the external target within the preset range of the current vehicle's geographic location can be identified by the external target recognition sensor, the target position of the external target is obtained from the external target recognition sensor; otherwise, the target geographic location and target height of the external target within the preset range of the current vehicle's geographic location are obtained from the server, and the target position of the external target is determined based on the target geographic location, target height and current vehicle geographic location.

[0036] The present invention provides an electronic device, comprising:

[0037] at least one processor; and,

[0038] a memory communicatively connected to at least one of the processors; wherein,

[0039] The memory stores instructions that can be executed by at least one of the processors, and the instructions are executed by at least one of the processors to enable the at least one of the processors to perform the vehicle windshield image enhancement display method as described above.

[0040] The present invention provides a storage medium, wherein the storage medium stores computer instructions. When a computer executes the computer instructions, the storage medium is used to execute all steps of the vehicle windshield image enhancement display method as described above.

[0041] The present invention provides a vehicle windshield, comprising an outer windshield, an inner windshield, and a pixel layer between the outer windshield and the inner windshield, wherein the pixel layer is communicatively connected with the electronic device as described above, and the display is controlled by the electronic device.

[0042] The present invention calculates the position of the target object outside the vehicle and the position of the human eye, establishes a light path passing through the target object position and the human eye position, determines the display position of the target object on the windshield according to the light path, and displays the enhancement effect of the target object outside the vehicle at the display position. Therefore, while the present invention displays the enhanced effect of the target object to prompt the driver, it does not add too much additional information to avoid interfering with the driver's field of vision. At the same time, the vehicle windshield provided by the present invention is displayed by setting a pixel layer between the outer windshield and the inner windshield. Compared with the existing non-HUD technology, only one dot matrix light-emitting layer is required on the parts, and compared with the existing HUD configuration technology, there is no need to consider the process issues of the curvature of the HUD windshield on the parts, and there is no need to use it with a HUD projection device. The process is convenient to install and can be perfectly integrated with the windshield, and there is no need for an additional HUD projection device and a HUD windshield with a special curvature. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A working flow chart of a vehicle windshield image enhancement display method according to the present invention;

[0044] Figure 2 A schematic diagram of a vehicle windshield and a light path according to an embodiment of the present invention;

[0045] Figure 3 This is a working flow chart of a vehicle windshield image enhancement display method according to an embodiment of the present invention;

[0046] Figure 4 This is a schematic diagram of detecting multiple external objects according to an embodiment of the present invention;

[0047] Figure 5 This is a schematic diagram of completing an external target object of an embodiment of the present invention;

[0048] Figure 6This is a schematic diagram of an overlap between an external target object and a basic information image according to an embodiment of the present invention;

[0049] Figure 7 A working flow chart of a vehicle windshield image enhancement display method according to a preferred embodiment of the present invention;

[0050] Figure 8 The figure is a schematic diagram of the hardware structure of an electronic device of the present invention. DETAILED DESCRIPTION

[0051] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0052] Embodiment 1

[0053] like Figure 1 The flowchart of the vehicle windshield image enhancement display method of the present invention is shown, comprising:

[0054] Step S101, obtaining the target position of the target object outside the vehicle and the eye position of the human eye inside the vehicle;

[0055] Step S102, establishing a light path passing through the target object position and the human eye position according to the target object position and the human eye position;

[0056] Step S103, determining the intersection of the light path and the windshield as the display position of the external target on the windshield based on the position information of the windshield;

[0057] Step S104: displaying the enhancement effect on the external target at the display position of the windshield.

[0058] Specifically, the present invention can be applied to an electronic control unit (ECU) of a vehicle. Step S101 is executed to obtain the target position of a target object outside the vehicle and the eye position of a human eye inside the vehicle. Figure 2As shown, the outside of the vehicle is equipped with an external target recognition sensor 4, including but not limited to a camera, a laser radar, a millimeter wave radar, a temperature sensor, a humidity sensor, etc. It can identify the road ground line, as well as the traffic warning signs and text of the road conditions. At the same time, an independent distance sensor can be used for ranging, or the external target recognition sensor itself can be used for ranging, such as ranging based on a camera or a laser radar. The external target recognition sensor is used to identify the target outside the vehicle, and the target includes but is not limited to traffic warning signs and text. The specific target recognition and ranging can be obtained by using existing image recognition technology and ranging technology, so as to obtain the target position of the external target. At the same time, at least one driver eye recognition sensor 5 is installed in the vehicle, which can identify the height of the current driver's eye position and the distance from the eye to the windshield, so as to obtain the eye position of the driver's eye in the vehicle. The external sensor detects the object appearance of the target to be identified in real time, as well as the relative height, relative size and relative distance of the identified target from the current vehicle position.

[0059] Then, step S102 is performed, such as Figure 2 As shown, a light path A between the human eye 1 inside the vehicle and the target 2 outside the vehicle is simulated. Then step S103 is executed to determine the intersection between the light path A and the windshield 3 as the display position according to the geometric relationship constructed by the light path A. Specifically, for an external target 2, it has multiple endpoints, and multiple light paths A are constructed from each endpoint to the human eye 1 inside the vehicle, so as to obtain the display positions of the multiple endpoints of the external target 2 on the windshield, and the multiple display positions constitute a display range, and the enhanced effect 6 of the external target 2 on the windshield 3 is displayed within the display range. In addition, the light path A can also be constructed with the midpoint of the external target 2 and the human eye 1 inside the vehicle to obtain the display position of the midpoint of the external target 2 on the windshield, and the enhanced effect 6 of the external target 2 on the windshield is displayed with the display position as the midpoint.

[0060] Specifically, a coordinate system about the position inside the vehicle is established, and the regional coordinates of the area where the windshield is located on the coordinate system can be determined as the windshield area. Since the relative height and relative distance of the target object from the current vehicle position are obtained, the relative distance and relative height of the target object from the origin of the coordinate system can be obtained, thereby obtaining the coordinates of the target object in the vehicle coordinate system. Similarly, the position of the human eye relative to the human eye recognition sensor inside the vehicle can be determined, and the position of the human eye recognition sensor inside the vehicle is fixed, so the position of the human eye identified by the human eye recognition sensor can be converted to the position of the vehicle coordinate system. Based on the two points, a straight line function of the straight line of the light path passing through the human eye position and the target position in the vehicle coordinate system can be established. The intersection of the straight line function and the windshield area is the display position.

[0061] More specifically, a coordinate system is established with the lower left corner of the windshield as the origin. An x-axis is established from the origin along the width of the vehicle, with the right side of the vehicle as the positive direction of the x-axis. A y-axis is established from the origin along the forward direction of the vehicle, with the forward direction of the vehicle as the positive direction of the y-axis. A z-axis is established from the origin along the height of the vehicle, with the top of the vehicle as the positive direction of the z-axis. The surface function f2 of the windshield in the coordinate system is determined. The coordinates of the external object recognition sensor relative to the origin are determined as a vector The vector from the external object recognition sensor to the object , then the vector from the origin to the target , the coordinates of the target object in the coordinate system are Similarly, the coordinates of the human eye recognition sensor relative to the origin are the vector , the vector from the human eye recognition sensor to the human eye , then the vector from the origin to the human eye is , the coordinates of the human eye in the coordinate system are . Determine in the coordinate system and The intersection of f1 and f2 is the display position.

[0062] After the display position is determined, step S104 is executed to display the enhancement effect of the target object at the display position.

[0063] Specifically, the enhanced effect of displaying the target object can be projected on the HUD by projection. A windshield can also be used, the windshield includes an outer windshield, an inner windshield, and a pixel layer (Pixel layer) between the outer windshield and the inner windshield. The pixel layer is a transparent pixel layer, and the pixel layer includes a plurality of extremely small crystals arranged and combined, each crystal is a pixel point, and each pixel point emits light and displays separately. Preferably, the pixel layer can be a transparent organic light-emitting diode (OLED) film. The transparent OLED film uses a very thin organic material coating and a glass substrate (or a flexible organic substrate). When current passes through, these organic materials will emit light, and each organic material can be an independent pixel point to emit light and display independently. When no current passes, the organic material does not emit light, forming a transparent film. The transparent OLED film is sandwiched between the outer windshield and the inner windshield to form a windshield. By controlling the transparent OLED film in the middle, the enhanced effect of the target object is displayed at the display position. The windshield can be a front windshield or a window windshield. Preferably, the pixel layer may also be a basic material that can be made into a transparent display screen, such as quantum dot light emitting diodes (QLED), light-emitting diodes (LED) or liquid crystal displays (LCD).

[0064] The present invention calculates the position of the target object outside the vehicle and the position of the human eye, establishes a light path passing through the target object position and the human eye position, determines the display position of the target object on the windshield according to the light path, and displays the enhancement effect of the target object outside the vehicle at the display position. Therefore, while the present invention displays the enhanced effect of the target object to prompt the driver, it does not add too much additional information to avoid interfering with the driver's field of vision.

[0065] Embodiment 2

[0066] like Figure 3 The flowchart of a vehicle windshield image enhancement display method in one embodiment of the present invention includes:

[0067] Step S301, obtaining the target position of the target object outside the vehicle and the eye position of the human eye inside the vehicle;

[0068] In one embodiment, obtaining the target position of the target object outside the vehicle specifically includes:

[0069] Get the current vehicle geographic location of the vehicle;

[0070] If the external target within the preset range of the current vehicle's geographic location can be identified by the external target recognition sensor, the target position of the external target is obtained from the external target recognition sensor; otherwise, the target geographic location and target height of the external target within the preset range of the current vehicle's geographic location are obtained from the server, and the target position of the external target is determined based on the target geographic location, target height and current vehicle geographic location.

[0071] Step S302, establishing a light path passing through the target object position and the human eye position according to the target object position and the human eye position;

[0072] Step S303, determining the intersection of the light path and the windshield as the display position of the external target on the windshield based on the position information of the windshield;

[0073] Step S304, acquiring a captured image of the target object outside the vehicle, and performing image processing on the captured image to obtain a display image displayed on the windshield;

[0074] In one embodiment, the acquiring of the captured image of the target object outside the vehicle and performing image processing on the captured image to obtain a display image displayed on the windshield specifically includes:

[0075] Acquire a captured image of the target object outside the vehicle;

[0076] If it is detected that the captured image is blocked by an obstacle, a padding operation is performed on the captured image;

[0077] If the complementing operation is successful, image processing is performed on the complemented captured image to obtain a display image displayed on the windshield.

[0078] Step S305: If the distance between the external target and the vehicle is greater than or equal to a preset distance threshold, step S306 is executed; otherwise, the enhancement effect of the external target is not displayed.

[0079] Step S306: displaying the display image at the display position of the windshield.

[0080] In one embodiment, displaying the display image at the display position of the windshield specifically includes:

[0081] The display image is displayed at the display position of the windshield with a preset transparency.

[0082] In one of the embodiments, displaying the display image at the display position with a preset transparency specifically includes: displaying the display image at the display position with a preset transparency using a display color, and a first color difference between the display color and the color of the target object outside the vehicle is less than or equal to a preset first color difference threshold.

[0083] In one embodiment, displaying the display image at the display position of the windshield specifically includes:

[0084] If multiple external objects are detected and the display images of the multiple external objects at the display position of the windshield at least partially overlap, the display image of the external object closest to the vehicle is displayed at the display position of the windshield with a preset transparency.

[0085] Step S307, if the displayed image overlaps or partially overlaps with the basic information image displayed on the windshield, taking the overlapping portion of the basic information image and the displayed image as an overlapping image, and calculating a second color difference between the overlapping image and the displayed image;

[0086] Step S308: if the second color difference is less than a preset second color difference threshold, adding a filling color to the overlapping image.

[0087] Step S309: if the second color difference is greater than or equal to a preset second color difference threshold, the brightness of the basic information image is reduced, and the brightness and / or saturation of the displayed image is increased.

[0088] Step S310: If a change in the position of the target object or the position of the human eye is detected, the light path is updated, the display position is recalculated, and the enhancement effect on the target object outside the vehicle is displayed at the updated display position of the windshield.

[0089] Specifically, step S301 is executed to obtain the target position of the target outside the vehicle and the eye position of the human eye inside the vehicle. The vehicle is equipped with an external target recognition sensor, including but not limited to a camera, a laser radar, a millimeter wave radar, a temperature sensor, a humidity sensor, etc. It can identify the road ground line, as well as the traffic prompt symbols and text of the road conditions. At the same time, an independent distance sensor can be used for ranging, or the external target recognition sensor itself can be used for ranging, such as ranging based on a camera or a laser radar. The external target recognition sensor is used to identify the target outside the vehicle, and the target includes but is not limited to traffic prompt symbols and text. The specific target recognition and ranging can be obtained by using existing image recognition technology and ranging technology, so as to obtain the target position of the external target. At the same time, at least one driver eye recognition sensor is installed in the vehicle, which can identify the height of the current driver's eye position and the distance from the eye to the windshield, so as to obtain the eye position of the driver's eye inside the vehicle. The external sensor detects the object appearance of the target to be identified in real time, as well as the relative height, relative size and relative distance of the identified target from the current vehicle position.

[0090] The target position of the target outside the vehicle is preferentially obtained from the target recognition sensor outside the vehicle. However, considering that the target outside the vehicle cannot be detected due to irresistible factors (such as being blocked by a larger vehicle, or the traffic signal sign is bent, etc.), it is impossible to form a complete optical path with the target outside the vehicle, or the optical path is cut off. Therefore, preferably, this embodiment can be combined with server-side data such as the Internet of Vehicles and cloud servers. Under the combination of big data, within the detectable range of the vehicle detector, if the traffic signal information within the preset range of the current vehicle geographical location provided by the server-side big data cannot be matched, the target position of the target outside the vehicle is determined according to the geographical location of the target outside the vehicle provided by the big data information, thereby forming a light path and displaying it in the windshield. If the light path is restored, it is switched back to the light path formed based on the measurement signal of the target recognition sensor outside the vehicle, such as an image capture sensor. The preset range can be the detectable range of the target recognition sensor outside the vehicle. Specifically, a coordinate system is established with the end point of the windshield, such as the lower left corner, as the origin. An x-axis is established from the origin along the width direction of the vehicle, with the right side of the vehicle as the positive direction of the x-axis. Establish the y-axis from the origin along the vehicle's forward direction, with the vehicle's forward direction as the positive direction of the y-axis. Establish the z-axis from the origin along the vehicle's height direction, with the top of the vehicle as the positive direction of the z-axis. The coordinates of the geographic location reference point relative to the origin used to determine the vehicle's current vehicle geographic location are vectors. . Generally speaking, the geographic location reference point only defines two-dimensional coordinates, that is, only x3 and y3 are determined, and z3 can be the coordinate of the ground relative to the origin. Then, based on the geographic coordinates of the external target and the current vehicle geographic location of the vehicle, the distance vector from the vehicle's geographic location reference point to the external target can be determined. The distance vector is, for example, (bx3, by3). Then, combined with the height d of the external target, the vector from the vehicle's geographic location reference point to the external target can be obtained. , then the vector from the origin to the target is .

[0091] Then execute step S302, such as Figure 2 As shown, a light path A is simulated to be formed between the human eye 1 inside the vehicle and the target object 2 outside the vehicle (i.e., the object to be identified outside the window). According to the geometric relationship constructed by the light path A, the intersection between the light path A and the windshield 3 is determined as the display position. Then step S304 is executed to obtain the captured image of the target outside the vehicle, and the captured image is processed to obtain the display image displayed on the windshield. Specifically, the image X obtained by the external target object recognition sensor is subjected to image preprocessing deformation, and the image X is restored to the deformed image Y that should be observed at the position of the human eye; after image processing, it is recorded as the display image M, and the size of the display image M mapped on the windshield and the display position on the windshield are recorded as area B. Image processing includes but is not limited to basic image processing methods such as lateral deformation, longitudinal deformation, distortion processing, magnification and reduction, and jitter processing.

[0092] like Figure 5 As shown, if the signal icon of the target object 2 outside the vehicle to be observed is blocked by non-signal objects such as branches and leaves 51, the area where the mark of this area is mapped on the windshield is recorded as D.

[0093] 5a. If the area D is blocked and cannot be identified as a traffic signal by the sensor, it will not be enhanced.

[0094] 5b. If the blocked area D is recognized as a valid signal by the sensor, the signal of the identified target object 2 outside the vehicle is automatically filled in the windshield according to the recognition state, and the filled captured image 21 is obtained, and then enhanced and displayed.

[0095] Specifically, the completion operation can be implemented using existing image recognition completion methods. For example, if the target object outside the vehicle is text, the text of the target object outside the vehicle is recognized and the missing text part of the captured image is completed. For example, if a road sign is recognized, the missing part of the captured image is completed using a standard road sign.

[0096] In one of the embodiments, relevant information of an external target object within a preset range of the current vehicle geographic location is obtained from a server, and based on the relevant information of the external target object obtained from the server, a captured image of the external target object obtained by shooting is completed.

[0097] When the observation signal of the external target object is first captured by the external target object sensor, such as the image sensor, step S306 is executed to display the enhanced information on the windshield in real time until the vertical distance between the vehicle and the road surface of the external target object is less than the preset distance threshold L1, and then the enhanced display effect is stopped.

[0098] The enhanced effect at the display position is combined with the shape and color of the signal or text of the detected target outside the vehicle, and an image of similar color is projected and displayed in area B, forming a translucent color area on the windshield. Since the display position is located on the light path of the target outside the vehicle actually observed by the human eye, the luminous translucent area overlaps with the object outside the window currently observed by the human eye, forming an enhanced display effect to prompt the driver to receive information. The first color difference between the display color of area B and the color of the target outside the vehicle is less than or equal to the preset first color difference threshold. The display color of area B can be selected based on the RGB color space, and the spatial distance H1 between the display color (R1, G1, B1) and the color (R0, G0, B0) detected by the target outside the vehicle is less than or equal to the preset first color difference threshold, where .

[0099] like Figure 4 As shown, when there are multiple external targets 2, if the signals of two external targets observed one after the other appear, and the optical paths A and E formed by them overlap on the windshield 3, then according to the relationship between the observation signal of the external target determined by the external target sensor and the vehicle distance, the signal of the external target closer to the vehicle is enhanced and displayed first. When there is no overlapping area between the optical paths A and E, they are enhanced and displayed simultaneously.

[0100] Optionally, the vehicle may have a dedicated area C to display the current basic information of the vehicle (temperature, speed, navigation, etc.). Figure 6 As shown, area C displays the basic information image. If the graphics displayed in area B and area C have overlapping parts, then step S307 to step S309 are executed, and the following judgment processing is adopted:

[0101] 6a. Compare the color difference of the observed object and the color of the light that needs to be emitted by area B in the display of area C. Specifically, the spatial distance H2 calculated in the RGB color space can be calculated, where: , the display color of area B is (R1, G1, B1), and the color of the overlapping part of area C and area B is (R2, G2, B2);

[0102] 6b. If the spatial distance H2 is less than the second color difference threshold, a semi-transparent filling color is added to region C to distinguish it from the observed signal color, and region C should still be filled with a non-transparent color in other non-overlapping display signals.

[0103] 6c. If the spatial distance H2> the second color difference threshold, the display brightness of region C is lowered, and the brightness and saturation of region B are increased. Since both region C and region B are semi-transparent luminous displays, there will be no visual conflict.

[0104] When the driver's eyes move, the human eye recognition sensor in the cab can feedback the position change in real time. Similarly, when an external target, such as a signal sign, moves relative to the vehicle, the external target recognition sensor also updates the change of its relative size and relative distance in real time, and sends it to the controller in real time, triggering step S310 to recalculate the optical path A, update the image processing effect to obtain the image M, and update the area B displayed on the windshield.

[0105] In this embodiment, when the light path of the external target is blocked, the geographical location of the target is obtained from the cloud to calculate the position of the target to avoid blocking the light path. At the same time, the image is displayed with transparency to prompt the user. In addition, when the displayed image overlaps with the basic information image, the brightness of different areas is adjusted to avoid visual conflicts. A fill-in operation is added for when the external target is blocked to assist the driver in driving. Finally, considering the situation of multiple external targets, the external target closest to the vehicle is selected for display to avoid overlapping.

[0106] like Figure 7 The flowchart of the vehicle windshield image enhancement display method according to the best embodiment of the present invention is shown, comprising:

[0107] Step S701, acquiring data from the eye position capture module, the external sensor signal capture module, and the cloud server, wherein the eye position capture module acquires data from the eye recognition sensor, and the external sensor signal capture module acquires data from the external object recognition sensor;

[0108] Step S702, performing image restoration judgment;

[0109] Step S703, determining and calculating the optical path;

[0110] Step S704, image preprocessing and deformation;

[0111] Step S705, determining the windshield display position and color, and then performing enhanced display;

[0112] Step S706: when the distance is less than L1, exit the enhanced display.

[0113] Embodiment 3

[0114] like Figure 8 The figure shows a hardware structure diagram of an electronic device of the present invention, including:

[0115] at least one processor 801; and,

[0116] A memory 802 is communicatively connected to at least one of the processors 801; wherein,

[0117] The memory 802 stores instructions that can be executed by at least one of the processors. The instructions are executed by at least one of the processors to enable the at least one of the processors to perform the vehicle windshield image enhancement display method as described above.

[0118] Figure 8 A processor 801 is taken as an example.

[0119] The electronic device may further include: an input device 803 and a display device 804 .

[0120] The processor 801, the memory 802, the input device 803 and the display device 804 may be connected via a bus or other means, and the figure takes the connection via a bus as an example.

[0121] The memory 802 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions / modules corresponding to the vehicle windshield image enhancement display method in the embodiment of the present application, for example, Figure 1 The processor 801 executes various functional applications and data processing by running the non-volatile software programs, instructions and modules stored in the memory 802, that is, the vehicle windshield image enhancement display method in the above embodiment is implemented.

[0122] The memory 802 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created according to the use of the vehicle windshield image enhancement display method, etc. In addition, the memory 802 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 802 may optionally include a memory remotely arranged relative to the processor 801, and these remote memories may be connected to the device for executing the vehicle windshield image enhancement display method via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0123] The input device 803 can receive user clicks and generate signal inputs related to user settings and function control of the vehicle windshield image enhancement display method. The display device 804 can include display devices such as a display screen.

[0124] The one or more modules are stored in the memory 802 , and when executed by the one or more processors 801 , the vehicle windshield image enhancement display method in any of the above method embodiments is executed.

[0125] The present invention calculates the position of the target object outside the vehicle and the position of the human eye, establishes a light path passing through the target object position and the human eye position, determines the display position of the target object on the windshield according to the light path, and displays the enhancement effect of the target object outside the vehicle at the display position. Therefore, while the present invention displays the enhanced effect of the target object to prompt the driver, it does not add too much additional information to avoid interfering with the driver's field of vision.

[0126] An embodiment of the present invention provides a storage medium, wherein the storage medium stores computer instructions. When a computer executes the computer instructions, the storage medium is used to execute all steps of the vehicle windshield image enhancement display method as described above.

[0127] like Figure 2 As shown, a vehicle windshield 3 of the present invention comprises an outer windshield 31, an inner windshield 32, and a pixel layer 33 between the outer windshield and the inner windshield, wherein the pixel layer is communicatively connected with the electronic device as described above, and the display is controlled by the electronic device.

[0128] Specifically, the pixel layer is a transparent pixel layer, which includes a plurality of extremely small crystals arranged and combined, each crystal is a pixel point, and each pixel point emits light and displays separately. Preferably, the pixel layer can be a transparent organic light-emitting diode (OLED) film. The transparent OLED film uses a very thin organic material coating and a glass substrate (or a flexible organic substrate). When current passes through, these organic materials will emit light, and each organic material can be an independent pixel point and independently controlled by an electronic device to emit light and display. When no current passes, the organic material does not emit light and forms a transparent film. The transparent OLED film is sandwiched between the outer windshield and the inner windshield to form a windshield. By controlling the transparent OLED film in the middle, the enhanced effect of the target object is displayed at the display position. The windshield can be a front windshield or a window windshield.

[0129] The vehicle windshield provided by the present invention displays by setting a pixel layer between the outer windshield and the inner windshield. Compared with the existing non-HUD technology, only one dot matrix light-emitting layer is required on the component. Compared with the existing HUD-equipped technology, there is no need to consider the process issues of the curvature of the HUD windshield on the component, and there is no need to use it with a HUD projection device. The process is easy to install and can be perfectly integrated with the windshield. There is no need for an additional HUD projection device and a HUD windshield with a special curvature.

[0130] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A vehicle windshield image enhancement display method, characterized in that: include: Obtaining the target position of the target object outside the vehicle and the eye position of the human eye inside the vehicle; Establishing a light path passing through the target object position and the human eye position according to the target object position and the human eye position; Determining the intersection of the light path and the windshield as the display position of the external target on the windshield based on the position information of the windshield; displaying an enhancement effect on the external object at the display position of the windshield; The displaying of the enhancement effect on the external target at the display position of the windshield specifically includes: Acquire a captured image of the target object outside the vehicle, and perform image processing on the captured image to obtain a display image displayed on the windshield; displaying the display image at the display position of the windshield; The displaying the display image at the display position of the windshield specifically includes: displaying the display image at the display position of the windshield with a preset transparency; Displaying the display image at the display position with a preset transparency specifically includes: displaying the display image at the display position with a preset transparency using a display color, wherein a first color difference between the display color and the color of the target object outside the vehicle is less than or equal to a preset first color difference threshold; After displaying the display image at the display position of the windshield, the method further includes: If the displayed image overlaps or partially overlaps with the basic information image displayed on the windshield, taking the overlapping portion of the basic information image and the displayed image as an overlapping image, and calculating a second color difference between the overlapping image and the displayed image; If the second color difference is less than a preset second color difference threshold, the filling color of the overlapping image is increased.

2. The vehicle windshield image enhancement display method according to claim 1, characterized in that: After displaying the display image at the display position of the windshield, the method further includes: If the second color difference is greater than or equal to a preset second color difference threshold, the brightness of the basic information image is reduced, and the brightness and / or saturation of the displayed image is increased.

3. The vehicle windshield image enhancement display method according to claim 1, characterized in that: The acquiring of the captured image of the target object outside the vehicle and performing image processing on the captured image to obtain a display image displayed on the windshield specifically includes: Acquire a captured image of the target object outside the vehicle; If it is detected that the captured image is blocked by an obstacle, a padding operation is performed on the captured image; If the complementing operation is successful, image processing is performed on the complemented captured image to obtain a display image displayed on the windshield.

4. The vehicle windshield image enhancement display method according to claim 1, characterized in that: The displaying the display image at the display position of the windshield specifically includes: If multiple external objects are detected and the display images of the multiple external objects at the display position of the windshield at least partially overlap, the display image of the external object closest to the vehicle is displayed at the display position of the windshield with a preset transparency.

5. The vehicle windshield image enhancement display method according to any one of claims 1 to 4, characterized in that: Also includes: If a change in the position of the target object or the position of the human eye is detected, the light path is updated, the display position is recalculated, and the enhanced effect on the external target object is displayed at the updated display position of the windshield.

6. The vehicle windshield image enhancement display method according to any one of claims 1 to 4, characterized in that: The displaying of the enhancement effect on the external target at the display position of the windshield specifically includes: If the distance between the external object and the vehicle is greater than or equal to a preset distance threshold, the enhancement effect of the external object is displayed at the display position of the windshield, otherwise the enhancement effect of the external object is not displayed.

7. The vehicle windshield image enhancement display method according to any one of claims 1 to 4, characterized in that: The obtaining of the target position of the target outside the vehicle specifically includes: Get the current vehicle geographic location of the vehicle; If the external target within the preset range of the current vehicle's geographic location can be identified by the external target recognition sensor, the target position of the external target is obtained from the external target recognition sensor; otherwise, the target geographic location and target height of the external target within the preset range of the current vehicle's geographic location are obtained from the server, and the target position of the external target is determined based on the target geographic location, target height and current vehicle geographic location.

8. An electronic device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to at least one of the processors; wherein, The memory stores instructions that can be executed by at least one of the processors, and the instructions are executed by at least one of the processors to enable at least one of the processors to execute the vehicle windshield image enhancement display method according to any one of claims 1 to 7.

9. A storage medium, characterized in that: The storage medium stores computer instructions, and when a computer executes the computer instructions, it is used to execute all steps of the vehicle windshield image enhancement display method as claimed in any one of claims 1 to 7.

10. A vehicle windshield, characterized in that: The device comprises an outer windshield, an inner windshield, and a pixel layer between the outer windshield and the inner windshield, wherein the pixel layer is communicatively connected to the electronic device as claimed in claim 8, and the display is controlled by the electronic device.

Images