Information display method, device and equipment and computer readable storage medium

Abstract

The invention relates to an information display method, device and equipment and a computer readable storage medium, and the method comprises the steps: determining a target image parameter, enabling a first image source image to occupy an original display region of an image source when the first image source image obtained after the first image is subjected to the first distortion processing is displayed on the image source in head-up display equipment, and enabling the first image source image to occupy the original display region of the image source; the display area of the image source comprises an original display area and an extended display area, and the extended display area is a display area except the original display area; a second image conforming to the target image parameters is generated, a second image source image obtained after first distortion processing is conducted on the second image is displayed on the image source, and the second image source image occupies the original display area and the extended display area; the second image source image is imaged through the optical element, the utilization rate of the image source display area of the head-up display device is improved, and the driving experience of a user is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to an information display method, device, equipment and computer-readable storage medium. Background Art

[0002] In today's society, cars, as a means of transportation, are equipped with more and more new technologies to enhance the user's driving experience while meeting the user's travel needs. Head-up display (HUD) projects important driving data on the windshield, allowing users to see real-time driving information without lowering their heads. However, the curvature of the windshield will cause the virtual image of driving data projected by the HUD to be distorted, which is optical distortion. Summary of the invention

[0003] In a first aspect, an embodiment of the present disclosure provides an information display method, which is applied in a head-up display device, comprising:

[0004] Determining target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area;

[0005] generating a second image that meets the target image parameters, and displaying a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area;

[0006] The second image source image is imaged by an optical element.

[0007] In a second aspect, an embodiment of the present disclosure provides an information display device, which is applied in a head-up display device, including:

[0008] a determination module, configured to determine target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area;

[0009] A display module, used for generating a second image conforming to the target image parameters, and displaying a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area;

[0010] An imaging module is used to image the second image source image through an optical element.

[0011] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0012] Memory;

[0013] Processor; and

[0014] Computer programs;

[0015] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect.

[0016] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method described in the first aspect.

[0017] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the method described in the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 A flow chart of an information display method provided by an embodiment of the present disclosure;

[0021] Figure 2 A schematic diagram of reflective imaging of a reflective imaging unit provided in an embodiment of the present disclosure;

[0022] Figure 3 A schematic diagram of an imaging process of a head-up display device provided in an embodiment of the present disclosure;

[0023] Figure 4 A schematic diagram of an imaging process of a head-up display device provided in an embodiment of the present disclosure;

[0024] Figure 5 A schematic diagram of a first image to an extended image provided by an embodiment of the present disclosure;

[0025] Figure 6 A schematic diagram of a first image source image to an extended image source image provided by an embodiment of the present disclosure;

[0026] Figure 7 A schematic diagram of an original display area to an extended display area provided in an embodiment of the present disclosure;

[0027] Figure 8 A schematic diagram of a first extended display area provided in an embodiment of the present disclosure;

[0028] Fig. 9 A schematic diagram of a second extended display area provided in an embodiment of the present disclosure;

[0029] Fig.10 A schematic diagram of a third extended display area provided in an embodiment of the present disclosure;

[0030] Fig.11 A schematic diagram of the structure of an information display device provided by an embodiment of the present disclosure;

[0031] Fig.12 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0033] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0034] In today's society, cars, as a means of transportation, are equipped with more and more new technologies to enhance the user's driving experience while meeting the travel needs of users. Head-up display (HUD) projects important driving data on the windshield, allowing users to see real-time driving information without lowering their heads. However, the curvature of the windshield causes the virtual image of driving data projected by the HUD to be distorted. This distortion is generally called optical distortion, and the image corresponding to this distortion is the first distortion form.

[0035] The inventors of the present application discovered during the research process that, through a distortion correction algorithm (also called digital distortion), the image displayed on the image source of the HUD (such as a TFT-LCD liquid crystal display) produces a second distortion form opposite to the optical distortion. When the image displayed on the image source is reflected and imaged by an optical element (such as a curved reflector) and a reflective imaging part (such as a vehicle's windshield) in the HUD, the second distortion form of the image displayed on the image source offsets the first distortion caused by the optical distortion, and the virtual image formed does not show distortion. However, this method will result in the display area of ​​the image source being unable to be fully utilized, that is, the utilization rate of the image source display area is low, thereby reducing the utilization rate of the display area of ​​the head-up display device. In response to this problem, the embodiments of the present disclosure provide an information display method, which is described below in conjunction with specific embodiments.

[0036] Figure 1 This is a flow chart of the information display method provided by the embodiment of the present disclosure. The method can be executed by an information display device, which can be implemented in software and / or hardware, and the information display device can be configured in an electronic device, such as a head-up display device. In addition, the method can be applied to the application scenario of information display, and it can be understood that the information display method provided by the embodiment of the present disclosure can also be applied in other scenarios.

[0037] Below Figure 1 The information display method shown in the figure is introduced, and the specific steps of the method are as follows:

[0038] S101. Determine target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, and the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area excluding the original display area.

[0039] The display area of ​​the image source includes an original display area and an extended display area. The extended display area is a display area other than the original display area. When a first image source image obtained by performing a first distortion process on a first image is displayed on the image source in the head-up display device, the first image source image occupies the original display area of ​​the image source, that is, the first image source image is only located in the original display area.

[0040] like Figure 2As shown, in the prior art, 21 is a first image source image, specifically, the first image source image can be an image source of the HUD, such as an image displayed on a liquid crystal display screen (or a liquid crystal display device), and 20 is a reflective imaging unit (or a reflective imaging device), specifically, the reflective imaging unit can be a windshield. The first image source image 21 of the head-up display device is reflected and imaged on the reflective imaging unit 20. Since the reflective imaging unit 20 is curved, the first image source image 21 forms a second distorted virtual image on the reflective imaging unit 20 through the head-up display device. Figure 2 The grid pattern on the middle reflection imaging unit 20 represents a virtual image of the first image source image 21 after a second distortion. The virtual image is a second distorted form of the first image source image. The second distortion is an optical distortion caused by the windshield.

[0041] like Figure 3 As shown, 30 is a first image, 31 is a display area of ​​an image source, 32 is a first image source image obtained after the first image 30 is subjected to a first distortion process, and 33 is a first image source image obtained after the reflection imaging portion (e.g. Figure 2 The virtual image formed by the reflective imaging part 20 shown in the figure, the reflective imaging part can specifically be a windshield, and the first image source image 32 can form a second distorted virtual image 33 on the reflective imaging part through the head-up display device. Specifically, in order to eliminate the above-mentioned second distortion, in the process of forming the virtual image 33 on the reflective imaging part through the head-up display device, the first image source image displayed on the liquid crystal display device is caused to produce a first distortion form opposite to the second distortion form according to a first distortion algorithm, wherein the first distortion algorithm can be a distortion correction algorithm (also called a digital distortion algorithm), and when the first image source image 32 is reflected and imaged by the reflective imaging part, the virtual image 33 formed by the reflective imaging part does not show distortion in visual effect. The principle is that the first distortion form of the first image source image 32 displayed on the liquid crystal display device offsets the second distortion caused by the reflective imaging part (i.e., the windshield), so that the virtual image projected by the head-up display device does not show distortion in visual effect. Among them, the first image source image 32 occupies the original display area of ​​the image source, that is, the image after the first distortion processing only occupies the original display area when displayed on the image source, as shown in FIG. Figure 3 As shown in , the boundary of the first image source image 32 coincides with the boundary of the original display area. The display area of ​​the image source includes the original display area and the extended display area, and the extended display area is the display area other than the original display area, that is, the extended display area is the area obtained by subtracting the original display area from the display area of ​​the image source.

[0042] S102: Generate a second image that meets the target image parameters, and display a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area.

[0043] A second image meeting the above target parameters is generated, the size of the second image is larger than the size of the first image, and a second image source image obtained by performing the first distortion processing on the second image is displayed on the image source, wherein the second image source image occupies the original display area and the extended display area.

[0044] Specifically, Figure 4 As shown, 40 is the second image, 41 is the second image source image, and 42 is the second image source image after the reflection imaging part (for example Figure 2 A second image 40 is generated according to the parameters of the target image, and the second image is subjected to a first distortion process to obtain a second image source image 41. The second image source image 41 occupies the original display area and the extended display area ( Figure 4 As shown in the figure, the second image source image 41 occupies the original display area and the extended display area of ​​the image source, so the boundary of the second image source image coincides with the boundary of the image source display area), wherein the original display area is the area surrounded by the dotted line in the second image source image 41, that is, Figure 3 The extended display area is the area where the first image source image is located, and the extended display area is the area in the image source except the original display area.

[0045] S103: Imaging the second image source image through an optical element.

[0046] The image formed by the optical element on the second image source image, that is, the second image source image 41 is projected on the reflective imaging portion through the head-up display device to form a virtual image 42.

[0047] It can be understood that the area of ​​the virtual image obtained after imaging the second image source image through the optical element is larger than the area of ​​the virtual image obtained after imaging the first image source image through the optical element.

[0048] The disclosed embodiment determines target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in a head-up display device, the first image source image occupies an original display area of ​​the image source, and the display area of ​​the image source includes an original display area and an extended display area, and the extended display area is a display area other than the original display area; generates a second image that meets the target image parameters, and displays a second image source image obtained by performing a first distortion process on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area; images the second image source image by an optical element, thereby expanding a used portion of the display area of ​​the image source of the head-up display device, improving the utilization rate of the image source display area of ​​the head-up display device, and enhancing the driving experience of the user.

[0049] In some embodiments, imaging the second image through an optical element includes: guiding the image light corresponding to the second image source image to the reflective imaging part through the optical element, and the image light reaches the eye box area after being reflected by the reflective imaging part, wherein the first distortion processing is used to offset the second distortion caused by the reflective imaging part to the second image source image.

[0050] The image light corresponding to the second image source image is guided to the reflective imaging part through the optical element, and the image light reaches the eye box area after being reflected by the reflective imaging part, so that the user can view the virtual image of the second image source image in the eye box area, and no distortion of the virtual image can be seen in the visual effect, wherein the first distortion processing is used to offset the second distortion caused by the reflective imaging part to the second image source image.

[0051] Specifically, Figure 4 As shown, the optical element can be a curved reflector, a plane reflector or other element used for magnified imaging in the head-up display device. The image light corresponding to the second image source image 41 is guided to the reflective imaging unit 20 through the optical element in the head-up display device. The image light reaches the eye box area after being reflected by the reflective imaging unit 20, so that the user can see the virtual image 42 formed in front of the reflective imaging unit through the reflective imaging unit, wherein the reflective imaging unit 20 will generate a second distortion on the second image source image 41. The first distortion processing is used to offset the second distortion generated by the reflective imaging unit 20 on the second image source image 41. After the first distortion and the second distortion are offset, the second image source image 41 is not distorted in visual effect.

[0052] The disclosed embodiment guides the image light corresponding to the second image source image to the reflective imaging portion through an optical element. The image light reaches the eye box area after being reflected by the reflective imaging portion, so that when the user views the second image source image with the naked eye, no visual distortion is seen, thereby improving the user's driving experience.

[0053] In some embodiments, determining the target image parameters includes: expanding the image size of the first image to obtain an extended image; when the extended image source image obtained after performing the first distortion processing on the extended image occupies the original display area and the extended display area, determining the image size of the extended image as the target image size, and determining the shape of the extended image as the target image shape, wherein the target image parameters include the target image size and the target image shape; when the extended image source image occupies the entire display area on the image source, determining the image size of the extended image as the target image size, and determining the shape of the extended image as the target image shape.

[0054] like Figure 5 , Figure 6As shown, the image size of the first image 51 is expanded to obtain an extended image 52, and the extended image 52 is subjected to a first distortion process to obtain an extended image source image 62. When the extended image source image 62 obtained after the first distortion process on the extended image 52 occupies the original display area and the extended display area, the image size of the extended image is determined as the target image size, and the shape of the extended image is determined as the target image shape, wherein the target image parameters include the target image size and the target image shape.

[0055] Specifically, when the extended image source image occupies the entire display area on the image source (liquid crystal display device or liquid crystal screen), the image size of the extended image is determined as the target image size, and the shape of the extended image is determined as the target image shape.

[0056] Alternatively, the preset picture is subjected to an inverse process of the first distortion process to obtain a target picture, wherein the preset picture occupies the original display area and the extended display area; an image size of the target picture is determined as a target image size, and a shape of the target picture is determined as a target image shape, wherein the target image parameters include the target image size and the target image shape, and when the preset picture is displayed on the image source, the preset picture occupies the entire display area on the image source.

[0057] Specifically, the preset picture is subjected to the inverse processing of the first distortion processing to obtain a target picture, wherein the preset picture occupies an original display area and an extended display area, for example, when the preset picture is displayed on an image source, it occupies the entire display area of ​​the image source (a liquid crystal display device or a liquid crystal display screen); the image size of the target picture is determined as a target image size, and the shape of the target picture is determined as a target image shape, wherein the target image parameters include a target image size and a target image shape.

[0058] The target image size includes the length and width of the target image (the unit may be centimeters or pixels).

[0059] Optionally, the extended display area includes at least one of the following: a display area located above the original display area, a display area located on the left side of the original display area, a display area located on the right side of the original display area, and a display area located below the original display area.

[0060] Specifically, Figure 7 As shown, the extended display area includes at least one of the following: a display area 72 located above the original display area 71, a display area 73 located on the left side of the original display area 71, a display area 74 located on the right side of the original display area 71, and a display area 75 located below the original display area 71.

[0061] The disclosed embodiment specifically describes how to determine the target image parameters, clarifies the size and shape of the target image, facilitates generation of a second image that meets the target image parameters based on the size and shape of the target image, and improves the utilization rate of the image source display area of ​​the head-up display device.

[0062] In some embodiments, the generating of a second image conforming to the target image parameters and displaying on the image source a second image source image obtained after performing the first distortion processing on the second image include: determining content to be displayed based on a driving state of a vehicle; generating a second image according to the content to be displayed and the target image parameters; performing the first distortion processing on the second image to obtain a second image source image; and displaying the content to be displayed on the second image source image in an extended display area of ​​the image source.

[0063] According to the driving state of the vehicle, content to be displayed is determined, wherein the content to be displayed includes non-augmented reality content and augmented reality content, the non-augmented reality content includes blind spot information, vehicle status warning information, and application program interface, and the augmented reality content includes point of interest information, steering information, front vehicle locking information, and lane departure prompt information; according to the content to be displayed and target image parameters, a second image is generated, a first distortion process is performed on the second image to obtain a second image source image, and the content to be displayed on the second image source image is displayed in an extended display area of ​​the image source.

[0064] Optionally, based on the driving state of the vehicle, the content to be displayed is determined, including: based on the triggering operation of the application in the vehicle system, determining that the content to be displayed is an application interface, and correspondingly, displaying the content to be displayed on the second image source image in the extended display area of ​​the image source, including: displaying the application interface on the second image source image in the extended display area of ​​the image source.

[0065] The trigger operation can be an operation performed by the user through interactive methods such as voice input, touch, and buttons. For example, the trigger operation is that the user uses the voice command "open the voice assistant", then the content to be displayed is determined to be the interface of the voice assistant application, and the virtual image of the voice assistant can be displayed in the interface.

[0066] Optionally, based on the driving state of the vehicle, the content to be displayed is determined, including: based on the activation of the front vehicle locking function, determining that the content to be displayed is the front vehicle locking information; accordingly, in the extended display area of ​​the image source, the content to be displayed on the second image source image is displayed, including: in the extended display area of ​​the image source, the front vehicle locking information on the second image source image is displayed.

[0067] The preceding vehicle locking information may be icon-type information, which is used to remind the user to pay attention to the preceding vehicle. In the virtual image formed by the head-up display device for the second image source image, the preceding vehicle locking information is displayed superimposed on the preceding vehicle in an AR manner.

[0068] Optionally, based on the driving state of the vehicle, the content to be displayed is determined, including: based on the vehicle position deviating from the current driving lane, determining that the content to be displayed is lane departure warning information; accordingly, in the extended display area of ​​the image source, the content to be displayed on the second image source image is displayed, including: in the extended display area of ​​the image source, displaying the lane departure warning information on the second image source image.

[0069] When the vehicle position deviates from the current driving lane, the user can be reminded through lane departure prompt information. In the virtual image formed by the head-up display device for the second image source image, the lane departure prompt information is superimposed and displayed with the current driving lane in an AR manner.

[0070] Optionally, the extended display area includes a first extended display area, which is a display area located above the original display area; based on the driving state of the vehicle, determining the content to be displayed, including: based on the distance between the vehicle position and the point of interest position being less than a preset distance threshold, determining that the content to be displayed is point of interest information; correspondingly, in the extended display area of ​​the image source, displaying the content to be displayed on the second image source image, including: displaying the point of interest information on the second image source image in the first extended display area of ​​the image source.

[0071] Specifically, Figure 8 As shown, the extended display area includes a first extended display area 72, and the first extended display area 72 is a display area located above the original display area. When the distance between the vehicle position and the position of the point of interest is less than a preset distance threshold, it is determined that the content to be displayed is the point of interest information. According to the content to be displayed and the target image parameters, a second image is generated, and a first distortion process is performed on the second image to obtain a second image source image. In the first extended display area of ​​the image source, the point of interest information on the second image source image is displayed, wherein the point of interest information can specifically be restaurant information, park information, etc., and the point of interest information includes the name of the point of interest, the business hours or opening hours of the point of interest, etc.

[0072] Optionally, the extended display area includes a second extended display area, which is a display area located below the original display area; based on the driving state of the vehicle, determining the content to be displayed, including: based on an alarm triggered by an object detected in the surrounding environment of the vehicle, determining that the content to be displayed is blind spot information; accordingly, in the extended display area of ​​the image source, displaying the content to be displayed on the second image source image, including: displaying the blind spot information on the second image source image in the second extended display area of ​​the image source.

[0073] Specifically, Fig. 9 As shown, the extended display area includes a second extended display area 75, and the second extended display area 75 is a display area located below the original display area. When an alarm is triggered by an object detected in the surrounding environment of the vehicle (for example, obstacle information such as a person, a vehicle, or a non-motor vehicle is detected in a blind spot), it is determined that the content to be displayed is blind spot information. According to the content to be displayed and the target image parameters, a second image is generated, and a first distortion process is performed on the second image to obtain a second image source image. In the second extended display area of ​​the image source, the blind spot information on the second image source image is displayed, wherein the blind spot information may specifically be obstacle information appearing in the blind spot, and the obstacle information includes people, rear vehicles, non-motor vehicles, etc.

[0074] Optionally, the extended display area includes a second extended display area, which is a display area located below the original display area; based on the driving state of the vehicle, determining the content to be displayed, including: based on an alarm triggered by the driving parameters of the vehicle, determining that the content to be displayed is vehicle status alarm information, wherein the driving parameters include at least one of the following: current vehicle speed, remaining battery power, cruising range, and vehicle system failure; accordingly, in the extended display area of ​​the image source, displaying the content to be displayed on the second image source image, including: displaying the vehicle status alarm information on the second image source image in the second extended display area of ​​the image source.

[0075] Specifically, Fig. 9 As shown, the extended display area includes a second extended display area 75, and the second extended display area 75 is a display area located below the original display area. When the alarm is triggered by the driving parameters of the vehicle, it is determined that the content to be displayed is the vehicle status alarm information, wherein the driving parameters include at least one of the following: current vehicle speed, remaining power, cruising range, and vehicle system failure. According to the content to be displayed and the target image parameters, a second image is generated, and the second image is subjected to a first distortion process to obtain a second image source image. In the second extended display area of ​​the image source, the vehicle status alarm information on the second image source image is displayed, wherein the vehicle status alarm information specifically includes speeding information, insufficient power information, insufficient cruising range information, vehicle system failure information, etc.

[0076] Optionally, the extended display area also includes a third extended display area, and the third extended display area is a display area located on the left side of the original display area and / or on the right side of the original display area; based on the driving state of the vehicle, the content to be displayed is determined, including: based on the vehicle driving within a preset distance range to the intersection, determining that the content to be displayed is turning information; accordingly, in the extended display area of ​​the image source, the content to be displayed on the second image source image is displayed, including: in the third extended display area of ​​the image source, the turning information on the second image source image is displayed.

[0077] Specifically, Fig.10 As shown, the extended display area also includes a third extended display area, and the third extended display area is a display area 73 located on the left side of the original display area and / or a display area 74 on the right side of the original display area. When the vehicle travels to the preset distance range of the intersection, it is determined that the content to be displayed is the turning information. According to the content to be displayed and the target image parameters, a second image is generated, and the second image is subjected to a first distortion process to obtain a second image source image. In the third extended display area of ​​the image source, the turning information on the second image source image is displayed. The turning information can specifically be an AR navigation arrow. The position of the AR navigation arrow in the second image source image changes with the change of the distance between the vehicle and the intersection, and the display of the AR navigation arrow is realized by augmented reality technology. If the distance between the vehicle and the intersection is greater than the first distance and less than the preset distance, the AR navigation key head is displayed in the third extended display area. When the distance between the vehicle and the intersection is less than the first distance, the AR arrow is displayed in the original display area and the third extended display area.

[0078] The embodiments of the present disclosure specifically describe the information to be displayed in the extended display area, clarify the display content of the extended display area, expand the display area of ​​the head-up display device, and improve the utilization rate of the head-up display device.

[0079] Fig.11 The information display device provided in the embodiment of the present disclosure can be configured in a head-up display device. The information display device provided in the embodiment of the present disclosure can execute the processing flow provided in the information display method embodiment, such as Fig.11As shown, the information display device 110 includes: a determination module 111, a display module 112 and an imaging module 113; wherein the determination module 111 is used to determine target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, and the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area; the display module 112 is used to generate a second image that meets the target image parameters, and display a second image source image obtained by performing the first distortion process on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area; the imaging module 113 is used to image the second image source image through an optical element.

[0080] Optionally, the imaging module 113 is also used to guide the image light corresponding to the second image source image to the reflective imaging part through the optical element, and the image light reaches the eye box area after being reflected by the reflective imaging part, wherein the first distortion processing is used to offset the second distortion caused by the reflective imaging part to the second image source image.

[0081] Optionally, the determination module 111 is further used to expand the image size of the first image to obtain an extended image; when the extended image source image obtained after performing the first distortion processing on the extended image occupies the original display area and the extended display area, the image size of the extended image is determined as the target image size, and the shape of the extended image is determined as the target image shape, wherein the target image parameters include the target image size and the target image shape; or, perform the inverse processing of the first distortion processing on a preset picture to obtain a target picture, wherein the preset picture occupies the original display area and the extended display area; the image size of the target picture is determined as the target image size, and the shape of the target picture is determined as the target image shape, wherein the target image parameters include the target image size and the target image shape.

[0082] Optionally, when the extended image source image occupies the entire display area on the image source, the image size of the extended image is determined as the target image size, and the shape of the extended image is determined as the target image shape; when the preset picture is displayed on the image source, the preset picture occupies the entire display area on the image source.

[0083] Optionally, the size of the second image is larger than the size of the first image, and / or the area of ​​the virtual image obtained after imaging the second image source image through the optical element is larger than the area of ​​the virtual image obtained after imaging the first image source image through the optical element.

[0084] Optionally, the extended display area includes at least one of: a display area located above the original display area, a display area located on the left side of the original display area, a display area located on the right side of the original display area, and a display area located below the original display area.

[0085] Optionally, the display module 112 is also used to determine the content to be displayed based on the driving state of the vehicle; generate a second image according to the content to be displayed and the target image parameters; perform a first distortion process on the second image to obtain a second image source image; and display the content to be displayed on the second image source image in an extended display area of ​​the image source.

[0086] Optionally, the content to be displayed includes non-augmented reality content and augmented reality content, the non-augmented reality content includes blind spot information, vehicle status warning information, and an application program interface; the augmented reality content includes point of interest information, steering information, front vehicle locking information, and lane departure warning information.

[0087] Optionally, the extended display area includes a first extended display area, which is a display area located above the original display area; the display module 112 is also used to determine that the content to be displayed is point of interest information based on that the distance between the vehicle position and the point of interest position is less than a preset distance threshold; and display the point of interest information on the second image source image in the first extended display area of ​​the image source.

[0088] Optionally, the extended display area includes a second extended display area, which is a display area located below the original display area; the display module 112 is also used to determine that the content to be displayed is blind spot information based on an alarm triggered by an object detected in the surrounding environment of the vehicle; and to display the blind spot information on the second image source image in the second extended display area of ​​the image source.

[0089] Optionally, the extended display area includes a second extended display area, which is a display area located below the original display area; the display module 112 is also used to determine that the content to be displayed is vehicle status warning information based on an alarm triggered by the vehicle's driving parameters, wherein the driving parameters include at least one of the following: current vehicle speed, remaining battery power, cruising range, and vehicle system failure; in the second extended display area of ​​the image source, the vehicle status alarm on the second image source image is displayed.

[0090] Optionally, the extended display area also includes a third extended display area, and the third extended display area is a display area located on the left side of the original display area and / or on the right side of the original display area; the display module 112 is also used to determine that the content to be displayed is turning information based on the vehicle traveling to a preset distance range from the intersection; and display the turning information on the second image source image in the third extended display area of ​​the image source.

[0091] Fig.11 The information display device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned information display method embodiment, and its implementation principle and technical effect are similar and will not be described in detail here.

[0092] Fig.12 Schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. The electronic device may be the information display device described in the above embodiment. The electronic device provided in an embodiment of the present disclosure may execute the processing flow provided in the information display method embodiment, such as Fig.12 As shown, the electronic device 120 includes: a memory 121, a processor 122, a computer program and a communication interface 123; wherein the computer program is stored in the memory 121 and is configured so that the processor 122 executes the information display method as described above.

[0093] In addition, an embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored. The computer program is executed by a processor to implement the information display method described in the above embodiment.

[0094] In addition, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the information display method as described above is implemented.

[0095] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0096] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0097] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0098] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0099] Determining target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area;

[0100] generating a second image that meets the target image parameters, and displaying a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area;

[0101] The second image source image is imaged by an optical element.

[0102] In addition, the electronic device may also execute other steps in the information display method described above.

[0103] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0104] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0105] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0106] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0107] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0108] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0109] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An information display method, applied in a head-up display device, characterized in that: The method comprises: Determining target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area; generating a second image that meets the target image parameters, and displaying a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area; The second image source image is imaged by an optical element.

2. The method according to claim 1, characterized in that The imaging of the second image by an optical element comprises: The image light corresponding to the second image source image is guided to the reflective imaging part through the optical element, and the image light reaches the eye box area after being reflected by the reflective imaging part, wherein the first distortion processing is used to offset the second distortion caused by the reflective imaging part on the second image source image.

3. The method according to claim 1, characterized in that The step of determining the target image parameters comprises: Expanding the image size of the first image to obtain an expanded image; In a case where the extended image source image obtained after performing the first distortion processing on the extended image occupies the original display area and the extended display area, determining the image size of the extended image as the target image size, and determining the shape of the extended image as the target image shape, wherein the target image parameters include the target image size and the target image shape; or Performing an inverse process of the first distortion process on a preset picture to obtain a target picture, wherein the preset picture occupies the original display area and the extended display area; An image size of the target picture is determined as a target image size, and a shape of the target picture is determined as a target image shape, wherein the target image parameters include the target image size and the target image shape.

4. The method according to claim 3, characterized in that In the case where the extended image source image occupies the entire display area on the image source, determining the image size of the extended image as the target image size, and determining the shape of the extended image as the target image shape; When the preset picture is displayed on the image source, the preset picture occupies the entire display area on the image source.

5. The method according to claim 1, characterized in that: The size of the second image is larger than that of the first image, and / or the area of ​​the virtual image obtained after imaging the second image source image through the optical element is larger than the area of ​​the virtual image obtained after imaging the first image source image through the optical element.

6. The method according to claim 1, characterized in that The extended display area includes at least one of the following: a display area located above the original display area, a display area located on the left side of the original display area, a display area located on the right side of the original display area, and a display area located below the original display area.

7. The method according to claim 1, characterized in that The generating of the second image conforming to the target image parameters and displaying on the image source a second image source image obtained by performing the first distortion processing on the second image, comprises: Determining content to be displayed based on the driving state of the vehicle; generating a second image according to the content to be displayed and the target image parameters; Performing a first distortion process on the second image to obtain a second image source image; In the extended display area of ​​the image source, the content to be displayed on the image of the second image source is displayed.

8. The method according to claim 7, characterized in that The content to be displayed includes non-augmented reality content and augmented reality content, wherein: The non-augmented reality content includes blind spot information, vehicle status warning information, and application program interface; The augmented reality content includes point of interest information, steering information, front vehicle locking information, and lane departure warning information.

9. The method according to claim 7, characterized in that: The extended display area includes a first extended display area, and the first extended display area is a display area located above the original display area; Based on the driving status of the vehicle, determine the content to be displayed, including: Based on the distance between the vehicle position and the position of the point of interest being less than a preset distance threshold, determining that the content to be displayed is the point of interest information; Correspondingly, displaying the content to be displayed on the image of the second image source in the extended display area of ​​the image source includes: The interest point information on the second image source image is displayed in the first extended display area of ​​the image source.

10. The method according to claim 7, characterized in that The extended display area includes a second extended display area, and the second extended display area is a display area located below the original display area; Based on the driving status of the vehicle, determine the content to be displayed, including: Based on an alarm triggered by an object detected in the surrounding environment of the vehicle, determining that the content to be displayed is blind spot information; Correspondingly, displaying the content to be displayed on the image of the second image source in the extended display area of ​​the image source includes: The blind area information on the second image source image is displayed in a second extended display area of ​​the image source.

11. The method according to claim 7, characterized in that The extended display area includes a second extended display area, and the second extended display area is a display area located below the original display area; Based on the driving status of the vehicle, determine the content to be displayed, including: Based on the alarm triggered by the driving parameters of the vehicle, determining that the content to be displayed is the vehicle status alarm information, wherein the driving parameters include at least one of the following: current vehicle speed, remaining battery power, cruising range, and vehicle system failure; Correspondingly, displaying the content to be displayed on the image of the second image source in the extended display area of ​​the image source includes: The vehicle status warning information on the second image source image is displayed in the second extended display area of ​​the image source.

12. The method according to claim 7, characterized in that The extended display area further includes a third extended display area, and the third extended display area is a display area located on the left side of the original display area and / or on the right side of the original display area; Based on the driving status of the vehicle, determine the content to be displayed, including: Based on the vehicle traveling within a preset distance range of the intersection, determining that the content to be displayed is turn information; Correspondingly, displaying the content to be displayed on the image of the second image source in the extended display area of ​​the image source includes: The steering information on the second image source image is displayed in a third extended display area of ​​the image source.

13. An information display device, used in a head-up display device, characterized in that: The device comprises: a determination module, configured to determine target image parameters, wherein when a first image source image obtained by performing a first distortion process on a first image is displayed on an image source in the head-up display device, the first image source image occupies an original display area of ​​the image source, the display area of ​​the image source includes the original display area and an extended display area, and the extended display area is a display area other than the original display area; A display module, used for generating a second image conforming to the target image parameters, and displaying a second image source image obtained by performing the first distortion processing on the second image on the image source, wherein the second image source image occupies the original display area and the extended display area; An imaging module is used to image the second image source image through an optical element.

14. An electronic device, characterized in that: include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 12.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images