Parameter design method and system of head-up display system, electronic equipment and medium

Abstract

The invention provides a parameter design method and system of a head-up display system, electronic equipment and a medium, and belongs to the technical field of automobile engineering. The method comprises the following steps: acquiring a current position pair of a target object corresponding to left and right eye spots, wherein the position change range of the left and right eye spots corresponds to the position range of an eye box in the head-up display system; obtaining a current image pair associated with the current position pair and obtained through simulation based on current design parameters of the head-up display system; the current image pair is output and displayed on an image display device, so that a target object observes a target image, the position of the image display device corresponds to the imaging position of a virtual image in the head-up display system, and the distance between the target object and the image display device is the imaging distance of the head-up display system; and according to a target image observed by the target object, determining whether the current design parameter can be used as a target design parameter of the head-up display system. The accuracy of the performance result in the parameter design process of the head-up display system can be improved.

Description

Technical Field

[0001] This application relates to the field of automotive engineering technology, and more specifically, to a parameter design method for a head-up display system, a parameter design system for a head-up display system, an electronic device, and a computer-readable storage medium. Background Technology

[0002] Currently, HUD (Head-Up Display) technology is becoming increasingly widely used in the automotive field as an important in-vehicle display technology. The performance of the HUD system directly affects the user experience. For example, if the HUD system has significant binocular parallax or dynamic distortion, users may experience dizziness and other discomfort.

[0003] Among related technologies, there are some performance optimization solutions for HUD systems, but they may not be able to obtain accurate performance optimization results in advance, or the optimization cost may be high. Summary of the Invention

[0004] This application provides a parameter design method for a head-up display (HUD) system, a parameter design system for a HUD system, an electronic device, and a computer-readable storage medium. The method described in this application can improve the accuracy of performance results during the parameter design process of a HUD system.

[0005] Firstly, this embodiment provides a parameter design method for a head-up display system, including:

[0006] Obtain the current position pair of the left and right eye points corresponding to the target object; wherein, the position variation range of the left and right eye points corresponds to the position range of the eye box in the head-up display system;

[0007] Obtain the current image pair associated with the current position pair, obtained from the simulation based on the current design parameters of the head-up display system;

[0008] The current image pair is output and displayed on an image display device, so that the target object observes the target image; wherein, the position of the image display device corresponds to the imaging position of the virtual image in the head-up display system, and the distance between the target object and the image display device is the imaging distance of the head-up display system;

[0009] Based on the target image observed from the target object, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

[0010] Optionally, the target object is a binocular vision device, and determining whether the current design parameters can be used as the target design parameters of the head-up display system based on the target image observed by the target object includes:

[0011] For any pixel position in the target image, obtain the first binocular disparity corresponding to the current position and the next pixel position;

[0012] Based on the first binocular parallax, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

[0013] Optionally, determining whether the current design parameters can be used as the target design parameters for the head-up display system based on the first binocular parallax includes:

[0014] Obtain a first probability corresponding to the current position pair and / or a second probability corresponding to the pixel position; wherein, the first probability is determined based on the frequency of use of the current position pair within the position range of the eye box, and the second probability is determined based on the frequency of use of the position point corresponding to the pixel position within the imaging position;

[0015] Based on at least one of the first probability and the second probability, and the first binocular disparity, determine the second binocular disparity corresponding to the current position and the next pixel position;

[0016] Based on the second binocular parallax, it is determined whether the current design parameters can be used as the target design parameters for the head-up display system.

[0017] Optionally, determining whether the current design parameters can be used as the target design parameters for the head-up display system based on the second binocular parallax includes:

[0018] Obtain a second binocular disparity set composed of the second binocular disparities of multiple current position pairs;

[0019] Determine the target's second binocular disparity based on the second binocular disparity set;

[0020] If the target second binocular parallax is less than a threshold, it is determined that the current design parameters can be used as the target design parameters of the head-up display system.

[0021] Optionally, the target object is a user, and determining whether the current design parameters can be used as the target design parameters of the head-up display system based on the target image observed by the target object includes:

[0022] Obtain feedback from the user regarding the image effect of the target image;

[0023] Based on the feedback results, it is determined whether the current design parameters can be used as the target design parameters for the head-up display system.

[0024] Optionally, the method further includes:

[0025] If the current design parameters cannot be used as the target design parameters of the head-up display system, a notification message for adjusting the current design parameters is output so that the target design parameters can be obtained by adjusting the current design parameters through the notification message;

[0026] The notification information includes the current position pair information of the target object and the pixel position of the pixel in the target image when the target image does not meet the design requirements of the head-up display system. The notification information is used to adjust the reflection unit in the head-up display system.

[0027] Optionally, before obtaining the current image pair associated with the current position pair obtained from the simulation of the current design parameters of the head-up display system, the method further includes:

[0028] Using the distortion-free image as the first image at the imaging position of the virtual image, and simulating the first image based on the current design parameters, a second image at the image source position in the head-up display system is obtained.

[0029] Based on the current design parameters, the second image is simulated for each eye point position within the position range of the eye box to obtain a virtual image at the imaging position corresponding to each eye point position;

[0030] Based on the eye point position and the virtual image corresponding to the eye point position, a set consisting of left and right eye point position pairs and image pairs corresponding to the left and right eye point position pairs is obtained; wherein the set includes the current position pair and the current image pair corresponding to the current position pair.

[0031] Secondly, this embodiment provides a parameter design system for a head-up display system, including: a target object, an eye point position acquisition device, an image display device, and a processing device. The position variation range of the left and right eye points of the target object corresponds to the position range of the eye box in the head-up display system. The position of the image display device corresponds to the imaging position of the virtual image in the head-up display system. The distance between the target object and the image display device is the imaging distance of the head-up display system.

[0032] The eye point position acquisition device is used to acquire the current position pairs of the target object corresponding to the left and right eye points, and send the current position pairs to the processing device;

[0033] The processing device is used to acquire a current image pair associated with the current position pair obtained by simulation based on the current design parameters of the head-up display system, and to transmit the current image pair to the image display device;

[0034] The image display device is used to display the current image, so that the target object can observe the target image;

[0035] The target object is used to observe the current image pair displayed on the image display device to obtain the target image;

[0036] The processing device is further configured to determine, based on the target image observed by the target object, whether the current design parameters can be used as the target design parameters of the head-up display system.

[0037] Thirdly, this embodiment provides an electronic device, including a memory and a processor, wherein the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute the parameter design method of the head-up display system as described in any one of the first aspects.

[0038] Fourthly, this embodiment provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the parameter design method for the head-up display system according to any one of the first aspects.

[0039] This application embodiment obtains the current position pair of the target object corresponding to the left and right eye points, and the current image pair associated with the current position pair obtained by simulation based on the current design parameters of the head-up display system. The current image pair is then output and displayed on an image display device, allowing the target object to observe the target image. Based on the target image observed by the target object, it is determined whether the current design parameters can be used as the target design parameters for the head-up display system. In this application embodiment, a target object observing a real imaging effect diagram and an image display device are introduced. The relative positions of the target object and the image display device are used to simulate the eye box in the HUD system and the virtual image formed by the windshield. During the HUD system parameter design stage, by using the target image observed by the target object from the image display device, the effect of the virtual image projected onto the vehicle's windshield during actual use of the HUD system with the current design parameters can be predicted in advance. This allows for the determination of whether the current design parameters meet the target design requirements, thereby designing a more accurate HUD system. Furthermore, the method of this application embodiment can detect design defects early in the HUD system parameter design stage, thereby reducing the cost of HUD system performance optimization during actual use.

[0040] Other features and advantages of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the present application and, together with their description, serve to explain the principles of the present application.

[0042] Figure 1 A schematic diagram of the HUD system provided in an embodiment of this application is shown.

[0043] Figure 2 A schematic flowchart of the parameter design method for the head-up display device provided in the embodiments of this application is shown.

[0044] Figure 3 A schematic diagram of the parameter design system for the head-up display device provided in an embodiment of this application is shown.

[0045] Figure 4 A schematic block diagram of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0046] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0047] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.

[0048] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0049] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0050] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0051] Currently, HUD (Head-Up Display) technology is becoming increasingly widely used in the automotive field as an important in-vehicle display technology. The performance of the HUD system directly affects the user experience. For example, if the HUD system has significant binocular parallax or dynamic distortion, users may experience dizziness and other discomfort.

[0052] In related technologies, there are some performance optimization schemes for HUD systems. For example, products with large actual binocular parallax and dynamic distortion can be combined with additional calibration equipment or display methods to reduce the impact of binocular parallax and dynamic distortion. However, this scheme cannot directly confirm dynamic distortion and binocular parallax from the design stage. In addition, reducing the impact of binocular parallax and dynamic distortion through additional equipment increases the cost of the HUD system, and the reduction is limited. Another example is to directly use simulation software to obtain specific calculated values ​​to represent the magnitude of binocular parallax or dynamic distortion. This scheme cannot intuitively represent binocular parallax or dynamic distortion, making it difficult to obtain a realistic feeling of the HUD imaging effect, resulting in an inability to obtain accurate binocular parallax or dynamic distortion corresponding to the current design parameters.

[0053] To address the problems of inaccurate performance optimization results or high optimization costs in related technologies, this application proposes a parameter design method for a head-up display (HUD) system. This method introduces a target object observing a real imaging effect and an image display device. The relative positions of the target object and the image display device are used to simulate the eye box in the HUD system and the virtual image formed by the windshield. During the HUD system parameter design stage, by using the target image observed by the target object from the image display device, the effect of the virtual image projected onto the vehicle's windshield during actual use can be predicted in advance. This allows for the determination of whether the current design parameters meet the target design requirements, thereby designing a more accurate HUD system. Furthermore, the method of this application can identify design defects early in the HUD system parameter design stage, thereby reducing the cost of HUD system performance optimization during actual use.

[0054] To facilitate understanding of the methods in the embodiments of this application, a HUD system applicable to the embodiments of this application will be briefly described first by way of example. Figure 1 A HUD system is provided. For example... Figure 1 As shown, the HUD system may include an image generation unit 1, a second reflection unit 2, a first reflection unit 3, a windshield 4, and an eye box 5. The image generation unit 1 generates in-vehicle information images; in one example, it can also be referred to as the image source. This in-vehicle information includes, for example, vehicle trip information, navigation information, and intelligent driving information. Vehicle trip information includes, for example, vehicle speed, mileage, and fuel consumption information. Intelligent driving information includes, for example, AR (Augmented Reality) information, which merges virtual information with the actual road scene, such as displaying navigation arrows directly on the road. The in-vehicle information image is reflected and amplified sequentially by the second reflection unit 2 and the first reflection unit 3, and then reaches the windshield 4. The user's eyes, positioned at the eye box 5, can see the in-vehicle information in the virtual image S through the windshield 4.

[0055] The following describes the parameter design method for the head-up display system provided in the embodiments of this application. For example... Figure 2 As shown, the method may include steps S110 to S140.

[0056] Step S110: Obtain the current position pair of the target object corresponding to the left and right eye points.

[0057] In this embodiment, the target object can be a user, such as personnel involved in the design of the head-up display system parameters, or personnel accepting the design results of the head-up display system parameters. The target object can also be a binocular vision device, such as a binocular camera.

[0058] In this embodiment, the positional variation range of the left and right eye points of the target object corresponds to the positional range of the eye box in the head-up display system. This positional setting allows the left and right eye points of the target object to be used to simulate the eye points within the positional range of the eye box in the head-up display system.

[0059] This target object can be used to observe a simulated image of the head-up display system under the current design parameters, reflecting the virtual image effect formed during actual use. When the left and right eyes of the target object observe the same pixel in the target image, the resulting pixel position is different. In one example, the left eye observes the pixel to the right of its actual position, while the right eye observes it to the left. That is, the left eye observes one image (called the first observation image), and the right eye observes another image (called the second observation image). The parallax between the first and second observation images is the binocular parallax when the user observes the target image.

[0060] The positions of the left and right eye points of the target object can form a position pair. In this embodiment, the current position pair of the left and right eye points of the target object can be obtained, so as to optimize subsequent design parameters based on the target image observed by the left and right eye points of the current position pair.

[0061] As an example, the position pairs of the left and right eye points of a target object can be obtained through an eye-tracking device.

[0062] Step S120: Obtain the current image pair associated with the current position pair obtained from the simulation of the current design parameters of the head-up display system.

[0063] The design parameters of the head-up display system in this embodiment may include at least one of the following: the position of the first reflecting unit 3, the position of the second reflecting unit 2, the surface shape of the first reflecting unit 3, and the surface shape of the second reflecting unit 2. The surface shape of the reflecting unit refers to the shape of the reflector, such as a plane or a curved surface.

[0064] In this embodiment, all eye point positions obtained from simulation based on the current design parameters and the virtual images associated with those positions can be pre-stored. Then, the eye point positions are divided into left and right eye points, forming eye point position pairs. The virtual images corresponding to each eye point position are then grouped into image pairs and stored in association with the eye point position pairs. In this way, when the current position pairs of the left and right eye points of the target object are obtained, the associated current image pairs can be retrieved from them.

[0065] One method to divide the eye point position into left and right eye points is, for example, to divide eye points that conform to the human eye interpupillary distance rule into left and right eye points according to their positional relationship.

[0066] A method for simulating all eye point positions and the virtual image associated with each position based on current design parameters. For example, a distortion-free image can be used as the first image at the imaging position of the virtual image in the head-up display system. Based on the current design parameters, the first image is simulated to obtain the second image at the image source position in the head-up display system. Based on the current design parameters, for each eye point position within the eyebox's position range, the second image is simulated separately to obtain the virtual image at the imaging position corresponding to each eye point position. Based on the eye point positions and the virtual images corresponding to the eye point positions, a set consisting of left and right eye point position pairs and corresponding image pairs is obtained. This set includes the current position pairs of the target object and the current image pairs corresponding to the current position pairs.

[0067] In some examples, the starting point of the optical path in the head-up display (HUD) system design model can be set as the virtual image imaging position, the ending point of the optical path as the image source position, and the center of the eyebox as the eye point position. The virtual image imaging position is set as a distortion-free image, and simulation software is used to simulate this distortion-free image. During the simulation, the field of view height is set as the field of view angle of the HUD system, and the pixel size and number of pixels at the detector position are set according to the optomechanical parameters used by image generation unit 1 in the HUD system. After simulation, a distorted second image is obtained, and this second image is used as the source image at the image source position.

[0068] In some examples, after obtaining the source image based on a distortion-free image, the starting point of the optical path in the head-up display system design model can be set as the image source position, the ending point as the virtual image imaging position, and the image source position as the source image. Simulation software is then used to simulate this source image. During the image simulation, the field of view height is set to the actual size of the optomechanical system, and the pixel size and number of pixels at the detector position are set according to the virtual image display parameters (such as resolution). The position of the eye point in the head-up display system design model is adjusted, and virtual images corresponding to different eye point positions are simulated. For example, the adjustment range of the eye point position can be a horizontal offset of ±70mm and a vertical offset of ±30mm relative to the center of the eyebox.

[0069] After obtaining the virtual images corresponding to different eye point positions, the eye point positions can be divided into left eye point and right eye point to form eye point position pairs. The virtual images corresponding to each eye point position can be combined into image pairs and stored in association with the eye point position pairs.

[0070] Step S130: Display the current image pair output on the image display device so that the target object can observe the target image.

[0071] Step S140: Based on the target image observed from the target object, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

[0072] The image display device in this embodiment can be used to display the virtual image formed by the simulated head-up display system, that is, to display the image pair corresponding to the positions of the left and right eye points. This image display device can be, for example, a 3D display.

[0073] In this embodiment, the position of the image display device corresponds to the imaging position of the virtual image in the head-up display system, and the distance between the target object and the image display device is the imaging distance of the head-up display system. This imaging distance refers to the distance between the virtual image formed through the windshield and the user's eye position.

[0074] The target object can be located in front of the image display device. As an example, the target object can be located directly in front of the image display device. The target object can move within the eye-box position range of the HUD system.

[0075] In this way, the relative position of the target object and the image display device can be set to simulate the position of the eye box in the HUD system and the virtual image formed by the windshield. The image effect of the target image observed from the image display device can reflect the image effect of the real virtual image formed by the HUD system. Then, the image effect of the target image can be used to determine whether the current design parameters can be used as target design parameters.

[0076] In embodiments where the target object is the user, the user's feedback on the image effect of the target image can be directly obtained, and based on the feedback, it can be determined whether the current design parameters can be used as the target design parameters of the head-up display system.

[0077] In this embodiment, the feedback result can characterize the user's visual experience when observing the target image. In one example, the visual experience may include at least one of the following: the presence or absence of dizziness, the degree of dizziness, whether the observed target image is distorted, and the degree of image distortion. In this embodiment, the current design parameters can be used as target design parameters based on whether the user experiences dizziness or whether the observed target image is distorted. Alternatively, the current design parameters can be used as target design parameters based on whether the degree of dizziness or the degree of image distortion exceeds a threshold. In this embodiment, the image display effect corresponding to the current design parameters of the HUD system can be intuitively shown to the user, allowing the user to obtain a realistic feeling of the HUD imaging effect, thereby discovering defects in the HUD system design as early as possible.

[0078] In embodiments where the target object is a binocular vision device, the target object can acquire the target image and input it into a processing device to obtain the image effect of the target image. In one example, the processing device can calculate the disparity between the first and second observation images to obtain the binocular disparity of the target image. Based on the magnitude of the binocular disparity, it is determined whether the current design parameters can be used as target design parameters.

[0079] If the image effect of the target image corresponding to the current design parameters meets the design requirements, the current design parameters are determined to be the target design parameters; if the image effect of the target image corresponding to the current design parameters does not meet the design requirements, the current design parameters need to be adjusted, and then the parameter design method of this application embodiment is repeated.

[0080] In this embodiment, a target object and an image display device are introduced to observe the actual imaging effect. The relative positions of the target object and the image display device are used to set the position of the eye box in the simulated HUD system and the virtual image formed by the windshield. During the HUD system parameter design stage, the effect of the virtual image projected on the vehicle's windshield by the user during actual use is predicted in advance by using the target image observed by the target object from the image display device. This allows for the determination of whether the current design parameters meet the target design requirements, thereby designing a more accurate HUD system. Furthermore, the method of this embodiment can identify design defects early in the HUD system parameter design stage, thereby reducing the cost of HUD system performance optimization during actual use.

[0081] In some embodiments, step S140 may include steps S141 to S142.

[0082] Step S141: For any pixel position in the target image, obtain the first binocular parallax corresponding to the current position and the next pixel position.

[0083] In this embodiment, for the same pixel position, the first pixel position obtained from the left eye view and the second pixel position obtained from the right eye view can be obtained respectively; the pixel position deviation between the first pixel position and the second pixel position can be calculated; and the first binocular parallax can be obtained based on the pixel position deviation and the imaging distance of the HUD system.

[0084] In some cases, the first binocular parallax can be calculated using the following formula:

[0085]

[0086] Where, θ ij1 Let be the first binocular disparity corresponding to the next pixel position at the current position. Let i be the number of the current position pair within the eyebox position range. Let j be the pixel position number of the pixel in the target image. Let d be the deviation of the pixel position seen by the left and right eyes for the j-th pixel position. Let l be the imaging distance of the HUD system. In this example, the first binocular disparity is in angular units.

[0087] The first binocular disparity can also be expressed in milliradians (mrad). In this example, the first binocular disparity can be calculated using the following formula:

[0088]

[0089] Step S142: Based on the first binocular parallax, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

[0090] In this embodiment, step S142 may include: obtaining a first binocular disparity set corresponding to all pixel positions; determining a target first binocular disparity based on the first binocular disparity set; and determining that the current design parameters can be used as the target design parameters of the head-up display system when the target first binocular disparity is less than a threshold.

[0091] As an example, the target first binocular disparity can be the largest first binocular disparity in the first binocular disparity set, or it can be the average of all first binocular disparities in the first binocular disparity set. Of course, the target first binocular disparity can also be calculated using other calculation rules.

[0092] In some examples, step S142 may also include: outputting a notification message to adjust the current design parameters if the target first binocular parallax is greater than or equal to a threshold.

[0093] Considering that the positions of different drivers' eyes may be different during actual use of the HUD system, the positions of the virtual images formed by the HUD system may also be different. In other words, the frequency of use of different eye point positions within the eye box position range and the frequency of use of different pixel positions in the formed virtual image may be different. Therefore, in some embodiments, step S142 may include steps S1421 to S1423.

[0094] Step S1421: Obtain the first probability corresponding to the current position and / or the second probability corresponding to the pixel position.

[0095] The first probability is determined based on the frequency of use of the current position pair within the eye-box's position range. The second probability is determined based on the frequency of use of the position point of the pixel within the HUD imaging position. Both the first and second probabilities range from 0 to 1.

[0096] In this embodiment, the frequency of use of each eye point position in the eye box during the actual use of the HUD system and the frequency of use of each virtual image imaging position can be statistically analyzed in advance. Then, the frequency of use of the current position pair can be obtained based on the frequency of use of each eye point position pair in the eye box, and the frequency of use of the position point of each pixel position in the target image can be obtained based on the frequency of use of the virtual image imaging position, thereby determining the first probability and the second probability.

[0097] Step S1422: Determine the second binocular disparity corresponding to the next pixel position at the current position based on at least one of the first probability and the second probability and the first binocular disparity.

[0098] In this embodiment, the second binocular parallax corresponding to the next pixel position at the current position can be determined based on the first probability, the second probability, and the first binocular parallax.

[0099] In some cases, the product of the first probability, the second probability, and the first binocular disparity can be used as the second binocular disparity. As an example, the second binocular disparity can be calculated using the following formula:

[0100] θ ij2 =θ ij1 *a i *b j

[0101] Where, θ ij2 θ represents the second binocular disparity corresponding to the next pixel position from the current position. ij1 Let be the first binocular disparity corresponding to the next pixel position of the current position pair. Let i be the index of the current position pair within the eyebox position range. Let j be the pixel index of the pixel in the target image. i This represents the first probability. (b) j This is the second probability.

[0102] In this embodiment, the second binocular disparity corresponding to the next pixel position can also be determined based on the first binocular disparity and the first probability. In some examples, the product of the first probability and the first binocular disparity can be used as the second binocular disparity.

[0103] In this embodiment, the second binocular disparity corresponding to the next pixel position can also be determined based on the first binocular disparity and the second probability. In some examples, the product of the second probability and the first binocular disparity can be used as the second binocular disparity.

[0104] Step S1423: Based on the second binocular parallax, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

[0105] In some examples, step S1423 may include: obtaining a second binocular disparity set consisting of the second binocular disparities of multiple current position pairs; determining a target second binocular disparity based on the second binocular disparity set; and determining that the current design parameters can be used as the target design parameters of the head-up display system if the target second binocular disparity is less than a threshold.

[0106] As an example, the target's second binocular disparity can be the largest second binocular disparity in the set of second binocular disparities. The target's second binocular disparity D can be calculated using the following formula:

[0107]

[0108] Where, θ ij2 Let be the second binocular disparity corresponding to the pixel position of the j-th target image pixel within the i-th current position pair within the eyebox location range. Let m be the total number of eye point position pairs within the eyebox location range, and n be the total number of pixels in the target image.

[0109] As another example, the target second binocular disparity can also be the average of all second binocular disparities in the set of second binocular disparities.

[0110] This application embodiment takes into account that the usage frequency of different eye point positions is different in the actual use stage of the HUD system, and the usage frequency of different pixel positions of the virtual image formed by the windshield is also different. At least one of these two usage frequencies is mapped to the HUD system parameter design stage, thereby achieving the goal of improving the accuracy of the performance results of the HUD system in advance during the parameter design stage.

[0111] In some embodiments, the parameter design method of this application may further include step S150.

[0112] Step S150: If the current design parameters cannot be used as the target design parameters of the head-up display system, output a notification message to adjust the current design parameters so as to obtain the target design parameters by adjusting the current design parameters through the notification message.

[0113] The notification information in this embodiment may include the current position of the target object and the pixel position of the pixels in the target image when the target image does not meet the design requirements of the head-up display system. This notification information can be used to adjust the reflective units in the head-up display system. As an example, this notification information can be used to adjust the position of the first and / or second reflective units in the head-up display system, and also to adjust the surface shape of the first and / or second reflective units in the head-up display system.

[0114] In embodiments where the target object is a user, when the target image observed by the user exhibits dizziness, or the degree of dizziness exceeds a threshold, or the image is distorted, or the degree of image distortion exceeds a threshold, the specific location provided by the user where dizziness exists, or the degree of dizziness exceeds a threshold, or the image is distorted, or the degree of image distortion exceeds a threshold can be obtained. This allows for adjustment of the current design parameters of the head-up display system based on the specific location, thereby adjusting the imaging effect of the HUD system.

[0115] After adjusting the design parameters of the head-up display system, continue to repeat the above steps of the embodiments of this application until the target design parameters that meet the requirements are obtained.

[0116] This application also provides a parameter design system for a head-up display system, such as... Figure 3 As shown, the system 1000 may include: a target object 1100, an eye-point position acquisition device 1200, an image display device 1300, and a processing device 1400. The position variation range of the left and right eye points of the target object 1100 corresponds to the position range of the eye box in the head-up display system; the position of the image display device 1300 corresponds to the imaging position of the virtual image in the head-up display system; and the distance between the target object 1100 and the image display device 1300 is the imaging distance of the head-up display system.

[0117] The eye point position acquisition device 1200 is used to acquire the current position pairs of the target object corresponding to the left and right eye points, and send the current position pairs to the processing device 1400.

[0118] The processing device 1400 is used to acquire the current image pair associated with the current position pair obtained from the simulation of the current design parameters of the head-up display system, and to transmit the current image pair to the image display device.

[0119] Image display device 1300 is used to display the current image pair so that the target object can observe the target image.

[0120] The target object 1100 is used to observe the current image pair displayed on the image display device 1300 to obtain the target image.

[0121] The processing device 1400 is also used to determine, based on the target image observed by the target object 1100, whether the current design parameters can be used as the target design parameters of the head-up display system.

[0122] In this embodiment, the target object 1100 can be a user or a binocular vision device. The eye point position acquisition device 1200 can be, for example, an eye-tracking device. The image display device 1300 can be, for example, a 3D display. The processing device 1400 can be, for example, a host connected to the image display device 1300.

[0123] Regarding the systems in the above embodiments, the specific ways in which each device performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.

[0124] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the method as described in any of the above method embodiments.

[0125] This application also provides an electronic device, such as... Figure 4 As shown, the electronic device 2000 includes a memory 2100 and a processor 2200. The memory 2100 is used to store computer instructions, and the processor 2200 is used to retrieve the computer instructions from the memory 2100 to execute the method as described in any of the above method embodiments.

[0126] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the device and apparatus embodiments are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0127] The foregoing has described specific embodiments of this application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired results. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0128] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0129] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0130] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0131] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0132] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0133] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0134] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0135] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0136] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. A parameter design method for a head-up display system, characterized in that, include: Obtain the current position pair of the left and right eye points corresponding to the target object; wherein, the position variation range of the left and right eye points corresponds to the position range of the eye box in the head-up display system; Obtain the current image pair associated with the current position pair, obtained from the simulation based on the current design parameters of the head-up display system; The current image pair is output and displayed on an image display device, so that the target object observes the target image; wherein, the position of the image display device corresponds to the imaging position of the virtual image in the head-up display system, and the distance between the target object and the image display device is the imaging distance of the head-up display system; Based on the target image observed from the target object, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

2. The parameter design method for the head-up display system according to claim 1, characterized in that, The target object is a binocular vision device. The step of determining whether the current design parameters can be used as the target design parameters for the head-up display system based on the target image observed by the target object includes: For any pixel position in the target image, obtain the first binocular disparity corresponding to the current position and the next pixel position; Based on the first binocular parallax, determine whether the current design parameters can be used as the target design parameters for the head-up display system.

3. The parameter design method for the head-up display system according to claim 2, characterized in that, The step of determining whether the current design parameters can be used as the target design parameters of the head-up display system based on the first binocular parallax includes: Obtain a first probability corresponding to the current position pair and / or a second probability corresponding to the pixel position; wherein, the first probability is determined based on the frequency of use of the current position pair within the position range of the eye box, and the second probability is determined based on the frequency of use of the position point corresponding to the pixel position within the imaging position; Based on at least one of the first probability and the second probability, and the first binocular disparity, determine the second binocular disparity corresponding to the current position and the next pixel position; Based on the second binocular parallax, it is determined whether the current design parameters can be used as the target design parameters for the head-up display system.

4. The parameter design method for the head-up display system according to claim 3, characterized in that, The step of determining whether the current design parameters can be used as the target design parameters for the head-up display system based on the second binocular parallax includes: Obtain a second binocular disparity set composed of the second binocular disparities of multiple current position pairs; Determine the target's second binocular disparity based on the second binocular disparity set; If the target second binocular parallax is less than a threshold, it is determined that the current design parameters can be used as the target design parameters of the head-up display system.

5. The parameter design method for the head-up display system according to claim 1, characterized in that, The target object is the user, and determining whether the current design parameters can be used as the target design parameters of the head-up display system based on the target image observed by the target object includes: Obtain feedback from the user regarding the image effect of the target image; Based on the feedback results, it is determined whether the current design parameters can be used as the target design parameters for the head-up display system.

6. The parameter design method for the head-up display system according to claim 1, characterized in that, The method further includes: If the current design parameters cannot be used as the target design parameters of the head-up display system, a notification message for adjusting the current design parameters is output so that the target design parameters can be obtained by adjusting the current design parameters through the notification message; The notification information includes the current position pair information of the target object and the pixel position of the pixel in the target image when the target image does not meet the design requirements of the head-up display system. The notification information is used to adjust the reflection unit in the head-up display system.

7. The parameter design method for the head-up display system according to any one of claims 1 to 6, characterized in that, Before obtaining the current image pair associated with the current position pair obtained from the simulation of the current design parameters of the head-up display system, the method further includes: Using the distortion-free image as the first image at the imaging position of the virtual image, and simulating the first image based on the current design parameters, a second image at the image source position in the head-up display system is obtained. Based on the current design parameters, the second image is simulated for each eye point position within the position range of the eye box to obtain a virtual image at the imaging position corresponding to each eye point position; Based on the eye point position and the virtual image corresponding to the eye point position, a set consisting of left and right eye point position pairs and image pairs corresponding to the left and right eye point position pairs is obtained; wherein the set includes the current position pair and the current image pair corresponding to the current position pair.

8. A parameter design system for a head-up display system, characterized in that, include: The system includes a target object, an eye point position acquisition device, an image display device, and a processing device. The position variation range of the left and right eye points of the target object corresponds to the position range of the eye box in the head-up display system. The position of the image display device corresponds to the imaging position of the virtual image in the head-up display system. The distance between the target object and the image display device is the imaging distance of the head-up display system. The eye point position acquisition device is used to acquire the current position pairs of the target object corresponding to the left and right eye points, and send the current position pairs to the processing device; The processing device is used to acquire a current image pair associated with the current position pair obtained by simulation based on the current design parameters of the head-up display system, and to transmit the current image pair to the image display device; The image display device is used to display the current image, so that the target object can observe the target image; The target object is used to observe the current image pair displayed on the image display device to obtain the target image; The processing device is further configured to determine, based on the target image observed by the target object, whether the current design parameters can be used as the target design parameters of the head-up display system.

9. An electronic device, characterized in that, It includes a memory and a processor, the memory being used to store computer instructions, and the processor being used to retrieve the computer instructions from the memory to execute the parameter design method of the head-up display system as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the parameter design method for the head-up display system according to any one of claims 1 to 7.

Images