Methods, apparatus, media, and products for adjusting an image of a vehicle's on-board projection display

Abstract

Embodiments of the present disclosure provide a method, electronic device, medium and program product for adjusting an image of a vehicle-mounted projection display of a vehicle. The method comprises determining a deviation between a first image displayed by the vehicle-mounted projection display and a target image. The method further comprises adjusting a component of the vehicle-mounted projection display based on the deviation, such that the vehicle-mounted projection display outputs a second image, wherein the second image corresponds to the target image. The method implemented by the present disclosure achieves real-time adjustment of the image displayed by the display, reduces material costs in the production process, reduces research and development costs, and can meet more extensive tolerance range correction requirements, improving the reusability and flexibility of the production system.

Description

Technical Field

[0001] This disclosure relates to the field of image display, and more specifically, to methods, electronic devices, media, and program products for adjusting images on an in-vehicle projection display for a vehicle. Background Technology

[0002] As automotive technology continues to develop and mature, consumers' demands for vehicle intelligence, comfort, and safety are also constantly increasing. To enhance the driving experience, more and more new technologies are being introduced into the automotive field. Among them, Head-up Display (HUD) technology, based on its intuitive information presentation method, has been widely used and has become one of the important components of intelligent vehicles.

[0003] HUD technology projects key vehicle information directly onto the windshield in front of the driver, allowing them to monitor the vehicle's status without looking down at the instrument panel or central control screen. For example, in some scenarios, HUD can display real-time vehicle speed, mileage, navigation route, speed limit reminders, road conditions, and other driver assistance information, reducing driver distraction and improving driving safety. The application of HUD technology effectively reduces potential safety hazards caused by looking down at the instrument panel, allowing drivers to focus more intently and smoothly while driving. Summary of the Invention

[0004] Embodiments of this disclosure provide a method, electronic device, medium, and program product for adjusting the image on an in-vehicle projection display of a vehicle.

[0005] According to a first aspect of this disclosure, a method is provided for adjusting an image displayed on an in-vehicle projection display of a vehicle. The method includes determining a deviation between a first image displayed on the in-vehicle projection display and a target image. The method further includes adjusting components of the in-vehicle projection display based on the deviation, such that the in-vehicle projection display outputs a second image, wherein the second image corresponds to the target image.

[0006] According to a second aspect of this disclosure, an electronic device is provided for adjusting an image displayed on an in-vehicle projection display of a vehicle, including a processor and a memory coupled to the processor and storing instructions, which, when executed by the processor, cause the device to perform the steps of adjusting the image displayed on the in-vehicle projection display of a vehicle during the production process according to embodiments of this disclosure.

[0007] In a third aspect of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions that, when executed, cause a computer to perform the steps of a method for adjusting an image displayed on an in-vehicle projection display of a vehicle during the production process, according to embodiments of this disclosure.

[0008] According to a fourth aspect of this disclosure, a computer program product is provided. The computer program product is tangibly stored on a non-volatile computer-readable medium and includes machine-executable instructions that, when executed, cause a machine to perform the steps of a method according to embodiments of this disclosure for adjusting an image displayed on an in-vehicle projection display of a vehicle during production.

[0009] Please note that this summary is provided to introduce some concepts in a simplified form, which will be further described in the detailed embodiments below. The summary is not intended to identify key or essential features of this disclosure, nor is it intended to limit the scope of this disclosure. Attached Figure Description

[0010] The above and other objects, features, and advantages of this disclosure will become clearer through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, in which:

[0011] Figure 1 A schematic diagram of an example environment in which several embodiments of the present disclosure may be implemented is shown;

[0012] Figure 2 A flowchart of an embodiment of the present disclosure for adjusting an image on a vehicle-mounted projection display;

[0013] Figure 3 A schematic diagram illustrating a process for adjusting an image displayed on an in-vehicle projection display of a vehicle according to some embodiments of the present disclosure is shown.

[0014] Figure 4 A schematic diagram illustrating a process for calibrating image distortion according to some embodiments of the present disclosure is shown;

[0015] Figure 5 Further schematic diagrams are shown illustrating a process for calibrating image distortion according to some embodiments of the present disclosure; and

[0016] Figure 6 A schematic block diagram of an example device that can be used to implement embodiments of the present disclosure is shown. Detailed Implementation

[0017] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, they are provided so that this application will be thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted.

[0018] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this application. However, those skilled in the art will recognize that the technical solutions of this application can be practiced without one or more of the specific details, or other methods, components, apparatuses, steps, etc., can be employed. In other instances, well-known methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this application.

[0019] In the description of embodiments of this disclosure, the term "comprising" and its variations should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an embodiment" or "the embodiment" should be understood as "at least one embodiment". Although the terms first, second, third, etc., may be used herein to describe various components, these components should not be limited by these terms. These terms are used to distinguish one component from another. Therefore, the first component discussed below may be referred to as the second component without departing from the teachings of this application. As used herein, the terms "and / or" and similar terms include all combinations of any, multiple, and all of the associated listed items.

[0020] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0021] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0022] As mentioned above, in-vehicle projection displays, including head-up displays (HUDs), can clearly present vehicle driving information within the driver's field of vision through reflection from the windshield, allowing the driver to obtain important driving data in real time without taking their eyes off the road. However, during the vehicle assembly process, the projection effect of the HUD may be affected by certain manufacturing processes. For example, tolerance issues in vehicle manufacturing and installation, such as windshield angle deviations and changes in crossbeam positions, can cause the HUD's projection position to shift. Changes in projection position can lead to image distortion in the virtual image displayed by the HUD, such as distorted, blurry, misaligned, or incomplete display of some information. Therefore, it is necessary to optimize the accuracy of the HUD during the automotive manufacturing and installation process to reduce projection distortion.

[0023] Therefore, embodiments of this disclosure propose a scheme for adjusting the image displayed on a vehicle-mounted projection display. In embodiments of this disclosure, the deviation between a first image displayed on the vehicle-mounted projection display and a target image can be determined first, wherein the first image is the image displayed on the vehicle-mounted projection display before adjustment, and the target image is the desired image displayed on the vehicle-mounted projection display.

[0024] According to some embodiments of this disclosure, components of the vehicle-mounted projection display can also be adjusted based on the deviation, such that the vehicle-mounted projection display outputs a second image, wherein the second image corresponds to the target image. For example, a motor within the vehicle-mounted projection display can rotate the reflector of the vehicle-mounted projection display by a corresponding angle, thereby causing the adjusted second image to reach the desired height of the desired target image.

[0025] The method implemented in this disclosure enables real-time adjustment of images displayed on vehicle-mounted projection displays, reducing material costs and R&D costs in the production process, while also meeting a wider range of tolerance correction requirements and improving the reusability and flexibility of the production system.

[0026] Figure 1 A schematic diagram of an example environment 100 in which various embodiments of the present disclosure may be implemented is shown. It should be understood that these exemplary embodiments are given only to enable those skilled in the art to better understand and implement embodiments of the present disclosure, and are not intended to limit the scope of the present disclosure in any way.

[0027] like Figure 1As shown, the example environment 100 may include elements such as an example vehicle 110 and a server 112 connected thereto. As an example, the vehicle 110 may include an in-vehicle projection display 108, which may be a head-up display or other types of displays such as liquid crystal displays, plasma displays, etc. In some embodiments, the in-vehicle projection display 108 may also be a projection screen located in the rear of the vehicle and electrically retractable without affecting the interior space. It should be understood that this disclosure does not limit the type of in-vehicle projection display 108. In some embodiments of this disclosure, the in-vehicle projection display 108 can project vehicle-related information as a virtual image 106 onto the windshield 102 in front of the vehicle 110, allowing the driver of the vehicle 110 to obtain the necessary driving data without deviating from their line of sight. According to some embodiments of this disclosure, the vehicle 110 may be any motorized or non-motorized vehicle capable of carrying people or goods and having mobility. Figure 1 In the illustration, vehicle 110 is represented as a car. However, it should be understood that this is merely an example and is not limited to cars. Other examples could include trucks, buses, motorcycles, electric vehicles, and many other modes of transportation.

[0028] According to some embodiments of this disclosure, the content of the virtual image 106 may include key information associated with the vehicle 110, such as vehicle speed, navigation information, road conditions, battery level, and fuel consumption. According to some embodiments of this disclosure, the in-vehicle projection display 108 may contain one or more components or elements of a projection device, such as an optical lens (e.g., a reflector), a motor, and a display content generation unit (e.g., an optical engine).

[0029] In some embodiments, by adjusting factors such as the optical angles and positions of various elements of the in-vehicle projection display 108, an image can be projected onto the driver's line of sight 104. In some embodiments, the line of sight 104 may represent the line of sight that the driver is looking at while driving. Additionally or alternatively, the line of sight 104 may also be the line of sight of the front and rear passengers in the vehicle 110. The method implemented according to this disclosure can align the position and direction of the projection of the virtual image 104 with the line of sight 104 of the driver and / or the front and rear passengers without deviation or image distortion causing a deviation in the line of sight.

[0030] According to some embodiments of this disclosure, the vehicle's onboard sensors, GPS module, driver assistance system, and the driver's smartphone can send real-time vehicle status information data, such as current speed, map data, detected road signs, obstacles, and other road information, to a server 112 communicatively connected to the vehicle 110. In some embodiments, the server 112 can subsequently process the received data, such as filtering, calculating, and rendering the received data, to generate image information that can be used to display a virtual image on the in-vehicle projection display 108. When the in-vehicle projection display 108 receives this image information, it can project the image information onto the vehicle's glass 102 and generate a corresponding virtual image 106 for the driver or front and rear passengers to reference.

[0031] It should be understood that the above examples are not intended to be limiting, but are merely illustrative for the purpose of aiding understanding, and the embodiments of this disclosure are not limited to the above examples.

[0032] The above combination Figure 1 A schematic diagram of an example environment 100 in which methods and / or processes according to embodiments of the present disclosure may be implemented is described. The following is in conjunction with... Figure 2 This is a flowchart describing an embodiment of the present disclosure for adjusting an image 200 on an in-vehicle projection display of a vehicle 110.

[0033] At frame 202, the deviation between the first image displayed on the vehicle-mounted projection display and the target image is determined. According to some embodiments of this disclosure, the first image may be the image currently displayed on the vehicle-mounted projection display, i.e., the image or virtual image projected by the vehicle-mounted projection display without adjustment.

[0034] In some cases, due to minor deviations in the windshield angle during vehicle manufacturing and assembly, slight variations in the vehicle crossbeams, or even assembly tolerances of the in-vehicle projection display module itself, the actual height of the first image may be higher or lower than the desired target image height. In some cases, the first image may also exhibit distortion or deformation deviations from the target image. It should be understood that although the data displayed on the in-vehicle projection display in the embodiments of this disclosure is described as images, it may also include video, pictures, animations, and other data, and this disclosure does not impose any limitations on this.

[0035] According to some embodiments of this disclosure, the position of the current first image and the position of the desired target image can be measured and determined using an optical sensor or a laser rangefinder. Additionally or alternatively, according to some embodiments of this disclosure, the offset can be determined by calculating the vertical height difference between the currently projected first image and the desired target image. According to some embodiments of this disclosure, the degree of distortion or coordinate difference in the deviation between the two images can also be determined by sampling corresponding multiple points on the first image and the target image, respectively.

[0036] At frame 204, components of the vehicle-mounted projection display are adjusted based on the height difference, causing the vehicle-mounted projection display to output a second image. For example, according to some embodiments of this disclosure, the height of the second image may be consistent with or correspond to the height of the desired target image. For example, according to some embodiments of this disclosure, the shape or distortion of the second image may be consistent with or correspond to the shape or distortion of the desired target image. According to some embodiments of this disclosure, components of the vehicle-mounted projection display may include one or more components associated with the vehicle-mounted projection display, such as a motor, a reflector, a display content generation unit, etc., for example, a micro motor, and stepper motors, servo motors, etc., for adjusting the angle or height of the projection or virtual image module.

[0037] According to some embodiments of this disclosure, the step size or angle that the motor needs to adjust can be calculated based on the measured height difference, and the angle of the optical reflector in the vehicle-mounted projection display can be adjusted by the motor to correct the projection position, thereby generating a second image with the same height as the desired target image. In some embodiments, the angle that needs to be adjusted can be determined based on the offset and the projection distance of the vehicle-mounted projection display. In some embodiments, the display content generation unit can also be adjusted based on the coordinate difference, for example, by adjusting the distortion by aligning the deviated image coordinate values. By using the method implemented by this disclosure, the image displayed on the vehicle-mounted projection display can be adjusted in real time, reducing material costs in the production process, lowering R&D costs, and meeting a wider range of tolerance correction requirements, thereby improving the reusability and flexibility of the production system.

[0038] Figure 3 A schematic diagram illustrating a process 300 for adjusting an image displayed on an in-vehicle projection display of a vehicle, according to some embodiments of the present disclosure, is shown. Figure 3 As shown, according to an embodiment of this disclosure, during the vehicle generation process, the height of the target virtual image 310 can be determined first to ensure that the projected image or video is located in the optimal line of sight area for the driver or front and rear passengers.

[0039] In some embodiments of this disclosure, a physical calibration plate can be installed on the production line at a calibration station, and the physical calibration plate may have scale markings indicating the desired virtual image height. As an example, the desired target virtual image height for a vehicle design can be determined based on the vehicle's eye-point coordinates, the down-viewing angle (LDA) of the HUD, and the virtual image distance (VID) of the HUD. When the projected virtual image 308 of the vehicle-mounted projection display 302 aligns with the scale line, it indicates that the desired virtual image has been achieved. Additionally or alternatively, in some embodiments, the target virtual image height can be the optical theoretical design value of the virtual image of the head-up vehicle-mounted projection display, which can be based on parameters such as the field of view (FOV), viewing distance, virtual image distance (VID), and linear discriminant analysis (LDA).

[0040] According to some embodiments of this disclosure, calibration software can also be used to display virtual calibration lines for comparison references on the vehicle's in-vehicle projection display 302 or the glass. For example, in some embodiments, the calibration software can set the virtual target line to the center of the vehicle's in-vehicle projection display or the glass. When the displayed virtual image coincides with this line, it indicates that the desired virtual image has been achieved. Additionally or alternatively, driver's view simulation software can also be used to simulate the driver's actual line of sight. For example, in an SUV, the driver's seat height can be 50mm higher than in a sedan, so the height of the target virtual image can also be increased by 50mm accordingly.

[0041] According to some embodiments of this disclosure, the actual height 308 of the virtual image currently displayed on the vehicle-mounted projection display can also be determined to assess its deviation from the height of the target virtual image 310. In some embodiments, a high-precision camera can be installed on the production line to automatically capture images of the virtual image 308 presented by the vehicle-mounted projection display 302 and calculate its deviation relative to a reference line. For example, in one embodiment, the height of the target virtual image 310 may be 130 mm, while the virtual image height 308 determined by the camera is 140 mm. The difference between the two is 10 mm, indicating that the current height of the virtual image 308 is too high.

[0042] Alternatively, the offset can also be determined by laser ranging, for example, by measuring the offset of the projection optical path of the vehicle-mounted projection display 302 using a laser rangefinder. In one embodiment, the target virtual image 310 may be located 0.5m away from the windshield, while the actual measured virtual image 308 appears at 0.6m, indicating that the current virtual image 308 is 10cm away. Alternatively, in some embodiments, the offset can also be determined based on driver feedback. For example, the driver can manually adjust the seat to a normal driving position, record the position of the virtual image, and determine whether the current virtual image 308 is too high or too low based on driver feedback.

[0043] In some embodiments of this disclosure, after determining the position and height deviation between the target virtual image 310 and the current virtual image 308, the number of motor steps to be adjusted can be determined. Various methods can be used to calculate the number of motor steps; as an example, the number of motor steps can be determined using the following formula:

[0044] θ= k × Δh (1)

[0045] N = g(θ) (2)

[0046] Where Δh is the height difference between the target virtual image 310 and the current virtual image 308, k is the corresponding angle change coefficient (e.g., 0.1° / mm) required to adjust the reflector 304 associated with the motor, and g(θ) is the conversion relationship between angle and motor steps, and N is the number of motor steps that need to be adjusted.

[0047] As an example, in one embodiment, the height of the target virtual image 310 can be 130mm, the height of the actual virtual image can be 140mm, the height difference between the two is 10mm, and the angle variation coefficient is 0.1° / mm, then θ is 10mm × 0.1° / mm = 1.0°. In some embodiments, the conversion relationship between angle and motor steps g(θ) can be 200 steps = 1.0°, so the number of motor steps N to be adjusted can be N = 200 × 1.0 = 200 steps. Additionally or alternatively, depending on the type of vehicle produced, different vehicle models may have different conversion relationships between angle and motor steps. For example, for SUV models, g(θ) can be 300 steps = 1.0°, while for sedan models, g(θ) can be 180 steps = 1.0°, and this disclosure does not impose any limitations on this. In some embodiments, the mapping relationship between height difference and motor steps can also be determined based on the length of the vehicle and optical parameters (such as the size of the reflector, the length of the optical path, and the angle).

[0048] After determining the required number of motor rotation steps, the motor can be rotated to rotate the associated reflector, for example, from the reflector position at 306 to 304, correcting the virtual image height so that the virtual image displayed on the vehicle projection display reaches the desired height. In some embodiments, the automatic calibration system on the production line can rotate the motor and adjust the corresponding height by sending adjustment commands.

[0049] Additionally or alternatively, in some embodiments, the production line system can remeasure the height of the virtual image currently displayed on the vehicle projection display 302 after adjustment to confirm whether the target height has been reached. For example, in some embodiments, the production line system's camera can perform secondary detection; the target virtual image height can be 130mm, while the adjusted current virtual image height is 130.5mm, with an error of 0.5mm, and this error is within an allowable threshold range.

[0050] In some embodiments, if the error exceeds the allowed threshold range, such as the adjusted height still being 135mm, the system can automatically calculate a new number of steps and perform a secondary adjustment. In some embodiments, after adjustment, the production system can store the correction data in its control unit and / or memory for subsequent generation, analysis, or optimization without further adjustment. For example, the determined number of motor steps and the angle of rotation can be recorded for subsequent analysis or optimization. Additionally or alternatively, in some embodiments, personalized user data can be stored during the customer-customized generation process for personalized adjustments. Thus, by adjusting the motor, the vehicle's in-vehicle projection display can adapt to installation errors in different vehicles and ensure that the driver sees clear and accurate virtual image information.

[0051] Figure 4 A schematic diagram of a process 400 for calibrating image distortion according to some embodiments of the present disclosure is shown. According to embodiments of the present disclosure, the adjustment process 400 may occur after the adjustment process 300. For example, in some embodiments, process 400 may be performed when the virtual image height is within a certain deviation range. In some embodiments, when the virtual image height exceeds a certain range, process 300 may be performed first, and then process 400 may be performed after the virtual image height reaches the desired height.

[0052] like Figure 4 As shown in the embodiments of this disclosure, during the vehicle manufacturing process, in some cases, due to factors such as optical system distortion, liquid crystal screen deformation (e.g., errors in screen manufacturing or non-uniform deformation caused by thermal expansion and contraction), assembly tolerances, and viewing angle differences (e.g., height differences between different drivers), the virtual image 410 displayed by the vehicle projection display 402 may undergo geometric distortion, affecting readability. Therefore, during the production process, the method implemented in this disclosure can be used to correct these displayed virtual images 410 through image adjustment compensation, thereby achieving the desired virtual image 408.

[0053] According to some embodiments of this disclosure, the distortion of the displayed virtual image 410 may include barrel distortion (e.g., the central part of the image is normal, but the edges expand outward, resembling a "barrel"), pincushion distortion (e.g., the central part of the image is normal, but the edges contract inward, resembling a "pincushion"), trapezoidal distortion (e.g., due to the deviation of the HUD mounting angle, one side of the image is larger and the other side is smaller, resulting in a trapezoidal shape), non-uniform distortion, and the like.

[0054] According to some embodiments of this disclosure, the position and deformation of the actual image 406 on the optical engine 404 of the display content generation unit in the vehicle-mounted projection display 402 can be adjusted so that the position and deformation of the actual image 406 are consistent with those of the target image 412, thereby ensuring that the final virtual image 410 meets the distortion requirements. According to some embodiments of this disclosure, the maximum size of the actual liquid crystal screen on the optical engine 404 can be the maximum range that image distortion correction can utilize.

[0055] Specifically, in some embodiments of this disclosure, the actual shape of the currently displayed virtual image 410 can be determined by combining a camera with a calibration plate. The production system can then determine the deviation between the actual shape of the currently displayed virtual image 410 and the target shape of the target virtual image 408, and determine one of the multiple distortion types mentioned above. In some embodiments of this disclosure, image adjustment compensation parameters can then be determined based on the determined deviation and distortion type; for example, perspective transformation matrices and radial distortion correction parameters can be determined.

[0056] In some embodiments of this disclosure, the position of image 404 on the screen of the optical engine 404 can be adjusted by translation transformation, for example, by offsetting the image in the horizontal direction (X-axis) or vertical direction (Y-axis) to resolve virtual image displacement caused by installation errors. In some embodiments of this disclosure, the geometric distortion of image 404 on the screen of the optical engine 404 can be adjusted by perspective transformation. For example, in some embodiments, trapezoidal distortion caused by the tilt of the optical engine 404 of the vehicle projection display 402 can be corrected by trapezoidal transformation. Additionally or alternatively, in some embodiments, barrel or pincushion distortion compensation (e.g., radial distortion) can be used to achieve nonlinear deformation correction of image distortion caused by the optical system.

[0057] Additionally or alternatively, in some embodiments, the compensated transformed image 412 can be loaded onto the screen of the optical engine 402, ensuring that the adjusted image remains within the effective display range of the screen of the optical engine 402. In some embodiments, a reprojection test can also be performed to determine whether the image-adjusted compensated virtual image 410 meets the requirements. If errors still exist, the transformation parameters can be further adjusted.

[0058] Figure 5Further schematic diagrams of a process 500 for calibrating image distortion according to some embodiments of the present disclosure are shown. During the adjustment of image distortion, the image 510 displayed by the optical engine can be corrected using sampling points. In some embodiments, the image 510 displayed by the optical engine can be divided into a grid and contains a number of sampling points, such as 9 × 21 sampling points, such as sampling point 502, sampling point 504, sampling point 506, etc. In some embodiments, the number and distribution of sampling points can differ under different optical designs; for example, an 11 × 9 sampling point grid is used in some embodiments, while a 16 × 16 grid may be used in other embodiments.

[0059] Each sampling point represents a specific location in the image, where image deviations can be measured and corrected. In some embodiments, these sampling points can be sampled at the edges and center of the display area to ensure that the image across the entire display area is corrected.

[0060] In some embodiments, the coordinate deviation (ΔX, ΔY) between the sampled point and its corresponding point in the target image 520 can be determined. For example, according to some embodiments of this disclosure, the coordinate deviation (ΔX, ΔY) between sampled point 502 and its corresponding point 508 in the target image 520 can be determined. In some embodiments, the coordinate deviation of each sampled point can be calculated using bilinear interpolation. For example, in some embodiments, the deviation of the sampled point can be determined based on the coordinate values ​​of four known points. Additionally or alternatively, in some embodiments of this disclosure, if the mapping relationship is non-linear, more frequent interpolation methods, such as cubic interpolation, can be used to determine the deviation.

[0061] In some embodiments, bilinear interpolation can be applied to correct all sampling points. Additionally or alternatively, in some embodiments, a distortion matrix can be determined based on the sampled points to determine the deviation of other pixels. In some embodiments, the production system can adjust the position of each pixel based on the distortion matrix to ensure that the final displayed image 510 is consistent with the target image 520. Additionally or alternatively, in some embodiments, distortion correction can be performed using a larger liquid crystal screen optical engine based on the dimensions defined by the optical path design. In some embodiments, the range of vertical image movement can be expanded without motor compensation, and distortion correction can be achieved through graphic compensation processes 400 and 500.

[0062] Additionally or alternatively, in some embodiments, the vehicle production system may define distortion tolerance thresholds based on different design requirements of different vehicle models, thereby achieving an acceptable level of accuracy in the displayed images. For example, a maximum of 5% virtual image distortion tolerance may be allowed for some vehicle models, while 3% virtual image distortion tolerance may be allowed for others.

[0063] Figure 6 A schematic block diagram of an example device 600 that can be used to implement embodiments of the present disclosure is shown. Figure 1 The vehicle equipment described herein can be implemented using device 600. As shown, device 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes based on computer program instructions stored in read-only memory (ROM) 602 or loaded from storage unit 608 into random access memory (RAM) 603. RAM 603 can also store various programs and data required for the operation of device 600. CPU 601, ROM 602, and RAM 603 are interconnected via bus 604. Input / output (I / O) interface 605 is also connected to bus 604.

[0064] Multiple components in device 600 are connected to I / O interface 605, including: input unit 606, such as keyboard, mouse, etc.; output unit 607, such as various types of displays, speakers, etc.; memory 607, such as disk, optical disk, etc.; and communication unit 609, such as network card, modem, wireless transceiver, etc. Communication unit 609 allows device 600 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0065] The various processes and procedures described above, such as method 200, can be executed by processing unit 601. For example, in some embodiments, method 200 may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on device 600 via ROM 602 and / or communication unit 609. When the computer program is loaded into RAM 603 and executed by CPU 601, one or more actions of method 200 and process 300 described above may be performed.

[0066] This disclosure can be a method, apparatus, system, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for performing various aspects of this disclosure.

[0067] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0068] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0069] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0070] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0071] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0072] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0073] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0074] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for adjusting an image displayed on an in-vehicle projection display of a vehicle, comprising: Determine the deviation between the first image displayed on the vehicle-mounted projection display and the target image; as well as The components of the vehicle-mounted projection display are adjusted based on the deviation, so that the vehicle-mounted projection display outputs a second image, wherein the second image corresponds to the target image.

2. The method of claim 1, wherein the components of the vehicle-mounted projection display include at least a motor and a reflector associated with the vehicle-mounted projection display, and wherein adjusting the components of the vehicle-mounted projection display based on the deviation comprises: The reflector is adjusted based on the height difference in the deviation.

3. The method according to claim 1, wherein the height of the target image is determined by placing a physical calibration plate based on a calibration station or setting a virtual calibration plate as a comparison reference, and wherein the height of the target image is determined based on one or more of the field of view, virtual image distance, and viewing distance.

4. The method of claim 2, wherein adjusting the reflector based on the height difference in the deviation comprises: The mapping relationship between the height difference and the number of motor steps of the motor is determined based on the length and optical parameters of the vehicle. as well as The reflector is rotated by a corresponding angle based on the mapping relationship between the height difference and the number of motor steps.

5. The method of claim 2, wherein the component of the vehicle-mounted projection display further comprises a display content generation unit, and wherein the component of adjusting the vehicle-mounted projection display based on the deviation further comprises: Multiple image points are acquired in the first image; Determine the coordinate difference in the deviation between the plurality of image points and the plurality of target image points of the target image, wherein the plurality of image points correspond to the plurality of target image points; as well as The display content generation unit is adjusted based on the coordinate difference to output a third image.

6. The method of claim 5, wherein determining the plurality of target image points corresponding to the plurality of image points comprises: The multiple target image points are determined based on the number of image points collected, the optical path of the vehicle-mounted projection display, and the number of image points collected.

7. The method of claim 5, wherein determining the coordinate difference between the plurality of image points and the plurality of target image points of the target image comprises: Based on the screen distortion matrix of the vehicle-mounted projection display, the coordinate values ​​of the plurality of image points in the first image, and the coordinate values ​​of the plurality of target image points in the target image, the coordinate difference is determined by aligning the plurality of image points with the plurality of target image points.

8. The method according to claim 5, wherein adjusting the display content generation unit based on the coordinate difference comprises: The display content generation unit associated with the vehicle-mounted projection display is adjusted based on a defined correction range.

9. The method of claim 5, wherein the second image corresponds to the height of the target image, and the third image corresponds to the distortion of the target image; and The in-vehicle projection display mentioned above is a head-up display.

10. The method of claim 5, further comprising: In response to completing the output of the second image based on the height difference, the third image is output based on the second image and the coordinate difference.

11. An electronic device for adjusting an image displayed on a vehicle's in-vehicle projection display, comprising: processor, and A memory, coupled to the processor, stores instructions that, when executed by the processor, cause the device to perform the method according to any one of claims 1 to 10.

12. A computer-readable storage medium storing computer-executable instructions that, when executed, cause a computer to perform the method according to any one of claims 1 to 10.

13. A computer program product tangibly stored on a non-volatile computer-readable medium and comprising machine-executable instructions that, when executed, cause a machine to perform the method according to any one of claims 1 to 10.

Images