A method, apparatus and vehicle for evaluating a display design

Abstract

The display design evaluation method, device and vehicle disclosed by the embodiments of the present application comprise the following steps: obtaining a plurality of eye positions in an eye box and a coordinate system of an image generation unit in a target display; determining a mapping relationship of a coordinate of a light ray passing through an eye position in the coordinate system to a coordinate of a virtual image plane; mapping a coordinate of an object point in the coordinate system of the target display to the coordinate of the virtual image plane according to the mapping relationship to obtain a coordinate of the object point on the virtual image plane; modeling in a virtual reality scene based on the coordinate of the object point mapped to the virtual image plane and the eye box to obtain a binocular position model; and evaluating the design of the target display based on the binocular position model and a picture projection value target device in the eye box and according to a state of the picture of the projection value target device. The display design evaluation method, device and vehicle provided by the embodiments of the present application can reduce the time and cost risks caused by mold opening.

Description

Technical Field

[0001] This invention relates to display technology, and more particularly to a method, apparatus, and vehicle for evaluating display design. Background Technology

[0002] As visual optical devices, displays such as HUDs (Head-Up Displays) require attention not only to conventional aberrations during design but also to parameters affecting viewing comfort, such as dynamic distortion and parallax. However, parameters like dynamic distortion and parallax are highly subjective, and subjective evaluation can only begin after the molds for each optical lens are made and assembled. This process is time-consuming and costly. If distortion or parallax occurs after this process is completed, there will be losses in investment and time. Summary of the Invention

[0003] This invention provides a method, apparatus, and vehicle for evaluating display designs to reduce the time and cost risks associated with mold making.

[0004] In a first aspect, embodiments of the present invention provide a method for evaluating display design, including:

[0005] Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box;

[0006] Determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image surface; the virtual image surface is the virtual image surface of the image generation unit;

[0007] Based on the mapping relationship, the coordinates of the object point of the target display in the coordinate system are mapped to the virtual image surface to obtain the coordinates of the object point in the virtual image surface;

[0008] Based on the coordinates of the object point mapped to the virtual image surface and the eye box, a model is created in the virtual reality scene to obtain a binocular position model;

[0009] Based on the binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device.

[0010] Optionally, the eye position includes multiple fields of view, and determining the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane includes:

[0011] Determine the mapping relationship between the coordinates of the light rays passing through each field of view at each eye position in the coordinate system of the image generation unit and the coordinates of the virtual image surface.

[0012] Optionally, the step of mapping the coordinates of the object point of the target display in the coordinate system to the virtual image surface according to the mapping relationship, to obtain the coordinates of the object point in the virtual image surface, includes:

[0013] Based on the mapping relationship, the coordinates of the object point in the coordinate system of the image generation unit are mapped to the coordinates of the virtual image surface.

[0014] Optionally, determining the mapping relationship between the coordinates of the light rays passing through each field of view at each eye position in the coordinate system of the image generation unit and the coordinates of the virtual image surface includes:

[0015] Establish a subsystem for each eye position, and in the subsystem, trace the coordinates of the light rays passing through each field of view on the virtual image plane and the coordinates in the coordinate system of the image generation unit;

[0016] The mapping relationship is obtained by mapping the coordinates of the light rays passing through each field of view on the virtual image plane to the coordinates in the coordinate system of the image generation unit.

[0017] Optionally, the step of modeling in the virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box to obtain a binocular position model includes:

[0018] Based on the coordinates of the object point mapped to the virtual image surface and the eye box, an eye position model is obtained by modeling in the virtual reality scene.

[0019] Based on the preset binocular distance and the center point of the eye position model, the center point of the eye position model is taken as the midpoint of the preset binocular distance, and the two endpoints of the preset binocular distance are taken as the two eye positions, thus obtaining the binocular position model.

[0020] Optionally, projecting the image in the eye box onto the target device based on the binocular position model includes:

[0021] Based on the binocular position model, the image of the target eye position in the eye box is projected onto the target device; the target eye position is the position in the eye box determined by the target device.

[0022] Optionally, evaluating the design of the target display based on the state of the image projected onto the target device includes:

[0023] If the distortion and / or parallax of the image of the target device exceeds a preset range, the design of the target display is determined to be unqualified.

[0024] If the distortion and parallax of the target device's image are within the preset range, then the design of the target display is deemed qualified.

[0025] Optionally, the target device is a virtual reality head-mounted display device, and the target display is a vehicle head-up display.

[0026] Secondly, embodiments of the present invention provide an evaluation device for display design, comprising:

[0027] The information acquisition module is used to acquire the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box;

[0028] An information determination module is used to determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image surface; the virtual image surface is the virtual image surface of the image generation unit;

[0029] Based on the mapping relationship, the coordinates of the object point of the target display in the coordinate system are mapped to the virtual image surface to obtain the coordinates of the object point in the virtual image surface;

[0030] The model determination module is used to model in a virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box to obtain a binocular position model;

[0031] The design evaluation module is used to project the image in the eye box onto the target device based on the binocular position model, and to evaluate the design of the target display based on the state of the image projected onto the target device.

[0032] Thirdly, embodiments of the present invention provide a vehicle including a head-up display, wherein the evaluation method for display design as described in the first aspect is applied to the head-up display.

[0033] The display design evaluation method, device, and vehicle provided in this invention determine the mapping relationship between the coordinates of light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane by acquiring a coordinate system and eye position. Based on the mapping relationship, the coordinates of the object point of the target display, such as a HUD, in the coordinate system are mapped to the virtual image plane to obtain the coordinates of the object point in the virtual image plane. Based on the coordinates of the object point mapped to the virtual image plane and the eye box, a model is created in the virtual reality scene to obtain a binocular position model. Based on the binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device. For example, based on the binocular position model, the image of the target eye position in the eye box is projected onto the target device. If the image of the target device has distortion and / or parallax, the optical design of the target display is determined to be unqualified. The above evaluation process of the HUD can be completed during the optical design of the HUD, without having to evaluate it after the molds and assembly of each optical lens of the HUD are completed, thereby reducing the time and cost risks associated with mold making. Attached Figure Description

[0034] Figure 1This is a flowchart of an evaluation method for display design provided in Embodiment 1 of the present invention;

[0035] Figure 2 This is a schematic diagram of a field-of-view sampling point provided in Embodiment 1 of the present invention;

[0036] Figure 3 This is a schematic diagram of an eye position sampling point provided in Embodiment 1 of the present invention;

[0037] Figure 4 This is a flowchart of an evaluation method for display design provided in Embodiment 2 of the present invention;

[0038] Figure 5 This is a schematic diagram of a mapping relationship provided in Embodiment 2 of the present invention;

[0039] Figure 6 This is a schematic diagram of the coordinates of a virtual image plane provided in Embodiment 2 of the present invention;

[0040] Figure 7 This is a schematic diagram of a binocular position model and an eye box provided in Embodiment 2 of the present invention;

[0041] Figure 8 This is a schematic diagram of the eye positions distributed in an eye box according to Embodiment 2 of the present invention;

[0042] Figure 9 This is a structural block diagram of a display design evaluation device provided in Embodiment 3 of the present invention;

[0043] Figure 10 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Detailed Implementation

[0044] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.

[0045] Example 1

[0046] Figure 1 This is a flowchart of a display design evaluation method provided in Embodiment 1 of the present invention. This embodiment can be applied to the evaluation of display designs such as HUDs. The method can be executed by a display design evaluation device, which can be integrated into an electronic device such as a computer. The electronic device can be implemented in software and / or hardware. The method specifically includes the following steps:

[0047] Step 110: Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box.

[0048] For example, the target display is a HUD, which is used in vehicles. The optical design data of the HUD comes from sequential optics software. To facilitate control of structural parameters, a reverse design is usually adopted, that is, light rays are traced from the virtual image surface to the PGU (Picture Generate Unit) in the HUD. The eyebox is the area of ​​eye movement that allows a viewer, such as a driver, to see the complete displayed image. The coordinate information of the PGU includes the coordinate system of the PGU.

[0049] The coordinate system of the image generation unit is the PGU coordinate system, which can be the coordinate system established by the HUD in the PGU. Each eye position in the eye box includes multiple fields of view, and multiple eye positions can be sampled in the eye box, with multiple fields of view sampled for each eye position. Figure 2 This is a schematic diagram of a field-of-view sampling point provided in Embodiment 1 of the present invention, for reference. Figure 2 The field of view is sampled using an 11x11 grid. Figure 3 This is a schematic diagram of an eye position sampling point provided in Embodiment 1 of the present invention, for reference. Figure 3 Sampling was performed at 5mm intervals for each eye position within the eye box, which measures 130mm x 50mm. The number of sampled eye positions was 27 x 11. Each sampled eye position had an 11x11 grid sampling field of view.

[0050] Step 120: Determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image surface; the virtual image surface is the virtual image surface of the image generation unit.

[0051] Specifically, based on the PGU coordinate system and eye position, the coordinates of each field of view at each eye position, i.e., the coordinates of the light rays passing through the eye position in the PGU coordinate system and the coordinates on the virtual image plane, can be determined. Thus, the mapping relationship between the coordinates of each field of view at each eye position in the PGU coordinate system and the coordinates on the virtual image plane can be obtained.

[0052] Step 130: Based on the mapping relationship, map the coordinates of the object point on the target display in the coordinate system to the virtual image surface to obtain the coordinates of the object point on the virtual image surface.

[0053] Specifically, based on the obtained mapping relationship, the object point of the target display, such as a coordinate point in the PGU coordinate system, is mapped onto the virtual image surface in the PGU coordinate system, thereby obtaining the coordinates of that object point on the virtual image surface. (Reference) Figure 2 and Figure 3 Based on the coordinate system and eye position, establish subsystems for each eye position, such as... Figure 3The 27x11 eye position shown establishes 27x11 subsystems. In the mn-th subsystem (where m is the column order, 0 ≤ m < 27, and n is the row order, 0 ≤ n < 11, and both m and n are integers), the coordinates of the principal rays of the 11x11 fields of view on the virtual image plane and in the coordinate system of the image generation unit are traced. Based on the coordinates of each field of view on the virtual image plane and in the coordinate system of the image generation unit, the mapping relationship is determined. Based on the mapping relationship, the coordinates of the object point in the coordinate system of the image generation unit are mapped to the coordinates on the virtual image plane.

[0054] Step 140: Based on the coordinates of the object point mapped to the virtual image plane and the eye box, model the virtual reality scene to obtain the binocular position model.

[0055] Specifically, based on the coordinates of the object point mapped to the virtual image plane and the eye box, a model is created in the virtual reality scene to obtain the eye position model; based on the preset binocular distance and the center point of the eye position model, the center point of the eye position model is taken as the midpoint of the preset binocular distance, and the two endpoints of the preset binocular distance are taken as the two eye positions to obtain the binocular position model.

[0056] Step 150: Based on the binocular position model, project the image in the eye box onto the target device, and evaluate the design of the target display based on the state of the image projected onto the target device.

[0057] Specifically, based on the binocular position model, the image of the target eye position in the eye box is projected onto the target device, such as a virtual reality head-mounted display device. The target eye position is the position in the eye box determined by the target device. If the distortion and / or parallax of the image on the target device exceeds the preset range, the optical design of the target display is deemed unqualified. If the distortion and parallax of the image on the target device are within the preset range, the optical design of the target display is deemed qualified.

[0058] The display design evaluation method provided in this embodiment determines the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane by acquiring the coordinate system and eye position. Based on the mapping relationship, the coordinates of the object point of the target display, such as HUD, in the coordinate system are mapped to the virtual image plane to obtain the coordinates of the object point in the virtual image plane. Based on the coordinates of the object point mapped to the virtual image plane and the eye box, a model is created in the virtual reality scene to obtain a binocular position model. Based on the binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device. For example, based on the binocular position model, the image of the target eye position in the eye box is projected onto the target device. If the image of the target device has distortion and / or parallax, the optical design of the target display is determined to be unqualified. The above evaluation process of HUD can be completed during the optical design of HUD, without having to evaluate after the mold making and assembly of each optical lens of HUD is completed, thereby reducing the time and cost risks brought about by mold making.

[0059] Example 2

[0060] Figure 4 This is a flowchart of a display design evaluation method provided in Embodiment 2 of the present invention. This embodiment can be applied to the evaluation of display designs such as HUDs. The method can be executed by a display design evaluation device, which can be integrated into an electronic device such as a computer. The electronic device can be implemented in software and / or hardware. The method specifically includes the following steps:

[0061] Step 210: Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box.

[0062] For example, the target display is a HUD, which is used in vehicles. The optical design data of the HUD comes from sequential optics software. To facilitate the control of structural parameters, a reverse design is usually adopted, that is, light rays are traced from the virtual image plane to the PGU (Picture Generate Unit) in the HUD. The eye box is the area of ​​eye movement that allows a viewer, such as a driver, to see the complete displayed image. The PGU coordinate system is the coordinate system of the Picture Generate Unit, and the PGU coordinate system can be the coordinate system established by the HUD on the PGU. Each eye position in the eye box includes multiple fields of view; multiple eye positions can be sampled from the eye box, and multiple fields of view can be sampled from each eye position.

[0063] Step 220: Establish subsystems for each eye position, and trace the coordinates of the light rays passing through each field of view on the virtual image plane and in the coordinate system of the image generation unit within the subsystems.

[0064] For details, please refer to Figure 2 and Figure 3 Establish subsystems for each eye position, such as Figure 3 The 27x11 eye position shown establishes 27x11 subsystems. In the mn-th subsystem (m is the column order 0≤m<27, n is the row order 0≤n<11, and m and n are both integers), the coordinates of the light rays passing through each field of view, such as the principal rays of the 11x11 fields of view, are traced in the coordinates of the virtual image plane and the coordinates of the image generation unit, so as to obtain the coordinates of each field of view of each eye position in the PGU coordinate system and the coordinates of the virtual image plane.

[0065] Step 230: Map the coordinates of the light rays passing through each field of view on the virtual image plane to their coordinates in the coordinate system of the image generation unit to obtain the mapping relationship.

[0066] For example, Figure 5 This is a schematic diagram of a mapping relationship provided in Embodiment 2 of the present invention. (Reference) Figure 5By mapping the coordinates Cv-mn of each field of view on the virtual image plane to the coordinates Cp-mn of the PGU, we can obtain the mapping relationship F-mn from the PGU coordinates to the coordinates on the virtual image plane at the mn-th eye position (object-image mapping).

[0067] Step 240: Based on the mapping relationship, determine the coordinates of the object point in the coordinate system of the image generation unit and their mapping to the coordinates of the virtual image surface.

[0068] For example, Figure 6 This is a schematic diagram of the coordinates of a virtual image plane according to Embodiment 2 of the present invention. (Reference) Figure 6 The light rays passing through the central eye point, with coordinates Cp-MN in the PGU coordinate system (which can be used as the coordinates of the object point), are mapped onto the virtual image plane via F-mn (including F-00, F-01…F-MN, where m is an integer between 0 and M, n is an integer between 0 and N, and M and N are both integers greater than 0). This results in the image point distribution, i.e., the coordinates C'v-mn (including C'v-00, C'v-01…C'v-MN), corresponding to the coordinates of different eye positions on the virtual image plane. For example, according to the mapping relationship F-00, the coordinates Cp-MN in the PGU coordinate system are mapped onto the virtual image plane to obtain coordinates C'v-00; according to the mapping relationship F-01, the coordinates Cp-MN in the PGU coordinate system are mapped onto the virtual image plane to obtain coordinates C'v-01; and according to the mapping relationship F-MN, the coordinates Cp-MN in the PGU coordinate system are mapped onto the virtual image plane to obtain coordinates C'v-MN. The coordinates Cp-MN of the ray passing through the central eye point in the PGU coordinate system can be obtained through ray tracing. For details, please refer to existing ray tracing technologies, which will not be elaborated here.

[0069] Step 250: Based on the coordinates of the object point mapped to the virtual image surface and the eye box, model the virtual reality scene to obtain the eye position model.

[0070] Specifically, taking HUD applications in vehicles as an example, in a VR scenario, the Z-axis and plane are first established based on gyroscope information and matched with the vehicle's coordinate system. For example... Figure 3 As shown, the coordinates of the virtual image points (object points) of 27x11 eye positions are mapped to the coordinates of the virtual image surface, and the eye boxes are modeled in the VR scene to obtain the eye position model.

[0071] Step 260: Based on the preset binocular distance and the center point of the eye position model, take the center point of the eye position model as the midpoint of the preset binocular distance, and take the two endpoints of the preset binocular distance as the two eye positions respectively to obtain the binocular position model.

[0072] For example, Figure 7 This is a schematic diagram of a binocular position model and an eye box provided in Embodiment 2 of the present invention. Figure 8 This is a schematic diagram of the eye placement in an eye box according to Embodiment 2 of the present invention. (Reference) Figure 7 and Figure 8 The preset binocular distance is 65mm. The left and right eye positions of the binocular model each have their corresponding projections on the eye box. The midpoint A of the line connecting the left eye position L and the right eye position R (the two endpoints of the preset binocular distance) is the center point of the eye position model. Based on the left eye position L, the right eye position R, and the midpoint A, the following is obtained: Figure 7 The model shows the position of both eyes. The midpoint A undergoes three-dimensional translation with the gyroscope position signal, and the two arms rotate around the center with the gyroscope rotation signal, ultimately projecting onto the eye box.

[0073] Step 270: Based on the binocular position model, project the image of the target eye position in the eye box onto the target device. The target eye position is the position in the eye box determined by the target device.

[0074] For example, the target device is a virtual reality head-mounted display device. After the wearer starts the dynamic experience, the virtual reality head-mounted display device first sets the current position as the reference position, defines the component of the current gaze in the horizontal plane as the X direction, and defines the YZ plane where the wearer's eyes are located as the eye box plane; the virtual reality head-mounted display device collects the translation and rotation information (including position offset and tilt angle) of the gyroscope (located in the virtual reality head-mounted display device) in real time, and matches the positions of the left and right eyes to the nearest eye points p1 and p2 in the eye box in real time. The positions of eye points p1 and p2 are the target eye positions, such as... Figure 8 As shown, the evaluation device for the display design projects the scene models of eye points p1 and p2 onto the left and right display channels of the virtual reality head-mounted display device in real time.

[0075] Step 280: If the distortion and / or parallax of the target device's screen exceeds the preset range, then the design of the target display is determined to be unqualified.

[0076] Specifically, if the distortion and / or parallax of the target device's image exceeds the preset range, it indicates that the optical design of the target display is unqualified and needs to be adjusted.

[0077] Step 290: If the distortion and parallax of the target device's screen are within the preset range, then the design of the target display is deemed qualified.

[0078] Specifically, if the distortion and parallax of the target device's image are within the preset range, it indicates that the optical design of the target display is qualified, and the next step, such as the molding and assembly of the various optical lenses of the HUD, can be carried out.

[0079] It should be noted that the magnitude of each parameter in this embodiment can be determined according to the actual evaluation requirements, and is not limited here.

[0080] The display design evaluation method provided in this embodiment is based on a determined binocular position model. The image of the target eye position in the eye box is projected onto the target device. If the distortion and / or parallax of the image of the target device exceeds a preset range, the optical design of the target display, such as a HUD, is determined to be unqualified. The above-mentioned evaluation process of the HUD can be completed during the optical design of the HUD, without having to evaluate it after the molds of each optical lens of the HUD are made and assembled, thereby reducing the time and cost risks brought about by mold making.

[0081] Example 3

[0082] Figure 9 This is a structural block diagram of a display design evaluation device provided in Embodiment 3 of the present invention. (Reference) Figure 9 The evaluation device for display design includes: an information acquisition module 310, an information determination module 320, a coordinate determination module 330, a model determination module 340, and a design evaluation module 350. The information acquisition module 310 acquires the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box. The information determination module 320 determines the mapping relationship between the coordinates of light rays passing through the eye positions in the coordinate system and the coordinates of the virtual image surface. The virtual image surface is the virtual image surface of the image generation unit. The coordinate determination module 330 maps the coordinates of the object point of the target display in the coordinate system to the virtual image surface according to the mapping relationship, obtaining the coordinates of the object point on the virtual image surface. The model determination module 340 models the virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box to obtain a binocular position model. The design evaluation module 350 projects the image in the eye box onto the target device based on the binocular position model and evaluates the design of the target display based on the state of the image projected onto the target device.

[0083] Based on the above implementation, the eye position includes multiple fields of view, and the information determination module 320 is specifically used to determine the mapping relationship between the coordinates of the light rays passing through each field of view in each eye position in the coordinate system of the image generation unit and the coordinates of the virtual image plane.

[0084] Optionally, the coordinate determination module 330 is specifically used to determine the coordinates of the object point in the coordinate system of the graphics generation unit and the coordinates of the virtual image surface according to the mapping relationship.

[0085] Based on the above implementation method, the information determination module 320 includes:

[0086] The coordinate tracing subunit is used to establish the subsystem for each eye position, and to trace the coordinates of the light rays passing through each field of view on the virtual image plane and in the coordinate system of the image generation unit within the subsystem.

[0087] The mapping determination sub-unit is used to map the coordinates of the light rays passing through each field of view on the virtual image plane to their coordinates in the coordinate system of the image generation unit, thus obtaining the mapping relationship.

[0088] In one implementation, the model determination module 340 includes:

[0089] The first model determination unit is used to model the virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box, and obtain the eye position model.

[0090] The second model determination unit is used to determine the binocular position model by setting the center point of the eye position model as the midpoint of the preset binocular distance and the two endpoints of the preset binocular distance as the two eye positions.

[0091] Optionally, the design evaluation module 350 includes:

[0092] The projection unit is used to project the image of the target eye position in the eye box to the target device based on the binocular position model; the target eye position is the position in the eye box determined by the target device.

[0093] The evaluation unit is used to evaluate the design of the target display based on the state of the screen on the target device.

[0094] Optionally, the evaluation unit is specifically used to determine that the design of the target display is unqualified if the distortion and / or parallax of the target device's image exceeds a preset range; and to determine that the design of the target display is qualified if the distortion and parallax of the target device's image are within a preset range.

[0095] This embodiment also provides a vehicle, including a head-up display, wherein the evaluation method for display design as described in any embodiment of the present invention is applied to the head-up display.

[0096] The display design evaluation device and vehicle provided in this embodiment belong to the same inventive concept as the display design evaluation method provided in any embodiment of the present invention, and have corresponding beneficial effects. For technical details not covered in this embodiment, please refer to the display design evaluation method provided in any embodiment of the present invention.

[0097] Example 4

[0098] Figure 10 This is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of the present invention. Figure 10 A block diagram is shown of an exemplary electronic device 412 suitable for implementing embodiments of the present invention. Figure 10 The electronic device 412 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.

[0099] like Figure 10As shown, electronic device 412 is represented in the form of a general-purpose device. The components of electronic device 412 may include, but are not limited to: one or more processors 416, storage device 428, and bus 418 connecting different system components (including storage device 428 and processor 416).

[0100] Bus 418 represents one or more of several bus architectures, including a memory device bus or memory device controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. Examples of these architectures include, but are not limited to, the Industry Subversive Alliance (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus.

[0101] Electronic device 412 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by electronic device 412, including volatile and non-volatile media, removable and non-removable media.

[0102] Storage device 428 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 430 and / or cache memory 432. Electronic device 412 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 434 may be used to read and write non-removable, non-volatile magnetic media (… Figure 10 Not shown; usually referred to as a "hard drive"). Although Figure 10Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk") and an optical disc drive for reading and writing to a removable non-volatile optical disc (e.g., a Compact Disc Read-Only Memory, CD-ROM), a Digital Video Disc Read-Only Memory, DVD-ROM, or other optical media may be provided. In these cases, each drive may be connected to bus 418 via one or more data media interfaces. Storage device 428 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present invention.

[0103] A program / utility 440 having a set (at least one) of program modules 442 may be stored in, for example, a storage device 428. Such program modules 442 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 442 typically perform the functions and / or methods described in the embodiments of the present invention.

[0104] Electronic device 412 can also communicate with one or more external devices 414 (e.g., keyboard, pointing terminal, display 424, etc.), and with one or more terminals that enable a user to interact with the electronic device 412, and / or with any terminal that enables the electronic device 412 to communicate with one or more other computing terminals (e.g., network card, modem, etc.). This communication can be performed via input / output (I / O) interface 422. Furthermore, electronic device 412 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 420. Figure 10 As shown, network adapter 420 communicates with other modules of electronic device 412 via bus 418. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with electronic device 412, including but not limited to: microcode, terminal drivers, redundant processors, external disk drive arrays, Redundant Arrays of Independent Disks (RAID) systems, tape drives, and data backup storage systems.

[0105] The processor 416 executes various functional applications and data processing by running programs stored in the storage device 428, such as implementing the display design evaluation method provided in the embodiments of the present invention, which includes:

[0106] Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box;

[0107] Determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane; the virtual image plane is the virtual image plane of the image generation unit;

[0108] Based on the mapping relationship, the coordinates of the object point of the target display in the coordinate system are mapped to the virtual image surface to obtain the coordinates of the object point in the virtual image surface;

[0109] Based on the coordinates of the object point mapped to the virtual image surface and the eyebox, a model is created in the virtual reality scene to obtain the binocular position model;

[0110] Based on a binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device.

[0111] Example 5

[0112] Embodiment 5 of the present invention also provides a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the program implements the evaluation method for display design as provided in the embodiments of the present invention, the method comprising:

[0113] Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box;

[0114] Determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane; the virtual image plane is the virtual image plane of the image generation unit;

[0115] Based on the mapping relationship, the coordinates of the object point of the target display in the coordinate system are mapped to the virtual image surface to obtain the coordinates of the object point in the virtual image surface;

[0116] Based on the coordinates of the object point mapped to the virtual image surface and the eyebox, a model is created in the virtual reality scene to obtain the binocular position model;

[0117] Based on a binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device.

[0118] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0119] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0120] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including—but not limited to—wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0121] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or terminal. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0122] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, rearrangements, combinations, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.

Claims

1. A method for evaluating display design, characterized in that, include: Obtain the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box; Determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image surface; the virtual image surface is the virtual image surface of the image generation unit; Based on the mapping relationship, the coordinates of the object point of the target display in the coordinate system are mapped to the virtual image surface to obtain the coordinates of the object point in the virtual image surface; Based on the coordinates of the object point mapped to the virtual image surface and the eye box, a model is created in the virtual reality scene to obtain a binocular position model; Based on the binocular position model, the image in the eye box is projected onto the target device, and the design of the target display is evaluated based on the state of the image projected onto the target device.

2. The evaluation method for display design according to claim 1, characterized in that, The eye position includes multiple fields of view, and determining the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image plane includes: Determine the mapping relationship between the coordinates of the light rays passing through each field of view at each eye position in the coordinate system of the image generation unit and the coordinates of the virtual image surface.

3. The evaluation method for display design according to claim 2, characterized in that, The step of mapping the coordinates of the object point of the target display in the coordinate system to the virtual image surface according to the mapping relationship, and obtaining the coordinates of the object point in the virtual image surface, includes: Based on the mapping relationship, the coordinates of the object point in the coordinate system of the image generation unit are mapped to the coordinates of the virtual image surface.

4. The evaluation method for display design according to claim 2, characterized in that, Determining the mapping relationship between the coordinates of the light rays passing through each field of view at each eye position in the coordinate system of the image generation unit and the coordinates of the virtual image surface includes: Establish a subsystem for each eye position, and in the subsystem, trace the coordinates of the light rays passing through each field of view on the virtual image plane and the coordinates in the coordinate system of the image generation unit; The mapping relationship is obtained by mapping the coordinates of the light rays passing through each field of view on the virtual image plane to the coordinates in the coordinate system of the image generation unit.

5. The evaluation method for display design according to claim 1, characterized in that, The process of modeling a binocular position model in a virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box includes: Based on the coordinates of the object point mapped to the virtual image surface and the eye box, an eye position model is obtained by modeling in the virtual reality scene. Based on the preset binocular distance and the center point of the eye position model, the center point of the eye position model is taken as the midpoint of the preset binocular distance, and the two endpoints of the preset binocular distance are taken as the two eye positions, thus obtaining the binocular position model.

6. The evaluation method for display design according to claim 1, characterized in that, The step of projecting the image in the eye box onto the target device based on the binocular position model includes: Based on the binocular position model, the image of the target eye position in the eye box is projected onto the target device; the target eye position is the position in the eye box determined by the target device.

7. The evaluation method for display design according to claim 1, characterized in that, The evaluation of the design of the target display based on the state of the image projected onto the target device includes: If the distortion and / or parallax of the image of the target device exceeds a preset range, the design of the target display is determined to be unqualified. If the distortion and parallax of the target device's image are within the preset range, then the design of the target display is deemed qualified.

8. The evaluation method for display design according to claim 1, characterized in that, The target device is a virtual reality head-mounted display device, and the target display is a vehicle head-up display.

9. An evaluation device for display design, characterized in that, include: The information acquisition module is used to acquire the coordinate system of the image generation unit in the target display and multiple eye positions in the eye box; An information determination module is used to determine the mapping relationship between the coordinates of the light rays passing through the eye position in the coordinate system and the coordinates of the virtual image surface; the virtual image surface is the virtual image surface of the image generation unit; A coordinate determination module is used to map the coordinates of the object point of the target display in the coordinate system to the virtual image surface according to the mapping relationship, so as to obtain the coordinates of the object point in the virtual image surface; The model determination module is used to model in a virtual reality scene based on the coordinates of the object point mapped to the virtual image surface and the eye box to obtain a binocular position model; The design evaluation module is used to project the image in the eye box onto the target device based on the binocular position model, and to evaluate the design of the target display based on the state of the image projected onto the target device.

10. A vehicle, characterized in that, include: A head-up display, wherein the evaluation method for the display design as described in any one of claims 1-8 is applied to the head-up display.

Images