A display control method, device, equipment and medium for a head-up display system

By detecting the user's left and right eyes position and controlling the luminous state of the pixel area of the display screen, the problem of crosstalk between left and right eyes image in the head-up display system is solved, achieving a better user experience.

CN116224582BActive Publication Date: 2025-07-29HANGZHOU FERVCLOUD TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211431279.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-15
Publication Date
2025-07-29
Estimated Expiration
2042-11-15

AI Technical Summary

Technical Problem

The existing head-up display system is incorrect when the user viewing position is not right, and crosstalk is prone to occur between the images seen by the left and right eyes, which seriously affects the user experience.

Method used

By detecting the left and right eyes of the user, the gaze position of the left and right eyes in the eye box is determined, and based on this, the target view area partition set corresponding to the left and right eyes is determined from the view area partition set, the corresponding pixel areas are determined from the display screen, and the luminous state of these areas is controlled, so that the image light emitted by the image source is incident on the corresponding view area partition set, and two images with parallax are displayed.

Benefits of technology

Reduces crosstalk in images seen by users' left and right eyes, and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116224582B_ABST
    Figure CN116224582B_ABST
Patent Text Reader

Abstract

The present application provides a display control method, device, equipment and medium for a head-up display system. By detecting in real time to determine the fixation positions of the left and right eyes in the eye box respectively, a first target view area set corresponding to the left eye position and / or a second target view area set corresponding to the right eye position are determined from a set of view area partitions. A first pixel area corresponding to the first target view area set and / or a second pixel area corresponding to the second target view area set are determined from the display screen. The first pixel area and the second pixel area are controlled to be in a light-emitting state, so that the imaging light rays of the first image emitted by the image source are reflected by the window and then incident on the first target view area set, and the imaging light rays of the second image emitted by the image source are reflected by the window and then incident on the second target view area set; the first image and the second image are two images with parallax. The embodiments of the present application can reduce the crosstalk of the images seen by the user's left and right eyes and improve the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image display, and in particular to a display control method, device, equipment and medium for a head-up display system. Background Art

[0002] The display control technology of a head-up display system refers to the ability to directly view three-dimensional images with the naked eye without the user wearing special 3D glasses. The display control of a head-up display system mainly includes lenticular grating display technology and slit grating display technology. Currently, the widely used one is the lenticular grating display technology, which realizes light splitting by attaching a special lenticular lens on a conventional display screen, enabling the user's left and right eyes to see different images and fuse them into a 3D image in the brain.

[0003] However, in the existing display control scheme of a head-up display system, when the user's viewing position is improper, it may occur that the left eye sees the image intended for the right eye, or the right eye sees the image intended for the left eye, that is, crosstalk occurs between the images seen by the user's left and right eyes, seriously affecting the user experience. Summary of the Invention

[0004] To solve the problem that crosstalk occurs between the images seen by the left and right eyes in the existing display control scheme of a head-up display system, seriously affecting the user experience, the present application provides a display control method, device, equipment and medium for a head-up display system:

[0005] According to a first aspect of the present application, there is provided a display control method for a head-up display system, wherein the head-up display system includes an image source and a window, and the head-up display system is configured to make the imaging light emitted by the image source incident on the eyebox after being reflected by the window. The display control method of the head-up display system includes:

[0006] Detect the left and right eye positions of the user, and determine the fixation positions of the left and right eye positions in the eyebox respectively; the eyebox includes a set of viewing area partitions, and each viewing area partition in the set of viewing area partitions has a corresponding pixel area on the display screen;

[0007] Based on the fixation positions of the left and right eye positions in the eyebox respectively, determine a first target set of viewing area partitions corresponding to the left eye position and / or a second target set of viewing area partitions corresponding to the right eye position from the set of viewing area partitions;

[0008] Determine a first pixel area corresponding to the first target set of viewing area partitions and / or a second pixel area corresponding to the second target set of viewing area partitions from the display screen;

[0009] The first pixel area and the second pixel area are controlled to be in a light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target visual area partition set, and the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target visual area partition set; the first image and the second image are two images with parallax.

[0010] According to a second aspect of the present application, a display control device for a head-up display system is provided. The head-up display system includes an image source and a viewing window. The head-up display system is configured so that imaging light emitted by the image source is reflected by the viewing window and then incident on an eye box. The display control device for the head-up display system includes:

[0011] A detection module is used to detect the positions of the left and right eyes of the user and determine the gaze positions of the left and right eyes in the eye box respectively; the eye box includes a set of visual area partitions, and each visual area partition in the set of visual area partitions has a corresponding pixel area on the display screen;

[0012] A first determining module is configured to determine, from the visual area partition sets, a first target visual area partition set corresponding to the left eye position and / or a second target visual area partition set corresponding to the right eye position based on the gaze positions of the left and right eyes, respectively, in the eye boxes;

[0013] A second determining module is configured to determine, from the display screen, a first pixel region corresponding to the first target viewing area partition set and / or a second pixel region corresponding to the second target viewing area partition set;

[0014] The control module is used to control the first pixel area and the second pixel area to be in a light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target visual area partition set, and the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target visual area partition set; the first image and the second image are two images with parallax.

[0015] On the other hand, the first determining module is configured to determine, when the gaze position of the left eye position in the eye box is within a preset distance from the geometric center of the visual zone area in the visual zone area set, and the gaze position of the right eye position in the eye box is within a preset distance from the geometric center of the visual zone area in the visual zone area set,

[0016] The visual area partition where the left eye's gaze position in the eye box is located is determined as the first target visual area partition set corresponding to the left eye position, and the visual area partition where the right eye's gaze position in the eye box is located is determined as the second target visual area partition set corresponding to the right eye position.

[0017] On the other hand, a first determination module, when the fixation position of the left eye in the eye box is within a preset distance from the boundary between two adjacent visual partition areas in the visual partition set, and the fixation position of the right eye in the eye box is within a preset distance from the boundary between two adjacent visual partition areas in the visual partition set,

[0018] determines the two adjacent visual partition areas on the boundary where the fixation position of the left eye in the eye box is located as the first target visual partition set corresponding to the left eye position, and determines the two adjacent visual partition areas on the boundary where the fixation position of the right eye in the eye box is located as the second target visual partition set corresponding to the right eye position.

[0019] On the other hand, a first determination module, when the fixation position of the left eye in the eye box is within a preset distance from the geometric center of the visual partition area in the visual partition set, and the fixation position of the right eye in the eye box is within a preset distance from the boundary between two adjacent visual partition areas in the visual partition set,

[0020] determines the visual partition area where the fixation position of the left eye in the eye box is located as the first target visual partition set corresponding to the left eye position, and determines the two adjacent visual partition areas on the boundary where the fixation position of the right eye in the eye box is located as the second target visual partition set corresponding to the right eye position; or;

[0021] when the fixation position of the left eye in the eye box is within a preset distance from the boundary between two adjacent visual partition areas in the visual partition set, and the fixation position of the right eye in the eye box is within a preset distance from the geometric center of the visual partition area in the visual partition set,

[0022] determines the two adjacent visual partition areas on the boundary where the fixation position of the left eye in the eye box is located as the first target visual partition set corresponding to the left eye position, and determines the visual partition area where the fixation position of the right eye in the eye box is located as the second target visual partition set corresponding to the right eye position.

[0023] On the other hand, a first determination module, when the fixation position of the left eye in the eye box is within a preset distance from the boundary of the boundary visual partition area in the visual partition set, and the fixation position of the right eye in the eye box is within a preset distance from the boundary between two adjacent visual partition areas in the visual partition set,

[0024] determines the boundary visual partition area where the fixation position of the left eye in the eye box is located and the relative boundary visual partition area in the visual partition set as the first target visual partition set corresponding to the left eye position, and determines the two adjacent visual partition areas on the boundary where the fixation position of the right eye in the eye box is located as the second target visual partition set corresponding to the right eye position; or;

[0025] When the gaze position of the left eye in the eye box is within a preset distance of the boundaries of two adjacent view zones in the view zone set, and the gaze position of the right eye in the eye box is within a preset distance of the boundary of a boundary view zone in the view zone set,

[0026] Determine the two adjacent visual zone partitions at the boundary of the gaze position of the left eye position in the eye box as a first target visual zone partition set corresponding to the left eye position, and determine the boundary visual zone partition at the gaze position of the right eye position in the eye box and the relative boundary visual zone partition in the visual zone partition set as a second target visual zone partition set corresponding to the right eye position;

[0027] The distribution direction of the boundary viewing area partitions in the viewing area partition set is opposite to the distribution direction of the relative boundary viewing area partitions in the viewing area partition set.

[0028] On the other hand, the head-up display system further includes a lenticular lens, and the display control device of the head-up display system further includes:

[0029] The third determining module is used to determine the corresponding relationship between the size of each lenticular lens in the lenticular lens grating and the size of a preset number of pixel areas, and determine the pixel areas corresponding to each viewing area partition; the lenticular lens grating is attached to the display screen.

[0030] On the other hand, the display control device of the head-up display system further includes:

[0031] The partition processing module is used to partition the eye box according to the parameters of the cylindrical lens grating to obtain a visual area partition set.

[0032] On the other hand, the partition processing module is used to partition the eye box based on the correspondence between the size of each lenticular lens in the lenticular grating and the size of a preset number of pixel areas to obtain a visual area partition set.

[0033] On the other hand, the partition processing module is used to partition the eye box according to the surface shape of the lenticular grating, the refractive index of the lenticular grating, the refractive index of the medium bonded between the lenticular grating and the display screen, the thickness of the medium and the optical parameters of the display screen to obtain a visual area partition set.

[0034] According to a third aspect of the present application, an electronic device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the processor to implement the display control method of the head-up display system of the first aspect of the present application.

[0035] According to a fourth aspect of the present application, a computer storage medium is provided, in which at least one instruction or at least one program is stored. The at least one instruction or at least one program is loaded and executed by a processor to implement the display control method of the head-up display system of the first aspect of the present application.

[0036] According to the fifth aspect of the present application, a computer program product is provided, which includes at least one instruction or at least one program segment, and the at least one instruction or at least one program segment is loaded and executed by a processor to implement the display control method of the head-up display system of the first aspect of the present application.

[0037] The embodiments of the present application provide a display control method, device, equipment, and medium for a head-up display system, which have the following technical effects:

[0038] By detecting the left and right eye positions of the user, the gaze positions of the left and right eye positions in the eye box are determined respectively; the eye box includes a visual area partition set, and each visual area partition in the visual area partition set has a corresponding pixel area in the display screen; based on the gaze positions of the left and right eye positions in the eye box respectively, a first target visual area partition set corresponding to the left eye position and / or a second target visual area partition set corresponding to the right eye position is determined from the visual area partition set; a first pixel area corresponding to the first target visual area partition set and / or a second pixel area corresponding to the second target visual area partition set are determined from the display screen; the first pixel area and the second pixel area are controlled to be in a light-emitting state, so that a first image is displayed in the first target visual area partition set and a second image is displayed in the second target visual area partition set; the first image and the second image are two images with parallax. Based on the embodiment of the present application, by detecting the left and right eye positions of the user in real time, and adjusting the light-emitting state of the corresponding pixels in the display screen and the displayed image in real time in combination with the visual area partition set of the eye box, crosstalk between the images seen by the left and right eyes of the user can be reduced, and the user experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present application or the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0040] Figure 1 is a schematic diagram of an application environment provided by an embodiment of the present application;

[0041] Figure 2 This is a schematic diagram of imaging of a naked-eye three-dimensional image provided by an embodiment of the present application;

[0042] Figure 3It is a schematic diagram of image crosstalk existing in the existing head-up display system;

[0043] Figure 4 It is a schematic diagram of a visual area partition set provided by an embodiment of the present application;

[0044] Figure 5 It is a schematic flowchart of a display control method for a head-up display system provided by an embodiment of the present application;

[0045] Figure 6 It is a display control schematic of the head-up display system provided by an embodiment of the present application Figure 1 ;

[0046] Figure 7 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 1 ;

[0047] Figure 8 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 2 ;

[0048] Figure 9 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 3 ;

[0049] Figure 10 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 3 ;

[0050] Figure 11 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 4 ;

[0051] Figure 12 It is a display control schematic of the head-up display system provided by an embodiment of the present application Figure 2 ;

[0052] Figure 13 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 5 ;

[0053] Figure 14 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 6 ;

[0054] Figure 15 It is a corresponding display schematic of the fixation positions of the left and right eye positions and the display screen provided by an embodiment of the present application Figure 7 ;

[0055] Figure 16 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 8 ;

[0056] Figure 17 This is a schematic diagram of the display control of the head-up display system provided in the embodiment of the present application. Figure 3 ;

[0057] Figure 18 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 9 ;

[0058] Figure 19 1 is a schematic structural diagram of a display control device of a head-up display system provided in an embodiment of the present application;

[0059] Figure 20 This is a hardware structure diagram of an electronic device provided in an embodiment of the present application for implementing the display control method of the head-up display system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] To make the objectives, technical solutions, and advantages of this application more clear, the following embodiments of this application will be further described in detail with reference to the accompanying drawings. Obviously, the described embodiment is only one embodiment of this application, not all embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0061] The “embodiment” referred to herein refers to a specific feature, structure or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the terms “first”, “second”, etc. are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as “first”, “second”, etc. may explicitly or implicitly include one or more of the features. Moreover, the terms “first”, “second”, etc. are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms “including”, “having” and “for” and any variations thereof are intended to cover non-exclusive inclusions.

[0062] See also Figure 1 , Figure 1It is a schematic diagram of an application environment provided by an embodiment of the present application. The application environment may include a Head Up Display (HUD). The HUD may include a head-up display device and a window, i.e., a windshield. The head-up display device may include an image source, a curved mirror, and a flat mirror. The image source may include a backlight, a display screen, and a lenticular grating. The lenticular grating may be attached to the display screen.

[0063] By detecting the positions of the user's left and right eyes, the fixation positions of the left and right eyes in the eye box are respectively determined. The first target view area set corresponding to the left eye position and / or the second target view area set corresponding to the right eye position are determined from the view area partition set. The first pixel area corresponding to the first target view area set and / or the second pixel area corresponding to the second target view area set are determined from the display screen. The first pixel area and the second pixel area are controlled to be in a light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target view area set, and the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target view area set. The first image and the second image are two images with parallax. The two images having parallax means that when the same object is observed by the left and right eyes at a certain designed virtual image distance, the position of the object in the images seen by the left and right eyes is different. The farther the virtual image distance is, the smaller the difference is, and the larger the virtual image distance is, the larger the difference is. It should be understood that at least some of the image elements in these two images are the same.

[0064] A head-up display device is an integrated electronic display device including electronic components, display components, controllers, etc. It projects information such as vehicle speed, navigation information, and warning information into the driver's field of vision in the form of images and characters, and is widely used in vehicles for driving assistance. Figure 2 It is a schematic diagram of the imaging of a naked-eye 3D image provided by an embodiment of the present application. The principle of the naked-eye 3D image is that through the optical design of the head-up display system, the user's left eye sees image P1 through an imaging structure (such as a windshield), and the right eye sees image P2. Since image P1 and image P2 form binocular parallax, the user sees the object with a sense of depth and space, and a three-dimensional picture with a sense of depth is synthesized in the user's brain. Its characteristic is that by changing the position between these two images viewed by the user, the binocular parallax is adjusted, so that the virtual image distance felt subjectively by the user changes. In fact, the virtual image distance remains unchanged. The closer the two images are, the closer the virtual image distance felt subjectively by the user is. On the contrary, the farther the two images are, the farther the virtual image distance felt subjectively by the user is.

[0065] Figure 3 It is a schematic diagram of image crosstalk existing in the existing head-up display system. Refer to Figure 3, the eye box is divided into four visual area zones e1, e2, e3, and e4. The distance between the user's two eyes is the width of the two visual area zones, such as the distance in direction a. When it is detected that the user's left eye position is located in the visual area zone e1, the right eye position is located in the visual area zone e3. It is preset that the left eye sees the first image P1 and the right eye sees the image P2. However, when the user changes the head posture, such as turning the head to the left, the user's left eye position exceeds the eye box. Since the eye box is not strictly divided, images may be seen in the area beyond the eye box. Moreover, according to the optical design of the HUD, it is believed that the divided eye box is periodically repeated. Therefore, the image actually seen by the left eye may be the image P2 for the right eye. When the right eye moves from the visual area zone e3 to the visual area zone e2, the actual image seen by the right eye may be the image P1 for the left eye. As a result, crosstalk occurs between the images seen by the left and right eyes of the user, seriously affecting the user experience.

[0066] Based on this, the present application provides a display control method, device, equipment and medium for a head-up display system.

[0067] Before implementing the display control method for a head-up display system, the eyebox can be partitioned according to the parameters of the lenticular grating to obtain a set of viewing zone partitions. Furthermore, the pixel area covered by each lenticular lens in the lenticular grating can be determined from the display screen. Based on the splitting relationship between the lenticular lens and the viewing zone partitions, the pixel area corresponding to each viewing zone partition can be determined.

[0068] Figure 4 This is a schematic diagram of a set of viewing area partitions provided in an embodiment of the present application. An image source is incident on each viewing area partition through a window, i.e., a windshield. During the design of a 3D HUD, a lenticular lens system can be designed so that one lenticule covers several pixel areas on the display screen, equivalent to treating several pixel areas on the display screen as a complete pixel. When partitioning the eyebox, the eyebox can be partitioned based on the number of pixel areas covered by each lenticule in the lenticular lens system to obtain a set of viewing area partitions. The viewing area partitions are periodically repeated. For example, if one lenticule covers four pixel areas on the display screen, the eyebox can be divided into four viewing area partitions. If one lenticule covers five pixel areas on the display screen, the eyebox can be divided into five viewing area partitions. If one lenticule covers five pixel areas on the display screen, the eyebox can be divided into six viewing area partitions. Optionally, the number of viewing area partitions can be greater than three and not an integer multiple of three. Furthermore, to avoid excessive resolution compression of the virtual image, the eyebox is typically divided into four or five viewing area partitions.

[0069] As an illustrative example of the present invention, the eyebox can also be partitioned to obtain a set of viewing area partitions based on the surface shape of the lenticular grating, the grating thickness, the refractive index of the grating material, the refractive index of the glue bonding the grating and the glue thickness, and the optical parameters of the display screen, such as the thickness and refractive index of the various layers involved between the filter and the top surface of the LCD. For example, if a lenticular lens covers 4 pixel areas in the display screen, the eyebox can be divided into 2 (2 + 4 * n) areas, where n = 0, 1, 2, 3... If a lenticular lens covers 5 pixel areas in the display screen, the eyebox can be divided into 2 (2.5 + 5 * n) areas, where n = 0, 1, 2, 3...

[0070] The following describes a specific embodiment of a display control method for a head-up display system of the present application. Figure 5 This is a flow chart of a display control method for a head-up display system provided by an embodiment of the present application. This specification provides the method operation steps shown in the embodiment or flow chart, but more or fewer operation steps may be included based on routine or non-creative work. The order of steps listed in the embodiment is only one of many execution orders and does not represent the only execution order. In actual execution, the method can be executed in the order shown in the embodiment or the figure or in parallel (for example, in a parallel processor or multi-threaded processing environment).

[0071] Specific as Figure 5 As shown, the display control method of the head-up display system may include:

[0072] S501: Detect the positions of the left and right eyes of the user, and determine the gaze positions of the left and right eyes in the eye boxes respectively.

[0073] In an embodiment of the present application, the eyebox may include a set of viewing area zones, each of which may have a corresponding pixel area on the display screen. The lenticular lenses in the lenticular lens grating overlying the display screen may split imaging light emitted by an image source into corresponding viewing area zones, so that each viewing area zone has a corresponding pixel area. The gaze position may refer to the relative position of the user's eyes in the eyebox.

[0074] By detecting the left and right eye positions of the user in real time, the luminous state and displayed image of the pixel area in the display screen can be adjusted in real time, thereby improving the real-time performance of the subsequent head-up display control.

[0075] S503: Based on the gaze positions of the left and right eyes in the eye boxes respectively, determine a first target visual area partition set corresponding to the left eye position and / or a second target visual area partition set corresponding to the right eye position from the visual area partition sets.

[0076] In the embodiments of the present application, the view division set may refer to the entire area into which the eye box is divided, which may include all view divisions. Determining the view divisions in the view division set as the target view division set may mean determining one view division in the view division set as the target view division set, or determining multiple view divisions in the view division set as the target view division set.

[0077] In an illustrative example of the present invention, when the fixation position of the left eye in the eye box is within a preset distance from the geometric center of the view division in the view division set, and the fixation position of the right eye in the eye box is within a preset distance from the geometric center of the view division in the view division set, the view division where the fixation position of the left eye in the eye box is located may be determined as the first target view division set corresponding to the left eye position, and the view division where the fixation position of the right eye in the eye box is located may be determined as the second target view division set corresponding to the right eye position.

[0078] In an illustrative example of the present invention, when the fixation position of the left eye in the eye box is within a preset distance from the boundary between two adjacent view divisions in the view division set, and the fixation position of the right eye in the eye box is within a preset distance from the boundary between two adjacent view divisions in the view division set, the two adjacent view divisions at the boundary where the fixation position of the left eye in the eye box is located may be determined as the first target view division set corresponding to the left eye position, and the two adjacent view divisions at the boundary where the fixation position of the right eye in the eye box is located may be determined as the second target view division set corresponding to the right eye position.

[0079] In an illustrative example of the present invention, when the fixation position of the left eye in the eye box is within a preset distance from the geometric center of the view division in the view division set, and the fixation position of the right eye in the eye box is within a preset distance from the boundary between two adjacent view divisions in the view division set, the view division where the fixation position of the left eye in the eye box is located may be determined as the first target view division set corresponding to the left eye position, and the two adjacent view divisions at the boundary where the fixation position of the right eye in the eye box is located may be determined as the second target view division set corresponding to the right eye position.

[0080] In an illustrative example of the present invention, when the fixation position of the left eye in the eye box is within a preset distance from the boundary between two adjacent view divisions in the view division set, and the fixation position of the right eye in the eye box is within a preset distance from the geometric center of the view division in the view division set, the two adjacent view divisions at the boundary where the fixation position of the left eye in the eye box is located may be determined as the first target view division set corresponding to the left eye position, and the view division where the fixation position of the right eye in the eye box is located may be determined as the second target view division set corresponding to the right eye position.

[0081] An illustrative example of the present invention, when the gaze position of the left eye position in the eye box is located within a preset distance from the boundary of the boundary visual area zone in the visual area zone set, and the gaze position of the right eye position in the eye box is located within a preset distance from the boundary of the two adjacent visual area zones in the visual area zone set, the boundary visual area zone where the gaze position of the left eye position in the eye box is located and the relative boundary visual area zone in the visual area zone set can be determined as the first target visual area zone set corresponding to the left eye position, and the two adjacent visual area zones at the boundary where the gaze position of the right eye position in the eye box is located can be determined as the second target visual area zone set corresponding to the right eye position; wherein, the distribution direction of the boundary visual area zones in the visual area zone set is opposite to the distribution direction of the relative boundary visual area zones in the visual area zone set.

[0082] An illustrative example of the present invention, when the gaze position of the left eye position in the eye box is located within a preset distance from the boundary of two adjacent visual area partitions in the visual area partition set, and the gaze position of the right eye position in the eye box is located within a preset distance from the boundary of a boundary visual area partition in the visual area partition set, the two adjacent visual area partitions at the boundary where the gaze position of the left eye position in the eye box is located can be determined as the first target visual area partition set corresponding to the left eye position, and the boundary visual area partition where the gaze position of the right eye position in the eye box is located and the relative boundary visual area partition in the visual area partition set can be determined as the second target visual area partition set corresponding to the right eye position; wherein, the distribution direction of the boundary visual area partition in the visual area partition set is opposite to the distribution direction of the relative boundary visual area partition in the visual area partition set.

[0083] By determining the target visual area partition sets corresponding to the left and right eye positions from the visual area partition sets based on the gaze positions of the left and right eye positions in the eye boxes respectively, the target visual area partition sets can be accurately determined according to the internal area or boundary of the visual area partition based on the gaze position, thereby improving the accuracy of the display control of the subsequent head-up display system.

[0084] S505: Determine, from the display screen, a first pixel region corresponding to the first target viewing area partition set and / or a second pixel region corresponding to the second target viewing area partition set.

[0085] In an embodiment of the present application, after determining the first target view area partition set and the second target view area partition set, the first pixel area corresponding to the first target view area partition set and the second pixel area corresponding to the second target view area partition set can be determined from the display screen based on the correspondence between each view area partition and the pixel area.

[0086] By determining the pixel area corresponding to each visual area partition in the target visual area partition set based on the correspondence between each visual area partition and the pixel area, the accuracy of the subsequent display control of the head-up display system can be improved.

[0087] S507: Control the first pixel region and the second pixel region to be in a light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target view division set, and so that the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target view division set; the first image and the second image are two images with parallax.

[0088] In the embodiments of the present application, after determining the first pixel region and the second pixel region, the first pixel region and the second pixel region can be controlled to be in a light-emitting state, and other pixel regions in the display screen can be controlled to be in a non-light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target view division set, and so that the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target view division set.

[0089] By separately controlling the pixel regions corresponding to the left and right eye positions to display two images with parallax, the user's left and right eyes can see different pictures and fuse them into a 3D image in the brain.

[0090] For the convenience of understanding, several specific examples are given below to illustrate the display control method of the above head-up display system.

[0091] Figure 6 is the display control schematic of the head-up display system provided by the embodiments of the present application Figure 1 . Among them, one cylindrical lens covers 4 pixel regions in the display screen, that is, 4 pixel regions in the display screen are regarded as a complete pixel region, and the eye box is divided into 4 view division regions e1, e2, e3, e4. These 4 view division regions are periodically repeated, that is, the two boundary view regions in the view division regions are repeated. Assume that the distance between the user's two eyes is the distance of 2 view division regions. From Figure 6 it can be seen that from left to right, every 4 pixel regions are regarded as a complete pixel region, and the light of the 4 pixel regions in a complete pixel region is sequentially incident on the 4 view regions in the eye box. For example, R1 is incident on e1, G1 is incident on e2, B1 is incident on e3, R2 is incident on e4, and so on for other pixel regions.

[0092] Figure 7 is the corresponding display schematic of the gaze positions of the left and right eye positions and the display screen provided by the embodiments of the present application Figure 1. When the left eye position is in the inner area of the visual area partition e1, and the right eye position is in the inner area of the visual area partition e3, the visual area partition e1 can be used as the first target visual area partition set, and the visual area partition e3 can be used as the second target visual area partition set. In order to avoid crosstalk, the pixel area corresponding to the visual area partition e1 in the display screen can be controlled to be in a luminous state, the pixel area corresponding to the visual area partition e2 can be in a non-luminous state, the pixel area corresponding to the visual area partition e3 can be in a luminous state, and the pixel area corresponding to the visual area partition e4 can be in a non-luminous state, so that the visual area partitions e1, e2, e3, and e4 display the first image P1, no image, the second image P2, and no image in turn. That is, the luminous states of the four pixel areas in each complete pixel area are ON, OFF, ON, and OFF, the first pixel in each complete pixel area displays part of the content of the first image P1, the third pixel displays part of the content of the second image P2, and the remaining two pixels are non-luminous.

[0093] Figure 8 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 2 . When the left eye position is in the inner area of the visual area partition e2, and the right eye position is in the inner area of the visual area partition e4, the visual area partition e2 can be used as the first target visual area partition set, and the visual area partition e4 can be used as the second target visual area partition set. In order to avoid crosstalk, the pixel area corresponding to the visual area partition e1 in the display screen can be controlled to be in a non-luminous state, the pixel area corresponding to the visual area partition e2 can be in a luminous state, the pixel area corresponding to the visual area partition e3 can be in a non-luminous state, and the pixel area corresponding to the visual area partition e4 can be in a luminous state, so that the visual area partitions e1, e2, e3, and e4 display no image, the first image P1, no image, and the second image P2 in turn. That is, the luminous states of the four pixel areas in each complete pixel area are OFF, ON, OFF, and ON, the second pixel in each complete pixel area displays part of the content of the first image P1, the fourth pixel displays part of the content of the second image P2, and the remaining two pixels do not emit light.

[0094] Figure 9 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 3When the left eye position is at the boundary between visual partition regions e1 and e2, and the right eye position is at the boundary between visual partition regions e3 and e4, visual partition regions e1 and e2 can be used as the first set of target visual partition regions, and visual partition regions e3 and e4 can be used as the second set of target visual partition regions. To avoid crosstalk, it is possible to control the pixel regions corresponding to visual partition regions e1, e2, e3, and e4 on the display screen to be in a luminous state, such that visual partition regions e1, e2, e3, and e4 sequentially display the first image P1, the first image P1, the second image P2, and the second image P2. That is, the luminous states of the 4 pixel regions in each complete pixel region are ON, ON, ON, ON. In each complete pixel region, the first pixel displays a part of the first image P1, the second pixel displays a part of the first image P1, the third pixel displays a part of the second image P2, and the fourth pixel displays a part of the second image P2.

[0095] Figure 10 is the corresponding display schematic diagram of the gaze positions of the left and right eye positions and the display screen provided by the embodiments of the present application Figure 3 When the left eye position is at the boundary between visual partition regions e2 and e3, and the right eye position is at the boundary of visual partition region e4, visual partition regions e2 and e3 can be used as the first set of target visual partition regions, and visual partition regions e1 and e4 can be used as the second set of target visual partition regions. To avoid crosstalk, it is possible to control the pixel regions corresponding to visual partition regions e1, e2, e3, and e4 on the display screen to be in a luminous state, such that visual partition regions e1, e2, e3, and e4 sequentially display the second image P2, the first image P1, the first image P1, and the second image P2. That is, the luminous states of the 4 pixel regions in each complete pixel region are ON, ON, ON, ON. In each complete pixel region, the first pixel displays a part of the second image P2, the second pixel displays a part of the first image P1, the third pixel displays a part of the first image P1, and the fourth pixel displays a part of the second image P2.

[0096] Figure 11 is the corresponding display schematic diagram of the gaze positions of the left and right eye positions and the display screen provided by the embodiments of the present application Figure 4. When the left eye position is at the boundary of the boundary visual area partition e1, and the right eye position is at the boundary of the visual area partitions e2 and e3, the visual area partitions e1 and e4 can be used as the first target visual area partition set, and the visual area partitions e2 and e3 can be used as the second target visual area partition set. In order to avoid crosstalk, the pixel areas corresponding to the visual area partitions e1, e2, e3 and e4 in the display screen can be controlled to be in a light-emitting state, so that the visual area partitions e1, e2, e3, e4 display the first image P1, the second image P2, the second image P2, and the first image P1 in sequence. That is, the light-emitting states of the four pixel areas in each complete pixel area are ON, ON, ON, ON, and the first pixel in each complete pixel area displays part of the content of the first image P1, the second pixel displays part of the content of the second image P2, the third pixel displays part of the content of the second image P2, and the fourth pixel displays part of the content of the first image P1.

[0097] Figure 12 This is a schematic diagram of the display control of the head-up display system provided in the embodiment of the present application. Figure 2 Among them, a cylindrical lens covers 5 pixel areas in the display screen, that is, the 5 pixel areas in the display screen are regarded as a complete pixel area, and the eye box is divided into 5 visual area zones e1, e2, e3, e4, and e5. The 5 visual area zones are repeated periodically, that is, the two boundary visual areas in the visual area zones are repeated. Assume that the distance between the user's eyes is the distance of 2.5 visual area zones. By Figure 12 As can be seen, from left to right, every five pixel areas constitute a complete pixel area, and the light from the five pixel areas within a complete pixel area is incident on the five viewing areas in the eye box in sequence. For example, R1 is incident on e1, G1 is incident on e2, B1 is incident on e3, R2 is incident on e4, G2 is incident on e5, and the same applies to the other pixel areas.

[0098] Figure 13 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 5. When the left eye position is in the inner area of the viewing area partition e1, and the right eye position is at the boundary of the viewing area partitions e3 and e4, the viewing area partition e1 can be used as the first target viewing area partition set, and the viewing area partitions e3 and e4 can be used as the second target viewing area partition set. In order to avoid crosstalk, the pixel area corresponding to the viewing area partition e1 in the display screen can be controlled to be in a luminous state, the pixel area corresponding to the viewing area partition e2 can be in a non-luminous state, the pixel area corresponding to the viewing area partition e3 can be in a luminous state, the pixel area corresponding to the viewing area partition e4 can be in a luminous state, and the pixel area corresponding to the viewing area partition e5 can be in a non-luminous state, so that the viewing area partitions e1, e2, e3, e4, and e5 display the first image P1, no image, the second image P2, the second image P2, and no image in sequence. That is, the luminous states of the five pixel areas in each complete pixel area are ON, OFF, ON, ON, and OFF, and the first pixel in each complete pixel area displays part of the content of the first image P1, the third pixel displays part of the content of the second image P2, the fourth pixel displays part of the content of the second image P2, and the remaining two pixels do not emit light.

[0099] Figure 14 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 6 . When the left eye position is at the boundary of visual area partitions e1 and e2, and the right eye position is in the internal area of visual area partition e4, visual area partitions e1 and e2 can be used as the first target visual area partition set, and visual area partition e4 can be used as the second target visual area partition set. In order to avoid crosstalk, the pixel area corresponding to visual area partition e1 in the display screen can be controlled to be in a luminous state, the pixel area corresponding to visual area partition e2 can be in a luminous state, the pixel area corresponding to visual area partition e3 can be in a non-luminous state, the pixel area corresponding to visual area partition e4 can be in a luminous state, and the pixel area corresponding to visual area partition e5 can be in a non-luminous state, so that visual area partitions e1, e2, e3, e4, and e5 display the first image P1, the first image P1, no image, the second image P2, and no image in sequence. That is, the luminous states of the five pixel areas in each complete pixel area are ON, ON, OFF, ON, and OFF, and the first pixel in each complete pixel area displays part of the content of the first image P1, the second pixel displays part of the content of the first image P1, the fourth pixel displays part of the content of the second image P2, and the remaining two pixels are non-luminous.

[0100] Figure 15 This is a schematic diagram of the corresponding display of the left and right eye gaze positions and the display screen provided in the embodiment of the present application. Figure 7When the left eye position is at the boundary of the boundary visual area partition e1 and the right eye position is in the internal area of the visual area partition e3, the boundary visual area partitions e1 and e5 can be used as the first set of target visual area partitions, and the visual area partition e3 can be used as the second set of target visual area partitions. To avoid crosstalk, it is possible to control the pixel area corresponding to the visual area partition e1 on the display screen to be in a light-emitting state, the pixel area corresponding to the visual area partition e2 to be in a non-light-emitting state, the pixel area corresponding to the visual area partition e3 to be in a light-emitting state, the pixel area corresponding to the visual area partition e4 to be in a non-light-emitting state, and the pixel area corresponding to the visual area partition e5 to be in a light-emitting state, so that the visual area partitions e1, e2, e3, e4, and e5 display the first image P1, no image, the second image P2, no image, and the first image P1 in sequence. That is, the light-emitting states of the 5 pixel areas in each complete pixel area are ON, OFF, ON, OFF, ON. In each complete pixel area, the first pixel displays a part of the first image P1, the third pixel displays a part of the second image P2, the fifth pixel displays a part of the first image P1, and the remaining two pixels do not emit light.

[0101] Figure 16 It is a schematic diagram of the corresponding display between the gaze position of the left and right eye positions and the display screen provided by the embodiment of the present application Figure 8 When the left eye position is in the internal area of the visual area partition e3 and the right eye position is at the boundary of the visual area partition e5, the boundary visual area partition e3 can be used as the first set of target visual area partitions, and the visual area partitions e1 and e5 can be used as the second set of target visual area partitions. To avoid crosstalk, it is possible to control the pixel area corresponding to the visual area partition e1 on the display screen to be in a light-emitting state, the pixel area corresponding to the visual area partition e2 to be in a non-light-emitting state, the pixel area corresponding to the visual area partition e3 to be in a light-emitting state, the pixel area corresponding to the visual area partition e4 to be in a non-light-emitting state, and the pixel area corresponding to the visual area partition e5 to be in a light-emitting state, so that the visual area partitions e1, e2, e3, e4, and e5 display the second image P2, no image, the first image P1, no image, and the second image P2 in sequence. That is, the light-emitting states of the 5 pixel areas in each complete pixel area are ON, OFF, ON, OFF, ON. In each complete pixel area, the first pixel displays a part of the second image P2, the third pixel displays a part of the first image P1, the fifth pixel displays a part of the second image P2, and the remaining two pixels do not emit light.

[0102] Figure 17 It is a schematic diagram of the display control of the head-up display system provided by the embodiment of the present application Figure 3Among them, a cylindrical lens covers 5 pixel regions in the display screen, that is, 5 pixel regions in the display screen are regarded as a complete pixel region, and the eye box is divided into 6 viewing sub-regions e1, e2, e3, e4, e5, and e6. These 6 viewing sub-regions are periodically repeated, that is, the two boundary viewing sub-regions in the viewing sub-regions are repeated.

[0103] When a cylindrical lens covers 5 pixel regions and the eye box is divided into more than 6 viewing sub-regions, image crosstalk may occur. Figure 18 It is a corresponding display schematic diagram of the fixation positions of the left and right eyes provided by the embodiment of the present application and the display screen. Figure 8 A cylindrical lens covers 5 pixel regions, and the eye box is divided into 7 viewing sub-regions. e6 is the same as e1, and e7 is the same as e2. The eye distance is the distance of 3.5 viewing sub-regions. The left eye position is inside the viewing sub-region e2, and the right eye is at the boundary between the viewing sub-regions e5 and e6. In this case, since e1 corresponds to the second image P2, e2 corresponds to the first image P1, the left eye may see the second image P2, e6 corresponds to the second image P2, e7 corresponds to the first image P1, and the right eye may see the first image P1, resulting in crosstalk. Therefore, during the partitioning process of the eye box, it is necessary to appropriately set the number of viewing sub-regions and the number of pixel regions covered by each cylindrical lens.

[0104] Adopting the display control method of the head-up display system provided by the embodiment of the present application, by respectively determining the fixation positions of the left and right eye positions in the eye box, determining the first target viewing sub-region set corresponding to the left eye position and / or the second target viewing sub-region set corresponding to the right eye position from the viewing sub-region set, and controlling the first pixel region corresponding to the first target viewing sub-region set and the second pixel region corresponding to the second target viewing sub-region set in the display screen to be in a light-emitting state, so that two images with parallax are respectively displayed in the first target viewing sub-region set and the second target viewing sub-region set.

[0105] The embodiment of the present application also provides a display control device for a head-up display system. Figure 19 It is a schematic structural diagram of a display control device for a head-up display system provided by the embodiment of the present application. Among them, the head-up display system includes an image source and a viewing window. The head-up display system is configured to make the imaging light emitted by the image source enter the eye box after being reflected by the viewing window.

[0106] As Figure 19 shown, the display control device of the head-up display system may include:

[0107] A detection module 1901, configured to detect the left and right eye positions of the user and determine the fixation positions of the left and right eye positions in the eye box respectively; the eye box includes a viewing sub-region set, and each viewing sub-region in the viewing sub-region set has a corresponding pixel region in the display screen.

[0108] The first determination module 1903 is configured to determine a first target visual area partition set corresponding to the left-eye position and / or a second target visual area partition set corresponding to the right-eye position from a set of visual area partitions based on the fixation positions of the left and right eyes in the eye box respectively;

[0109] The second determination module 1905 is configured to determine a first pixel area corresponding to the first target visual area partition set and / or a second pixel area corresponding to the second target visual area partition set from the display screen;

[0110] The control module 1907 is configured to control the first pixel area and the second pixel area to be in a light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target visual area partition set, and so that the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target visual area partition set; the first image and the second image are two images with parallax.

[0111] In an illustrative example of the present invention, the first determination module is configured to, when the fixation position of the left-eye position in the eye box is within a preset distance from the geometric center of the visual area partition in the set of visual area partitions, and the fixation position of the right-eye position in the eye box is within a preset distance from the geometric center of the visual area partition in the set of visual area partitions,

[0112] determine the visual area partition where the fixation position of the left-eye position in the eye box is located as the first target visual area partition set corresponding to the left-eye position, and determine the visual area partition where the fixation position of the right-eye position in the eye box is located as the second target visual area partition set corresponding to the right-eye position.

[0113] In an illustrative example of the present invention, the first determination module is configured to, when the fixation position of the left-eye position in the eye box is within a preset distance from the boundary between two adjacent visual area partitions in the set of visual area partitions, and the fixation position of the right-eye position in the eye box is within a preset distance from the boundary between two adjacent visual area partitions in the set of visual area partitions,

[0114] determine the two adjacent visual area partitions on the boundary where the fixation position of the left-eye position in the eye box is located as the first target visual area partition set corresponding to the left-eye position, and determine the two adjacent visual area partitions on the boundary where the fixation position of the right-eye position in the eye box is located as the second target visual area partition set corresponding to the right-eye position.

[0115] In an illustrative example of the present invention, the first determination module is configured to, when the fixation position of the left-eye position in the eye box is within a preset distance from the geometric center of the visual area partition in the set of visual area partitions, and the fixation position of the right-eye position in the eye box is within a preset distance from the boundary between two adjacent visual area partitions in the set of visual area partitions,

[0116] Determine the visual area partition where the gaze position of the left eye is located in the eye box as a first target visual area partition set corresponding to the left eye position, and determine the two adjacent visual area partitions at the boundary where the gaze position of the right eye is located in the eye box as a second target visual area partition set corresponding to the right eye position; or;

[0117] When the gaze position of the left eye position in the eye box is within a preset distance of the boundaries of two adjacent view zones in the view zone set, and the gaze position of the right eye position in the eye box is within a preset distance of the geometric center of the view zone set,

[0118] The two adjacent visual area partitions at the boundary of the left eye's gaze position in the eye box are determined as the first target visual area partition set corresponding to the left eye position, and the visual area partition at the right eye's gaze position in the eye box is determined as the second target visual area partition set corresponding to the right eye position.

[0119] In an illustrative example of the present invention, the first determining module is configured to determine, when the gaze position of the left eye in the eye box is within a preset distance from a boundary of a boundary visual zone in the visual zone set, and the gaze position of the right eye in the eye box is within a preset distance from a boundary of two adjacent visual zone sets,

[0120] Determine the boundary visual zone partition where the gaze position of the left eye position in the eye box is located and the relative boundary visual zone partition in the visual zone partition set as the first target visual zone partition set corresponding to the left eye position, and determine the two adjacent visual zone partitions at the boundary where the gaze position of the right eye position in the eye box is located as the second target visual zone partition set corresponding to the right eye position; or;

[0121] When the gaze position of the left eye in the eye box is within a preset distance of the boundaries of two adjacent view zones in the view zone set, and the gaze position of the right eye in the eye box is within a preset distance of the boundary of a boundary view zone in the view zone set,

[0122] Determine the two adjacent visual zone partitions at the boundary of the gaze position of the left eye position in the eye box as a first target visual zone partition set corresponding to the left eye position, and determine the boundary visual zone partition at the gaze position of the right eye position in the eye box and the relative boundary visual zone partition in the visual zone partition set as a second target visual zone partition set corresponding to the right eye position;

[0123] The distribution direction of the boundary viewing area partitions in the viewing area partition set is opposite to the distribution direction of the relative boundary viewing area partitions in the viewing area partition set.

[0124] In an illustrative example of the present invention, the head-up display system further includes a lenticular lens, and the display control device of the head-up display system further includes:

[0125] A third determination module, configured to determine the correspondence between the size of each cylindrical lens in the cylindrical lens grating and the size of a preset number of pixel regions, and determine the pixel regions corresponding to each visual area partition; the cylindrical lens grating is attached to the display screen.

[0126] In an illustrative example of the present invention, the display control device of the above head-up display system further includes:

[0127] A partition processing module, configured to perform partition processing on the eyebox according to the parameters of the cylindrical lens grating to obtain a set of visual area partitions.

[0128] In an illustrative example of the present invention, the partition processing module is configured to perform partition processing on the eyebox based on the correspondence between the size of each cylindrical lens in the cylindrical lens grating and the size of a preset number of pixel regions to obtain a set of visual area partitions.

[0129] In an illustrative example of the present invention, the partition processing module is configured to perform partition processing on the eyebox according to the surface shape of the cylindrical lens grating, the refractive index of the cylindrical lens grating, the refractive index of the medium between the cylindrical lens grating and the display screen, the thickness of the medium, and the optical parameters of the display screen to obtain a set of visual area partitions.

[0130] The device in the embodiments of the present application and the method embodiments are based on the same application concept.

[0131] The embodiments of the present application provide an electronic device, which includes a processor and a memory. At least one instruction or at least one program segment is stored in the memory, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the image classification method provided in the above method embodiments.

[0132] Figure 20 It is a schematic diagram of the hardware structure of an electronic device for implementing the display control method of the head-up display system provided in the embodiments of the present application. The electronic device can participate in constituting or include the display control device of the head-up display system provided in the embodiments of the present application. As Figure 20 shown, the electronic device may include one or more (shown as 2001a and 2001b in the figure) processors 2001 (the processor 2001 may include, but is not limited to, a microprocessor 2001MCU or a programmable logic device FPGA, etc.), a memory 2003 for storing data, and a transmission device 2005 for communication functions. In addition, it may further include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the I / O interface), a network interface, and / or a power supply. Those of ordinary skill in the art can understand that Figure 20 the structure shown is only schematic and does not limit the structure of the above electronic device. For example, the electronic device may further include moreFigure 20 more or fewer components shown, or having a configuration different from that Figure 20 shown.

[0133] It should be noted that one or more of the above-mentioned processors 2001 and / or other data processing circuits can generally be referred to as "data processing circuits" in this application. The data processing circuit can be embodied in software, hardware, firmware, or any combination thereof, in whole or in part. In addition, the data processing circuit can be a single independent processing module, or can be incorporated in whole or in part into any one of other components in an electronic device (or a mobile device). As involved in the embodiments of this application, the data processing circuit, as a processor 2001, controls (such as the selection of a variable resistor terminal path connected to an interface).

[0134] The memory 2003 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the display control method of the head-up display system in the embodiments of this application. The processor 2001 runs the software programs and modules stored in the memory 2003 to execute various functional applications and data processing, that is, to implement the above-mentioned display control method of a head-up display system. The memory 2003 can include a high-speed random access memory, and can also include a non-volatile random access memory 2003, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories 2003. In some possible embodiments, the memory 2003 can further include a memory 2003 that is remotely disposed relative to the processing unit, and these remote memories 2003 can be connected to the electronic device through a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0135] The transmission device 2005 is used to receive or send data via a network. Specific examples of the above-mentioned network can include a wireless network provided by a communication provider of the electronic device. In one example, the transmission device 2005 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station and thus can communicate with the Internet. In one example, the transmission device 2005 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0136] The display can be, for example, a touch-screen liquid crystal display (LED), which enables a user to interact with the user interface of the electronic device (or a mobile device).

[0137] An embodiment of the present application provides a computer-readable storage medium, which can be set in an electronic device to store at least one instruction or at least one program related to a display control method for a head-up display system in a method embodiment. The at least one instruction or the at least one program is loaded and executed by the processor to implement the display control method for the head-up display system provided in the above method embodiment.

[0138] Optionally, in this embodiment, the storage medium may be located in at least one of a plurality of network servers in a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard drive, a magnetic disk, or an optical disk, among other media capable of storing program code.

[0139] It should be noted that the order of the embodiments of the present application described above is for descriptive purposes only and does not represent the superiority or inferiority of the embodiments. The above description describes specific embodiments, and other embodiments are also within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in the order of different embodiments and can achieve the expected results. In addition, the processes depicted in the accompanying drawings do not necessarily require a specific order or a connection order to achieve the desired results. In some embodiments, multi-tasking parallel processing is also possible or may be advantageous.

[0140] The various embodiments in this specification are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences between the other embodiments. In particular, the embodiments of the apparatus and electronic device are described more simply because they are based on similarities to the method embodiments. For relevant portions, refer to the description of the method embodiments.

[0141] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.

Claims

1. A display control method for a head-up display system, the head-up display system including an image source and a window, the head-up display system being configured to cause imaging light emitted by the image source to be incident on an eyebox after being reflected by the window, characterized in that, The image source includes a display screen and a lenticular grating, and the lenticular grating is attached to the display screen; the method includes: Detect the left and right eye positions of the user, and determine the fixation positions of the left and right eye positions in the eye box respectively; the eye box includes a set of visual sub-regions, and each visual sub-region in the set of visual sub-regions has a corresponding pixel region in the display screen; the set of visual sub-regions is obtained by partitioning the eye box according to the number of pixel regions covered by each lenticular in the lenticular grating; that each visual sub-region has a corresponding pixel region in the display screen is determined based on the corresponding relationship between the size of each lenticular in the lenticular grating and the size of a preset number of pixel regions. Based on the fixation positions of the left and right eye positions in the eye box respectively, determine a first target set of visual sub-regions corresponding to the left eye position and / or a second target set of visual sub-regions corresponding to the right eye position from the set of visual sub-regions. Determine a first pixel region corresponding to the first target set of visual sub-regions and / or a second pixel region corresponding to the second target set of visual sub-regions from the display screen. Control the first pixel region and the second pixel region to be in a light-emitting state, and control other pixel regions in the display screen to be in a non-light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the window and then incident on the first target set of visual sub-regions, and so that the imaging light of the second image emitted by the image source is reflected by the window and then incident on the second target set of visual sub-regions; the first image and the second image are two images with parallax.

2. The method according to claim 1, wherein The determining a first target set of visual sub-regions corresponding to the left eye position and / or a second target set of visual sub-regions corresponding to the right eye position from the set of visual sub-regions includes: When the fixation position of the left eye position in the eye box is within a preset distance from the geometric center of the visual sub-region in the set of visual sub-regions, and the fixation position of the right eye position in the eye box is within a preset distance from the geometric center of the visual sub-region in the set of visual sub-regions, Determine the visual sub-region where the fixation position of the left eye position in the eye box is located as the first target set of visual sub-regions corresponding to the left eye position, and determine the visual sub-region where the fixation position of the right eye position in the eye box is located as the second target set of visual sub-regions corresponding to the right eye position.

3. The method according to claim 1, wherein The determining a first target set of visual sub-regions corresponding to the left eye position and / or a second target set of visual sub-regions corresponding to the right eye position from the set of visual sub-regions includes: When the fixation position of the left eye position in the eye box is within a preset distance from the boundary between two adjacent visual sub-regions in the set of visual sub-regions, and the fixation position of the right eye position in the eye box is within a preset distance from the boundary between two adjacent visual sub-regions in the set of visual sub-regions, Determine the two adjacent visual sub-regions at the boundary where the fixation position of the left eye position in the eye box is located as the first target set of visual sub-regions corresponding to the left eye position, and determine the two adjacent visual sub-regions at the boundary where the fixation position of the right eye position in the eye box is located as the second target set of visual sub-regions corresponding to the right eye position.

4. The method according to claim 1, wherein Determining the first target set of visual partition regions corresponding to the left-eye position and / or the second target set of visual partition regions corresponding to the right-eye position from the set of visual partition regions includes: When the fixation position of the left-eye position in the eye box is within a preset distance from the geometric center of the visual partition region in the set of visual partition regions, and the fixation position of the right-eye position in the eye box is within a preset distance from the boundary between two adjacent visual partition regions in the set of visual partition regions, Determining the visual partition region where the fixation position of the left-eye position in the eye box is located as the first target set of visual partition regions corresponding to the left-eye position, and determining the two adjacent visual partition regions where the fixation position of the right-eye position in the eye box is located as the second target set of visual partition regions corresponding to the right-eye position; or; When the fixation position of the left-eye position in the eye box is within a preset distance from the boundary between two adjacent visual partition regions in the set of visual partition regions, and the fixation position of the right-eye position in the eye box is within a preset distance from the geometric center of the visual partition region in the set of visual partition regions, Determining the two adjacent visual partition regions where the fixation position of the left-eye position in the eye box is located as the first target set of visual partition regions corresponding to the left-eye position, and determining the visual partition region where the fixation position of the right-eye position in the eye box is located as the second target set of visual partition regions corresponding to the right-eye position.

5. The method according to claim 1, characterized in that, Determining the first target set of visual partition regions corresponding to the left-eye position and / or the second target set of visual partition regions corresponding to the right-eye position from the set of visual partition regions includes: When the fixation position of the left-eye position in the eye box is within a preset distance from the boundary of the boundary visual partition region in the set of visual partition regions, and the fixation position of the right-eye position in the eye box is within a preset distance from the boundary between two adjacent visual partition regions in the set of visual partition regions, Determining the boundary visual partition region where the fixation position of the left-eye position in the eye box is located and the relative boundary visual partition region in the set of visual partition regions as the first target set of visual partition regions corresponding to the left-eye position, and determining the two adjacent visual partition regions where the fixation position of the right-eye position in the eye box is located as the second target set of visual partition regions corresponding to the right-eye position; or; When the fixation position of the left-eye position in the eye box is within a preset distance from the boundary between two adjacent visual partition regions in the set of visual partition regions, and the fixation position of the right-eye position in the eye box is within a preset distance from the boundary of the boundary visual partition region in the set of visual partition regions, Determining the two adjacent visual partition regions where the fixation position of the left-eye position in the eye box is located as the first target set of visual partition regions corresponding to the left-eye position, and determining the boundary visual partition region where the fixation position of the right-eye position in the eye box is located and the relative boundary visual partition region in the set of visual partition regions as the second target set of visual partition regions corresponding to the right-eye position; Wherein, the distribution direction of the boundary visual partition region in the set of visual partition regions is opposite to the distribution direction of the relative boundary visual partition region in the set of visual partition regions.

6. The method according to claim 1, wherein The method further includes: Partition the eye box according to the parameters of the cylindrical lens grating to obtain the visual area partition set.

7. The method according to claim 6, characterized in that, The partitioning the eye box according to the parameters of the cylindrical lens grating to obtain the visual area partition set includes: Based on the correspondence between the size of each cylindrical lens in the cylindrical lens grating and the size of a preset number of pixel regions, partition the eye box to obtain the visual area partition set.

8. The method according to claim 6, wherein The partitioning the eye box according to the parameters of the cylindrical lens grating to obtain the visual area partition set includes: According to the surface shape of the cylindrical lens grating, the refractive index of the cylindrical lens grating, the refractive index of the medium between the cylindrical lens grating and the display screen, the thickness of the medium, and the optical parameters of the display screen, partition the eye box to obtain the visual area partition set.

9. A display control device for a head-up display system, the head-up display system including an image source and a window, the head-up display system being configured to cause imaging light emitted by the image source to be incident on an eyebox after being reflected by the window, characterized in that, The image source includes a display screen and a cylindrical lens grating, and the cylindrical lens grating is attached to the display screen; the device includes: A detection module for detecting the left and right eye positions of the user and determining the fixation positions of the left and right eye positions in the eye box respectively; the eye box includes a visual area partition set, and each visual area in the visual area partition set has a corresponding pixel region in the display screen; the visual area partition set is obtained by partitioning the eye box according to the number of pixel regions covered by each cylindrical lens in the cylindrical lens grating; the fact that each visual area has a corresponding pixel region in the display screen is determined based on the correspondence between the size of each cylindrical lens in the cylindrical lens grating and the size of a preset number of pixel regions. A first determination module for determining a first target visual area partition set corresponding to the left eye position and / or a second target visual area partition set corresponding to the right eye position from the visual area partition set based on the fixation positions of the left and right eye positions in the eye box respectively. A second determination module for determining a first pixel region corresponding to the first target visual area partition set and / or a second pixel region corresponding to the second target visual area partition set from the display screen. A control module for controlling the first pixel region and the second pixel region to be in a light-emitting state, and controlling other pixel regions in the display screen to be in a non-light-emitting state, so that the imaging light of the first image emitted by the image source is reflected by the viewing window and then incident on the first target visual area partition set and so that the imaging light of the second image emitted by the image source is reflected by the viewing window and then incident on the second target visual area partition set; the first image and the second image are two images with parallax.

10. An electronic device, characterized in that, The electronic device includes a processor and a memory, and at least one instruction or at least one program segment is stored in the memory, and the at least one instruction or the at least one program segment is loaded and executed by the processor to implement the display control method of the head-up display system according to any one of claims 1-8.

11. A computer storage medium, characterized in that, At least one instruction or at least one program segment is stored in the storage medium, and the at least one instruction or at least one program segment is loaded and executed by the processor to implement the display control method of the head-up display system according to any one of claims 1-8.

12. A computer program product, characterized in that, The computer program product includes at least one instruction or at least one program segment, and the at least one instruction or the at least one program segment is loaded and executed by a processor to implement the display control method of the head-up display system according to any one of claims 1-8.

Citation Information

Patent Citations

  • Head-up display system and vehicle comprising same

    CN217561834U

  • Optical system for displaying three-dimensional image to observer within car, has image generator generating auto-stereoscopic image with two distinct objects, where each object includes three-dimensional depth about accommodation plane

    FR2997515A1