Image display method and system, panoramic display device, vehicle, and medium
By determining the preset viewpoint position and adjusting the parallax image in a panoramic display device, the problem of difficulty in displaying three-dimensional images in the prior art is solved, a stable three-dimensional imaging effect is achieved, and the user experience is improved.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-02-28
- Publication Date
- 2026-04-02
AI Technical Summary
Existing panoramic display devices are insufficient to meet the 3D image display requirements of intelligent vehicles, thus affecting the user experience.
By determining the preset viewpoint position, obtaining imaging parameters, adjusting the parallax of the initial image, generating a parallax image, and displaying it on the image generation component, the projection of a stereoscopic image is achieved.
It achieves stable 3D imaging effects, reduces image jitter and distortion during user movement, and improves user experience.
Smart Images

Figure CN2025079756_02042026_PF_FP_ABST
Abstract
Description
Image display method and system, panoramic display device, vehicle and medium
[0001] The present application claims priority to the Chinese patent application No. 202411378715.0, filed on September 30, 2024, to the Chinese Patent Office, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD
[0002] The present application relates to the technical field of image display, for example, to an image display method and system, a panoramic display device, a vehicle and a medium. BACKGROUND
[0003] The panoramic display device refers to outputting an image by an image generation component on an instrument panel and projecting the image into a lower region of a windshield for image display. In this region, the glass needs to be processed, generally by attaching a black coating or film to present a better image effect. However, this display method is usually only used to display partial image content, and cannot display image content in the form of three dimensions, etc. Such a display method cannot meet the image display requirements of intelligent vehicles that are changing rapidly, and seriously affects the user experience. SUMMARY
[0004] To solve the problem that the panoramic display device in the related art cannot meet the image display requirements, the present application provides an image display method and system, a panoramic display device, a vehicle and a medium.
[0005] In a first aspect, the embodiments of the present application provide an image display method, which applies an image generation component, and the display method comprises:
[0006] determining at least one preset viewpoint position;
[0007] obtaining an initial image and imaging parameters of each preset viewpoint position in the at least one preset viewpoint position;
[0008] adjusting the parallax of the initial image according to the imaging parameters of each preset viewpoint position respectively to obtain a parallax image matched with each preset viewpoint position;
[0009] displaying the parallax image matched with each preset viewpoint position on the image generation component.
[0010] In an embodiment, before determining the at least one preset viewpoint position, the method further comprises:
[0011] obtaining at least one coordinate position of a user's eye; the at least one coordinate position has a one-to-one correspondence with the at least one preset viewpoint position, and the at least one coordinate position is used to determine the at least one preset viewpoint position.
[0012] In an embodiment, before determining the at least one preset viewpoint position, the method further comprises:
[0013] obtaining at least one initial viewpoint position, wherein an initial viewpoint position satisfying a first preset condition is used to determine the at least one preset viewpoint position.
[0014] In an embodiment, the first preset condition comprises that the initial viewpoint positions are arranged continuously within a preset distribution range.
[0015] In an embodiment, on the image generation component, the parallax image matched with each preset viewpoint position is displayed, comprising:
[0016] determining a target pixel range matched with each preset viewpoint position, wherein the target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position satisfies a second preset condition;
[0017] displaying the parallax image matched with each preset viewpoint position in the target pixel range matched with each preset viewpoint position.
[0018] In an embodiment, the second preset condition comprises that the pixel position falls into an imaging range of each preset viewpoint position, wherein the imaging range is calculated according to each preset viewpoint position and corresponding imaging parameters.
[0019] In an embodiment, the image generation component further comprises at least one raster, and each raster covers at least one pixel position.
[0020] The image generation component comprises at least one of the following settings: the number of preset viewpoint positions is the same as the number of pixel positions covered by the raster, or the arrangement mode of at least two preset viewpoint positions in the at least one preset viewpoint position is the same as the arrangement mode of at least two pixel positions in the at least one pixel position.
[0021] In an embodiment, the imaging parameters comprise at least one of the following: optical parameters of the image generation component, virtual image distance, and distance between left and right eye images of the virtual image.
[0022] In a second aspect, embodiments of the present application provide an image display system, which applies the image generation component, and the display system comprises:
[0023] a determining module configured to determine the at least one preset viewpoint position;
[0024] a first obtaining module configured to obtain imaging parameters of each preset viewpoint position in the at least one preset viewpoint position and an initial image;
[0025] The adjusting module is configured to adjust the parallax of the initial image according to the imaging parameter of each preset viewpoint position, to obtain a parallax image matched with each preset viewpoint position.
[0026] The display module is configured to display the parallax image matched with each preset viewpoint position on the image generation component.
[0027] In a third aspect, an embodiment of the present application provides a panoramic display device, the panoramic display device comprising an image generation component, the image generation component performing image display according to the image display method of any one of the first aspect, and emitting image light to an imaging component according to the displayed image.
[0028] In an embodiment, the image generation component comprises a display panel and a grating.
[0029] The grating is arranged opposite to the display panel, and the display panel is configured to perform image display.
[0030] In an embodiment, one of the gratings covers at least one pixel position on the display panel.
[0031] In an embodiment, the panoramic display device further comprises a coordinate sensor and a processor.
[0032] The processor is electrically connected to the coordinate sensor and the image generation component, the coordinate sensor is configured to collect a coordinate position of the user's eyes, and the processor is configured to obtain the coordinate position and generate a corresponding control instruction based on the coordinate position and send the control instruction to the image generation component.
[0033] In a fourth aspect, an embodiment of the present application provides a vehicle, the vehicle comprising the panoramic display device of any one of the third aspect and the imaging component.
[0034] In a fifth aspect, an embodiment of the present application provides a panoramic display device, comprising a processor and a memory, the memory storing at least one instruction, at least one program, a code set or an instruction set, the at least one instruction, the at least one program, the code set or the instruction set being loaded and executed by the processor to implement the display method of any one of the first aspect.
[0035] In a sixth aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium storing at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by a processor to implement the display method of any one of the first aspect.
[0036] The device, the electronic equipment and the storage medium provided by the embodiments of the present application have the following technical effects:
[0037] First, at least one preset viewpoint position is acquired, and a parallax image matched with each of the at least one preset viewpoint position is generated. The parallax image of each preset viewpoint position is displayed on an image generation component. Under the projection of the image generation component, the parallax image is projected onto a corresponding imaging component. Through the parallax image, a user can perceive a stereoscopic picture with depth, and a 3D imaging effect is achieved. In addition, by setting at least one preset viewpoint position and a parallax image corresponding to the preset viewpoint position, a corresponding parallax image is matched with the user before and after the movement of the line of sight, so as to ensure the 3D imaging effect and reduce the jitter of the 3D imaging effect during the movement of the user. BRIEF DESCRIPTION OF DRAWINGS
[0038] FIG. 1 is a schematic diagram of a field of view according to an example embodiment of the present application;
[0039] FIG. 2 is a schematic diagram of a virtual image distance according to an example embodiment of the present application;
[0040] FIG. 3 is a schematic diagram of a HUD projection range according to an example embodiment of the present application;
[0041] FIG. 4 is a schematic diagram of naked-eye 3D according to an example embodiment of the present application;
[0042] FIG. 5 is a first structural schematic diagram of a panoramic display device according to an example embodiment of the present application;
[0043] FIG. 6 is a flowchart of an image display method according to an example embodiment of the present application;
[0044] FIG. 7 is a second structural schematic diagram of a panoramic display device according to an example embodiment of the present application;
[0045] FIG. 8 is a first structural schematic diagram of an image generation component according to an example embodiment of the present application;
[0046] FIG. 9 is a second structural schematic diagram of an image generation component according to an example embodiment of the present application;
[0047] FIG. 10 is a third structural schematic diagram of an image generation component according to an example embodiment of the present application;
[0048] FIG. 11 is a flowchart of step 64 of an image display method according to an example embodiment of the present application;
[0049] FIG. 12 is a structural diagram of an image display system according to an example embodiment of the present application;
[0050] FIG. 13 is a structural diagram of a carrier according to an example embodiment of the present application. DETAILED DESCRIPTION
[0051] With reference to the drawings, the technical solutions in the embodiments of the present application will be described below. The described embodiments are some or all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.
[0052] The terms "first", "second", etc. in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units shown in the embodiments of the present application can also include other processes, methods, systems, products and devices that are not clearly listed, or other steps or units inherent to these processes, methods, systems, products or devices.
[0053] Before the embodiments of the present application, the following technical terms are explained:
[0054] Field of view (FOV), see FIG. 1, the angle formed by the two edges of the maximum range of the object image 10 passing through the lens 11 of the optical instrument with the lens as the vertex, is called the field of view, including the horizontal field of view 12 and the vertical field of view 13.
[0055] Horizontal field of view 12, also known as horizontal field of view (HFOV), for a rectangular virtual image, the angle between the connecting line of the midpoint of the left and right vertical edges and the eye point is the horizontal field of view.
[0056] Vertical field of view 13, also known as vertical field of view (VFOV), for a rectangular virtual image, the angle between the connecting line of the midpoint of the upper and lower horizontal edges and the eye point is the vertical field of view.
[0057] Virtual image distance (VID) 20, see FIG. 2, refers to the distance from the eye position 21 of the user to the projected virtual image 22. In the figure, 23 is the horizontal plane, and 24 is an imaging component, such as a windshield.
[0058] The projection range of the head-up display (HUD) refers to the coverage area of the HUD that can be seen by the user's eye position 21 and the virtual image distance 20 between the virtual image 22 and the human eye, which can be calculated by the horizontal field of view 12, the vertical field of view 13 and the downward angle.
[0059] The naked eye three-dimensional display (Three Dimensional, 3D) refers to Fig. 4, through the optical design, the user sees the parallax image P1 on the imaging assembly through the left eye point 41, the parallax image P2 on the imaging assembly through the right eye point 42, the binocular parallax between the parallax image P1 and P2 makes the user see the object with depth and space, the imaging seen by the left eye point 41 and the right eye point 42 is synthesized in the user's brain to form a stereoscopic picture with depth. By changing the positional relationship between the two images, the binocular parallax is adjusted, so that the user subjectively feels that the virtual image distance has changed (in fact, the virtual image distance is unchanged), the closer the two images are, the closer the user subjectively feels the virtual image distance; on the contrary, the farther the two images are, the farther the user subjectively feels the virtual image distance.
[0060] The head-up display is a driving aid instrument used in the car, which is a comprehensive electronic display device composed of electronic components, display components, controllers and the like. It can project the speed, navigation information, warning and other information in the form of images and characters to the front of the driver through optical components.
[0061] The panorama display device (Panorama-Head-up-Display, PHUD) refers to Fig. 5, which is to output the image to the lower area of the windshield 52 through the image display component 51 on the dashboard of the car to display the image, and finally the user observes the corresponding imaging 54 at the corresponding position 53. The lower area can basically cover the entire horizontal area of the windshield. Compared with the HUD, the PHUD generally has no 3D effect.
[0062] Based on this, the embodiment of the present application provides a display method of image, which applies an image generating component.
[0063] The image generating component is arranged to project image light rays, and the image light rays carry image information. After the image light rays propagate through the optical path, they are projected onto the imaging component to form an image, which is generally a virtual image on the imaging component. When the user observes the imaging component, the user can observe the image on the imaging component. In this embodiment, the image generating component is not particularly limited and can be selected according to actual conditions.
[0064] Referring to Fig. 6, the display method comprises:
[0065] S61, determining at least one preset eye point position.
[0066] The preset viewpoint position is a position where the user's line of sight intersects with the center of the image.
[0067] However, in the imaging process, the position of the user's line of sight is not fixed. When the user's position moves, the position of the user's line of sight also changes. If the center of the image remains unchanged, the image will be distorted to a certain extent in the user's eyes, which will affect the user's viewing experience.
[0068] At this time, in order to avoid the change of the position of the user's line of sight causing the image to be distorted in the user's eyes, at least one preset viewpoint position can be set. In some preferred modes, a plurality of preset viewpoint positions can also be set. The number of preset viewpoint positions and the more stable three-dimensional effect of imaging.
[0069] The preset viewpoint position is a position where the user's line of sight intersects with the center of the image. The preset viewpoint position can be determined according to the movement track of the user's line of sight, can be acquired in real time during the movement of the user's line of sight, or can be set in advance.
[0070] It should be noted that when the image on the image generating component changes, the change type includes but is not limited to position, shape, size, color, etc. The corresponding image on the imaging component will also change. The image on the image generating component and the image on the imaging component are linked. The reason is that the light propagation between the image generating component and the imaging component is point-to-point. Therefore, when the initial viewpoint position on the image generating component changes, the initial viewpoint position on the imaging component will also change, and the image observed by the user will also change accordingly. In order to facilitate the control of the display of the image, the initial viewpoint position mentioned in the embodiment is generally preferably the initial viewpoint position on the image generating component.
[0071] The preset viewpoint position will be described in detail through three embodiments as follows:
[0072] The first embodiment, before step S61, the display method further comprises:
[0073] Obtaining at least one coordinate position of the user's eyes.
[0074] The coordinate position can reflect the direction of the user's line of sight, and further reflect the position where the line of sight intersects with the center of the image, that is, the preset viewpoint position.
[0075] In the embodiment, the at least one coordinate position is in one-to-one correspondence with the at least one preset viewpoint position, and the at least one coordinate position is used to determine the at least one preset viewpoint position. Therefore, the preset viewpoint position can be determined by acquiring the coordinate position, and the preset viewpoint position can be determined by the coordinate position in step S61.
[0076] Referring to FIG. 7, the coordinate position can be acquired according to a coordinate sensor 71, and the coordinate sensor 71 can acquire the coordinate position of the human eye, the line-of-sight direction and the like. In the embodiment, two coordinate positions of the left eye 72 and the right eye 73 are preferably acquired respectively. Since the final imaging 54 in the embodiment is imaging with 3D effect, based on FIG. 4, the imaging in three-dimensional form needs to see two parallax images P1 and P2 through the left eye viewpoint and the right eye viewpoint respectively, and the binocular parallax is formed between the parallax images of the left eye and the right eye, so that the object viewed by the user presents three-dimensional stereoscopic effect.
[0077] Therefore, when the eyes of the user move, the coordinate positions of the moving left eye 72 and the right eye 73 are acquired by the coordinate sensor 71, and the preset viewpoint positions corresponding to the coordinate positions of the left eye and the right eye are determined respectively. Based on the two preset viewpoint positions, the two parallax images P1 and P2 can be adjusted in real time with the movement of the eyes of the user, and the visual parallax formed between the two parallax images enables the user to always view the ideal imaging with 3D effect.
[0078] In a second embodiment, before step S61, the display method further comprises:
[0079] acquiring at least one initial viewpoint position.
[0080] Among the at least one initial viewpoint position, the initial viewpoint position satisfying a first preset condition is used to determine the at least one preset viewpoint position. The preset viewpoint position is obtained by screening the initial viewpoint position. The setting of the first preset condition enables the screened initial viewpoint position to match the position change of the line of sight of the user, so that the user can reduce the occurrence of image distortion when observing the image.
[0081] The first preset condition includes the initial viewpoint positions arranged continuously in a preset distribution range. The preset distribution range represents the distribution range of the preset viewpoint position, which can be determined according to an algorithm.
[0082] For example, by statistically classifying the historical line-of-sight positions of the user, the distribution rule and the distribution range of the line-of-sight position of the user can be determined, and then the preset distribution range can be determined based on the distribution range of the line-of-sight position of the user.
[0083] In a third embodiment, the number and arrangement of the preset viewpoint positions are related to the number and arrangement of the pixel positions, specifically:
[0084] Referring to FIG. 8, the image generating component generally comprises a display panel 81 and a grating 82, which is arranged opposite to the display panel 81. The display panel 81 is arranged to display images. Referring to FIGS. 9-10, the display panel 81 is provided with pixel positions, and each pixel position is provided with a sub-pixel. The sub-pixel can be formed by a lamp bead. In the figures, “R”, “G” and “B” represent red, green and blue lamp beads respectively.
[0085] At least one grating 82 covers at least one pixel position on the display panel 81. As shown in FIG. 9, one grating covers 50 pixel positions on the display panel 81; or as shown in FIG. 10, one grating covers 8 pixel positions on the display panel 81.
[0086] The number of preset viewpoint positions can be the same as or different from the number of pixel positions covered by the grating. In order to facilitate the control of the imaging process, the number of preset viewpoint positions is generally set to be the same as the number of pixel positions covered by the grating.
[0087] In addition, the arrangement of at least two of the at least one preset viewpoint position is the same as the arrangement of at least two of the at least one pixel position. Since the pixel positions are arranged continuously and uniformly, the arrangement of the obtained preset viewpoint positions in space is also continuous and uniform.
[0088] The parallax image adjusted based on the preset viewpoint positions can be arranged according to the same arrangement of the pixel positions. When the user's line of sight position changes from one position to another, the difference in parallax perceived by the eyes will be smaller, and the change in the viewed image will be smoother, reducing the visual jumping feeling. Also due to the continuous distribution of the preset viewpoint positions in space, the user can obtain clear stereoscopic vision effect in a larger range, thereby expanding the observation area and reducing the stereoscopic image distortion caused by the slight movement of the user's head, thereby providing a more stable stereoscopic vision experience.
[0089] S62, obtaining an initial image and imaging parameters of each of the at least one preset viewpoint position.
[0090] The initial image is set according to imaging requirements, and the initial image is generally an image that has not undergone image processing. The image information contained in the initial image is the same as the image information contained in the parallax image. The imaging parameters include, but are not limited to, one or more of the optical parameters of the image generation component, the virtual image distance, the distance between the left and right eye images on the virtual image, and the imaging. The optical parameters include, but are not limited to, FOV, VID, resolution of the image generation component, and actual used area of the image generation component. The actual situation can be selected according to the actual situation.
[0091] S63, adjusting the parallax of the initial image according to the imaging parameters of each preset viewpoint position to obtain a parallax image matched with each preset viewpoint position.
[0092] The parallax range of each preset viewpoint position can be calculated according to the imaging parameters of each preset viewpoint position. The parallax of the initial image of each preset viewpoint position is adjusted according to the parallax range to obtain a parallax image of each preset viewpoint position.
[0093] The adjustment process of the parallax of the initial image is described as follows: for example, the interpupillary distance of the human eye is 65 mm, the distance between the left and right eye images on the virtual image is also 65 mm, and the VID is 1 m away. The distance of the 3D effect of the imaging perceived by the user through the imaging component is 1 m away. At this time, if the distance of the 3D effect of the imaging perceived by the user through the imaging component is 2 m away, the distance between the left and right eye images on the virtual image can be adjusted without changing the real distance between the imaging component and the user. When the distance between the left and right eye images on the virtual image and the left and right eye images on the virtual image are reduced, the distance of the 3D effect of the imaging perceived by the user through the imaging component becomes far away. According to the principle of similar triangles, the distance between the left and right eye images on the virtual image should be 32.5 mm, which is the parallax range mentioned in this embodiment. The parallax of the initial image of each preset viewpoint position is adjusted according to the parallax range to obtain a parallax image of each preset viewpoint position.
[0094] Each parallax image corresponding to each preset viewpoint position is obtained based on each preset viewpoint position, so that the user's eyes can observe the 3D imaging in an ideal state on the imaging component at each viewpoint position before and after moving.
[0095] S64, displaying the parallax image matched with each preset viewpoint position on the image generation component.
[0096] For each parallax image corresponding to each preset viewpoint position obtained through the foregoing steps, the number of preset viewpoint positions can be multiple, and in this embodiment, all parallax images corresponding to the viewpoint positions are displayed on the image generation component to be projected to the corresponding positions on the imaging component. When multiple parallax images corresponding to the preset viewpoint positions are generated on the imaging component, when the user moves from one preset viewpoint position to another preset viewpoint position, the 3D effect of the image can be observed in the user's eyes at all times due to the existence of the corresponding parallax images.
[0097] In addition, it should be noted that the more the number of preset viewpoint positions, the more parallax images on the imaging component, and the smaller the interval between the parallax images, and the change in the 3D effect of the image observed by the user when the user moves from one position to another position will be smoother, reducing the visual jumping feeling; similarly, due to the continuous distribution of the viewpoint in space, the user can obtain clear stereoscopic vision effect in a larger range, thereby expanding the observation area, and can reduce the stereoscopic image distortion caused by the slight movement of the user's head, thereby providing a more stable stereoscopic vision experience.
[0098] In one embodiment, referring to FIG. 11, step S64 specifically includes:
[0099] S641, determining a target pixel range corresponding to each preset viewpoint position.
[0100] The target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position satisfying a second preset condition.
[0101] Specifically, the second preset condition includes a pixel position falling within an imaging range of each preset viewpoint position, and the imaging range is calculated according to each preset viewpoint position and the corresponding imaging parameter. Specifically, the parallax of each preset viewpoint position can be calculated first (the parallax calculation process can refer to the foregoing embodiment), and then the imaging range of each preset viewpoint position is calculated according to the size of the initial image and the parallax of each preset viewpoint position. In some scenarios, it can be understood that the imaging range of each preset viewpoint position is the same size as the target pixel range of each preset viewpoint position, but it is not limited thereto.
[0102] S642, displaying the parallax image corresponding to each preset viewpoint position in the target pixel range corresponding to each preset viewpoint position.
[0103] The target pixel range of each preset view point position matches the parallax image of each view point position. Referring to FIG. 4, the target pixel range of preset view point position 41 (i.e. left eye view point position) matches P1, and the target pixel range of preset view point position 42 (i.e. right eye view point position) matches P2.
[0104] For the parallax image of each preset view point position, each target pixel position in the target pixel range can carry the corresponding content of the parallax image at the target pixel position. The corresponding content of the parallax image carried by the target pixel position at the target pixel position can be seen from FIGS. 9-10.
[0105] In the embodiment, first, at least one preset view point position is acquired, and a parallax image matching each preset view point position in the at least one preset view point position is generated, and the parallax image of each preset view point position is displayed on an image generation component. Under the projection of the image generation component, the parallax image is projected onto a corresponding imaging component, and a stereoscopic picture with depth can be perceived by a user through the parallax image, and the 3D effect of imaging is realized. In addition, by setting at least one preset view point position and the parallax image corresponding to the preset view point position, the corresponding parallax image is matched before and after the movement of the user's line of sight, so as to guarantee the 3D effect of imaging and reduce the jitter of the 3D effect of imaging during the movement of the user.
[0106] On the basis of the above-mentioned embodiment, an example embodiment of the present application provides a panoramic display device, which comprises an image generation component. The image generation component displays images according to the image display method in the above-mentioned embodiment, and emits image light to an imaging component according to the displayed images.
[0107] Referring to FIG. 8, the image generation component generally comprises a display panel 81 and a grating 82, and the grating 82 is arranged opposite to the display panel 81. The display panel 81 is arranged to display images. Referring to FIGS. 9-10, the display panel 81 is distributed with pixel positions, and one sub-pixel is arranged on one pixel position. The sub-pixel can be composed of a lamp bead. “R”, “G” and “B” shown in the figure represent red, green and blue lamp beads respectively.
[0108] One grating 82 covers at least one pixel position on the display panel 81. As shown in FIG. 9, one grating covers 50 pixel positions on the display panel 81; or as shown in FIG. 10, one grating covers 8 pixel positions on the display panel.
[0109] The number of preset viewpoint positions can be same as or different from the number of pixel positions covered by the grating. In order to facilitate control of the imaging process, the number of preset viewpoint positions is generally set based on the number of pixel positions covered by the grating, so that the number of preset viewpoint positions is same as the number of pixel positions covered by the grating.
[0110] In one embodiment, referring to FIG. 7, the panoramic display device further includes a coordinate sensor 71 and a processor (not shown in the figure).
[0111] The processor is electrically connected to the coordinate sensor 71 and the image generation component 54 respectively, the coordinate sensor 71 is configured to collect the coordinate position of the user's eyes, and the processor is configured to obtain the coordinate position and generate a corresponding control instruction based on the coordinate position and send the control instruction to the image generation component 51.
[0112] The control process of the control instruction can refer to the image display method in the above embodiment.
[0113] An example embodiment of the present application provides a vehicle, as shown in the figure, the vehicle includes the panoramic display device and the imaging component in the above embodiment.
[0114] The vehicle can be any one of a car, a train, an airplane, etc., and the imaging component is preferably a region in the lower part of the windshield to which a black coating or film is attached, which is not particularly limited here.
[0115] The panoramic display device generates image light of the to-be-displayed image and emits the image light to the imaging component, so as to display a virtual image corresponding to the to-be-displayed image on the imaging component, and the user can observe the corresponding virtual image at the corresponding position.
[0116] An example embodiment of the present application provides an image display system, which applies an image generation component, referring to FIG. 12, the display system includes:
[0117] A determination module 1211 is configured to determine at least one preset viewpoint position.
[0118] A first acquisition module 1212 is configured to acquire an imaging parameter of each preset viewpoint position in the at least one preset viewpoint position and an initial image.
[0119] An adjustment module 1213 is configured to adjust a parallax of the initial image according to the imaging parameter of each preset viewpoint position respectively, to obtain a parallax image matched with each preset viewpoint position.
[0120] A display module 1214 is configured to display the parallax image matched with each preset viewpoint position on the image generation component.
[0121] In one embodiment, before performing the determining module 1211, the display system further performs:
[0122] The second obtaining module is configured to obtain at least one coordinate position of the user's eyes; the at least one coordinate position has a one-to-one correspondence with the at least one preset viewpoint position, and the at least one coordinate position is used to determine the at least one preset viewpoint position.
[0123] In one embodiment, before performing the determining module 1211, the display system further performs:
[0124] The third obtaining module is configured to obtain at least one initial viewpoint position; among the at least one initial viewpoint position, an initial viewpoint position satisfying a first preset condition is used to determine the at least one preset viewpoint position.
[0125] In one embodiment, the first preset condition includes initial viewpoint positions arranged continuously within a preset distribution range.
[0126] In one embodiment, the display module 1214 includes:
[0127] The determining unit is configured to determine a target pixel range matched with each preset viewpoint position; the target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position satisfying a second preset condition;
[0128] The display unit is configured to display a parallax image matched with each preset viewpoint position in a target pixel range matched with each preset viewpoint position.
[0129] In one embodiment, the second preset condition includes a pixel position falling into an imaging range of each preset viewpoint position; the imaging range is calculated according to each preset viewpoint position and a corresponding imaging parameter.
[0130] In one embodiment, the image generation component further includes at least one raster, and each raster covers at least one pixel position;
[0131] The image generation component includes at least one of the following configurations: the number of preset viewpoint positions is the same as the number of pixel positions covered by the raster, or the arrangement mode of at least two preset viewpoint positions in the at least one preset viewpoint position is the same as the arrangement mode of at least two pixel positions in the at least one pixel position.
[0132] In one embodiment, the imaging parameter includes at least one of the following: an optical parameter of the image generation component, a virtual image distance, and a distance between left and right eye images in a virtual image.
[0133] The device and the display method of the image in the embodiments of the present application are based on the same disclosure concept.
[0134] In a possible implementation, the panoramic display device comprises an electronic device. An example embodiment of the present application provides an electronic device as shown in FIG. 13, which can be quite different in configuration or performance, and can include one or more central processing units (CPUs) 1310, a memory 1330 for storing data, one or more storage media 1320 (such as one or more mass storage devices) for storing applications 1323 or data 1322, and a processor 1310, which can include but is not limited to a micro controller unit (MCU) or a field programmable gate array (FPGA) processing device. Among them, the memory 1330 and the storage medium 1320 can be temporary storage or persistent storage. The storage medium 1320 stores at least one instruction, at least one program, a code set or an instruction set, which is loaded and executed by the processor to implement the above-mentioned image display method.
[0135] Further, the central processing unit 1310 can be configured to communicate with the storage medium 1320 and execute a series of instructions in the storage medium 1320 on the electronic device 1300. The electronic device 1300 can also include one or more power supplies 1360, one or more wired or wireless network interfaces 130, one or more input / output interfaces 1340, and / or one or more operating systems 1321, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
[0136] The input / output interface 1340 can be used to receive or send data via a network. The above-mentioned network can include a wireless network provided by a communication provider of the electronic device 1300. In one example, the input / output interface 1340 includes a network interface controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet. In one example, the input / output interface 1340 can be a radio frequency (RF) module for communicating with the Internet in a wireless manner.
[0137] Those skilled in the art can understand that the structure shown in FIG. 13 is a schematic, and does not limit the structure of the electronic device described above. For example, the electronic device 1300 can further include more or less components than those shown in FIG. 13, or have a different configuration from that shown in FIG. 13.
[0138] The embodiment of the present application further provides a computer readable storage medium, which can be arranged in a server to store at least one instruction, at least one program, a code set or an instruction set related to an image display method in the image display method embodiment, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the image display method.
[0139] Optionally, in the embodiment, the storage medium can be located in at least one of the network servers in the computer network. Optionally, in the embodiment, the storage medium can include but is not limited to a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk and various storage program codes.
[0140] It should be noted that the above-mentioned sequence of the embodiments of the present application is for description, not representing the advantages and disadvantages of the embodiments. The above-mentioned embodiments of the present application are described. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be executed in different order from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-task processing and parallel processing are possible or can be advantageous.
[0141] Each of the embodiments in the present specification is described in a progressive manner, and the same or similar parts of each of the embodiments can be referred to each other. Each of the embodiments focuses on the difference from other embodiments. In particular, for the device embodiment, since it is basically similar to the image display method embodiment, the description is relatively simple, and the relevant parts can be referred to the part of the image display method embodiment.
[0142] Those skilled in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by hardware, or by program instructing related hardware, and the program can be stored in a computer readable storage medium, and the above-mentioned storage medium can be a read-only memory, a magnetic disk or an optical disk.
Claims
1. A display method of an image, applying an image generation component, the display method comprising: determining at least one preset viewpoint position; obtaining an initial image and imaging parameters of each of the at least one preset viewpoint position; adjusting a parallax of the initial image according to the imaging parameters of each of the at least one preset viewpoint position, respectively, to obtain a parallax image matched with each of the at least one preset viewpoint position; and displaying the parallax image matched with each of the at least one preset viewpoint position on the image generation component. 2.The display method of claim 1, before the determining at least one preset viewpoint position, further comprising: obtaining at least one coordinate position of a user’s eye; the at least one coordinate position has a one-to-one correspondence with the at least one preset viewpoint position, and the at least one coordinate position is used to determine the at least one preset viewpoint position. 3.The display method of claim 1, before the determining at least one preset viewpoint position, further comprising: obtaining at least one initial viewpoint position; and the initial viewpoint position satisfying a first preset condition in the at least one initial viewpoint position is used to determine the at least one preset viewpoint position. The first preset condition comprises initial viewpoint positions arranged continuously within a preset distribution range. The displaying the parallax image matched with each of the at least one preset viewpoint position on the image generation component comprises: determining a target pixel range matched with each of the at least one preset viewpoint position; the target pixel range is composed of at least one target pixel position on the image generation component, and each of the at least one target pixel position is a pixel position satisfying a second preset condition; and displaying the parallax image matched with each of the at least one preset viewpoint position in the target pixel range matched with each of the at least one preset viewpoint position. The second preset condition comprises a pixel position falling into an imaging range of each of the at least one preset viewpoint position; and the imaging range is calculated according to each of the at least one preset viewpoint position and the corresponding imaging parameters. 7.The display method of claim 1, the image generation component further comprises at least one grating, and each of the at least one grating covers at least one pixel position; and the image generation component comprises at least one of the following settings: the number of the preset viewpoint positions is the same as the number of the pixel positions covered by the grating, or the arrangement mode of at least two of the preset viewpoint positions in the at least one preset viewpoint position is the same as the arrangement mode of at least two of the pixel positions in the at least one pixel position. The imaging parameters comprise at least one of the following: an optical parameter of the image generation component, a virtual image distance, and a distance between left and right eye images of a virtual image. 9.A display system of an image, applying an image generation component, the display system comprising: a determining module configured to determine at least one preset viewpoint position; and a first obtaining module configured to obtain an initial image and imaging parameters of each of the at least one preset viewpoint position. 4. The display method according to claim 3, wherein 5. The display method according to claim 1, wherein 6. The display method according to claim 5, wherein 8. The display method of claim 1, wherein, an adjusting module configured to adjust the parallax of the initial image according to the imaging parameter of each preset view point position, to obtain a parallax image matched with each preset view point position; a display module configured to display the parallax image matched with each preset view point position on the image generation component.
10. A panoramic display device, comprising an image generation component configured to perform image display according to the image display method of any one of claims 1-8, and emit image light to an imaging component according to the displayed image.
11. The panoramic display apparatus of claim 10, wherein, The image generation component comprises a display panel and a grating. The grating is arranged opposite to the display panel, and the display panel is configured to perform image display.
12. The surround display apparatus of claim 11, wherein, One grating covers at least one pixel position on the display panel.
13. The panoramic display device of claim 10, further comprising a coordinate sensor and a processor. The processor is electrically connected with the coordinate sensor and the image generation component, the coordinate sensor is configured to collect a coordinate position of a user's eye, and the processor is configured to obtain the coordinate position and generate a corresponding control instruction based on the coordinate position and send the control instruction to the image generation component.
14. A vehicle, comprising the panoramic display device of any one of claims 10-13 and an imaging component.
15. An electronic device, comprising a processor and a memory, the memory storing at least one instruction, at least one program, a code set or an instruction set, the at least one instruction, at least one program, code set or instruction set being loaded and executed by the processor to implement the display method of any one of claims 1-8.
16. A computer readable storage medium, the computer readable storage medium storing at least one instruction or at least one program, the at least one instruction or at least one program being loaded and executed by a processor to implement the display method of any one of claims 1-8.
Citation Information
Patent Citations
Three-Dimensional Display with Motion Parallax
CN102611909A
Image display method and system, panoramic display device, carrier and medium
CN119395889A
Stereoscopic display device
CN204887281U
Bore hole 3D display device of an identification and tracking's method of should choosing
CN205665712U
Display device for vehicle
JP2024076426A