Image display method and system, panoramic display device, carrier and medium
By using image generation components in the panoramic display device of the intelligent car, determining the preset viewpoint position and adjusting the parallax image, the problem of difficulty in displaying three-dimensional images in the prior art is solved, and a stable stereoscopic visual experience is achieved.
Patent Information
- Application Number
- CN202411378715.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2025-02-07
AI Technical Summary
The existing panoramic display devices are difficult to meet the three-dimensional image display needs of smart cars, resulting in limited user experience.
Through the image generation component, at least one preset viewpoint position is determined, and the initial image is adjusted according to the imaging parameters of each preset viewpoint position, and a matching parallax image is generated to realize display on the image generation component.
It realizes the display of three-dimensional images with a sense of depth in smart cars, meets the user's three-dimensional image display needs, and reduces the 3D effect jitter of the image during user movement.
Smart Images

Figure CN119395889A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of image display technology, and in particular to an image display method and system, a panoramic display device, a carrier and a medium. Background Art
[0002] A panoramic display device is a device that uses the image generation component on the dashboard to output images and project them into the lower area of the windshield for image display. The glass needs to be processed in this area, usually by attaching a black coating or film, to present a better image effect. However, this display method is usually only used to display partial forms of image content, and cannot display image content such as three-dimensional forms. Such a display method is difficult to meet the ever-changing image display needs of smart cars, seriously affecting the user experience. Summary of the invention
[0003] In order to solve the problem in the prior art that panoramic display devices are difficult to meet image display requirements, the present invention provides an image display method and system, a panoramic display device, a carrier and a medium.
[0004] In a first aspect, an embodiment of the present disclosure provides a method for displaying an image, using an image generation component, the display method comprising:
[0005] determining at least one preset viewpoint position;
[0006] Acquire an initial image and imaging parameters of each preset viewpoint position in at least one preset viewpoint position;
[0007] The parallax of the initial image is adjusted according to the imaging parameters of each preset viewpoint position to obtain a parallax image matching each preset viewpoint position;
[0008] On the image generation component, the parallax image matching each preset viewpoint position is displayed.
[0009] In one embodiment, before determining at least one preset viewpoint position, the method further includes:
[0010] At least one coordinate position of the user's eyes is obtained; there is a one-to-one correspondence between the at least one coordinate position and at least one preset viewpoint position, and the at least one coordinate position is used to determine as the at least one preset viewpoint position.
[0011] In one embodiment, before determining at least one preset viewpoint position, the method further includes:
[0012] At least one initial viewpoint position is acquired; among the at least one initial viewpoint position, an initial viewpoint position that meets a first preset condition is used to determine as at least one preset viewpoint position.
[0013] In one embodiment, the first preset condition includes initial viewpoint positions that are arranged continuously within a preset distribution range.
[0014] In one embodiment, on the image generation component, displaying the disparity image matching each preset viewpoint position includes:
[0015] Determine a target pixel range that matches each preset viewpoint position; the target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position that satisfies a second preset condition;
[0016] In the target pixel range that matches each preset viewpoint position, the parallax image that matches each preset viewpoint position is displayed.
[0017] In one embodiment, the second preset condition includes pixel positions falling within the imaging range of each preset viewpoint position; the imaging range is calculated based on each preset viewpoint position and corresponding imaging parameters.
[0018] In one embodiment, the image generation component further comprises at least one grating, each grating covering at least one pixel position;
[0019] The number of preset viewpoint positions is the same as the number of pixel positions covered by the grating, and / or the arrangement of at least two preset viewpoint positions in the at least one preset viewpoint position is the same as the arrangement of at least two pixel positions in the at least one pixel position.
[0020] In one embodiment, the imaging parameters include at least one of the following: optical parameters of an image generating component, a virtual image distance, and a distance between left and right eye images on the virtual image.
[0021] In a second aspect, an embodiment of the present disclosure provides an image display system, using an image generation component, the display system includes:
[0022] A determination module, used to determine at least one preset viewpoint position;
[0023] A first acquisition module, used to acquire imaging parameters and an initial image of each preset viewpoint position in at least one preset viewpoint position;
[0024] An adjustment module, used to adjust the parallax of the initial image according to the imaging parameters of each preset viewpoint position, so as to obtain a parallax image matching each preset viewpoint position;
[0025] The display module is used to display the parallax image matching each preset viewpoint position on the image generation component.
[0026] In a third aspect, an embodiment of the present disclosure provides a panoramic display device, comprising an image generating component, which displays an image according to an image display method as described in any one of the first aspects, and emits image light to an imaging component according to the displayed image.
[0027] In one embodiment, the image generation assembly includes a display panel and a grating;
[0028] The grating is arranged opposite to the display panel, and the display panel is used for displaying images.
[0029] In one embodiment, one of the gratings covers at least one pixel position on the display panel.
[0030] In one embodiment, the panoramic display device further includes a coordinate sensor and a processor;
[0031] The processor is electrically connected to the coordinate sensor and the image generation component respectively. The coordinate sensor is used to collect the coordinate position of the user's eyes. The processor is used to obtain the coordinate position and generate corresponding control instructions based on the coordinate position and send them to the image generation component.
[0032] In a fourth aspect, an embodiment of the present disclosure provides a vehicle, comprising a panoramic display device and an imaging component as described in any one of the third aspects.
[0033] In a fifth aspect, an embodiment of the present disclosure provides a panoramic display device, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, at least one program, a code set or an instruction set is loaded and executed by the processor to implement a display method as described in any one of the first aspects.
[0034] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or at least one program is loaded and executed by a processor to implement a display method as described in any one of the first aspects.
[0035] The device, electronic device and storage medium provided by the embodiments of the present disclosure have the following technical effects:
[0036] First, at least one preset viewpoint position is obtained, and a parallax image matching each preset viewpoint position in at least one preset viewpoint position is generated, and the parallax image of each preset viewpoint position is displayed on the image generation component. Under the projection of the image generation component, the parallax image is projected onto the corresponding imaging component, and the user can perceive a stereoscopic picture with a sense of depth through the parallax image, thereby achieving a 3D effect of imaging. In addition, by setting at least one preset viewpoint position and the parallax image corresponding to the preset viewpoint position, the user is satisfied that there is a corresponding parallax image to match before and after the line of sight moves, so as to ensure the 3D effect of imaging and reduce the jitter of the 3D effect of imaging during the user's movement.
[0037] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions and advantages of the embodiments of the present disclosure or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0039] Figure 1 is a schematic diagram of a field of view provided by an exemplary embodiment of the present disclosure;
[0040] Figure 2 is a schematic diagram of a virtual image distance provided by an exemplary embodiment of the present disclosure;
[0041] Figure 3 is a schematic diagram of a HUD projection range provided by an exemplary embodiment of the present disclosure;
[0042] Figure 4 is a schematic diagram of naked-eye 3D provided by an exemplary embodiment of the present disclosure;
[0043] Figure 5 is a first structural schematic diagram of a panoramic display device provided by an exemplary embodiment of the present disclosure;
[0044] Figure 6 is a flowchart of a method for displaying an image provided by an exemplary embodiment of the present disclosure;
[0045] Figure 7 is a second structural schematic diagram of a panoramic display device provided by an exemplary embodiment of the present disclosure;
[0046] Figure 8 is a first structural schematic diagram of an image generation component provided by an exemplary embodiment of the present disclosure;
[0047] Fig. 9 is a second structural schematic diagram of an image generation component provided by an exemplary embodiment of the present disclosure;
[0048] Fig.10 is a third structural schematic diagram of an image generation component provided by an exemplary embodiment of the present disclosure;
[0049] Fig.11 is a flowchart of step 64 of a method for displaying an image provided by an exemplary embodiment of the present disclosure;
[0050] Fig.12 is a structural diagram of an image display system provided by an exemplary embodiment of the present disclosure;
[0051] Fig.13 It is a structural diagram of a carrier provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0052] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present disclosure.
[0053] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.
[0054] Before disclosing the embodiments of the present invention, the following technical terms are explained:
[0055] Field of view (FOV), see Figure 1 The angle formed by the two edges of the maximum range of the image 10 of the target object that can pass through the lens 11, with the lens of the optical instrument as the vertex, is called the field of view angle, including the horizontal field of view angle 12 and the longitudinal field of view angle 13.
[0056] Horizontal field of view (HFOV) 12: For a rectangular virtual image, the angle between the midpoints of the left and right vertical sides and the eye point is the horizontal field of view.
[0057] Vertical field of view (VFOV): For a rectangular virtual image, the angle between the midpoints of the upper and lower horizontal sides and the line connecting the eye point is the vertical field of view.
[0058] Virtual image distance (VID) 20, see Figure 2 , refers to the distance from the user's eye position 21 to the projected virtual image 22, in the figure 23 is a horizontal plane, 24 is an imaging component, such as a windshield.
[0059] HUD projection range, see Figure 3 , refers to the coverage area of the HUD that can be seen by the user's eye position 21 and the virtual image distance 20 of the virtual image 23 from the human eye, which can be specifically calculated through the horizontal field of view angle 12, the vertical field of view angle 13 and the downward viewing angle.
[0060] Three Dimensional (3D) display, see Figure 4 Through optical design, the user sees the parallax image P1 on the imaging component through the left eye viewpoint 41, and the parallax image P2 on the imaging component through the parallax image 42. The binocular parallax between the parallax images P1 and P2 makes the objects seen by the user have a sense of depth and space. The images seen by the left eye viewpoint 41 and the right eye viewpoint 42 are synthesized into a three-dimensional picture with a sense of depth in the user's brain. By changing the positional relationship between the two images to adjust the binocular parallax, the virtual image distance subjectively felt by the user changes (in fact, the virtual image distance remains unchanged). The closer the two images are, the closer the virtual image distance subjectively felt by the user; conversely, the farther the two images are, the farther the virtual image distance subjectively felt by the user.
[0061] Head Up Display (HUD) is a driving assistance instrument used in automobiles. It is a comprehensive electronic display device composed of electronic components, display components, controllers, etc. It can project information such as vehicle speed, navigation information, and warnings in the form of images and characters in front of the driver through optical components.
[0062] Panorama-Head-up-Display (PHUD), see Figure 5The image is output by the image display component 51 on the dashboard of the car and projected to the lower area of the windshield 52 for display. The end user observes the corresponding image 54 at the corresponding position 53. This lower area can basically cover the entire lateral area of the windshield. Compared with HUD, PHUD usually has no 3D effect.
[0063] Based on this, an embodiment of the present disclosure provides a method for displaying an image, using an image generation component.
[0064] The image generating component is used to project image light, and the image light carries image information. After the image light propagates through the optical path, it is projected onto the imaging component for imaging, and the image on the imaging component is generally a virtual image. When the user observes the imaging component, he can observe the image on the imaging component. In this embodiment, there is no special limitation on the image generating component, and it can be selected according to actual conditions.
[0065] See also Figure 6 , the display methods include:
[0066] S61. Determine at least one preset viewpoint position.
[0067] The viewpoint position is the position where the user's line of sight intersects with the center of the image when the user is observing.
[0068] However, during the imaging process, the position of the user's line of sight is not fixed. When the user moves, the position of his or her line of sight also changes. If the center of the image remains unchanged, the image will be distorted to a certain extent in the user's eyes, which will affect the user's viewing experience.
[0069] At this time, in order to avoid distortion of the image in the user's eyes due to changes in the position of the user's line of sight, at least one preset viewpoint position can be set. In some preferred embodiments, multiple preset viewpoint positions can also be set, and the number of preset viewpoint positions is more important than the number of preset viewpoint positions, and the more stable the three-dimensional effect of the imaging.
[0070] The preset viewpoint position is the position where the user's line of sight intersects with the center of the image before and after the user moves. The preset viewpoint position can be determined based on the movement trajectory of the user's line of sight, can be obtained in real time during the movement of the user's line of sight, or can be set in advance.
[0071] It should be noted that when the image on the image generation component changes, the change type includes but is not limited to position, shape, size, color, etc., the corresponding image on the imaging component will also change, and the image on the image generation component and the image on the imaging component are linked. The reason is that the light propagation between the image generation component and the imaging component is point-to-point. Therefore, when the initial viewpoint position on the image generation component changes, the initial viewpoint position on the imaging component will also change, and the image observed by the end user will also change accordingly. In order to facilitate the control of the display of the image, the initial viewpoint position mentioned in this embodiment is generally preferably the initial viewpoint position on the image generation component.
[0072] The preset viewpoint position is described below through three embodiments:
[0073] In the first embodiment, before step S61, the display method further includes:
[0074] Obtain at least one coordinate position of the user's eyes.
[0075] The coordinate position may reflect the user's line of sight direction, and further reflect the position where the line of sight intersects with the center of the image, that is, the preset viewpoint position.
[0076] In this embodiment, there is a one-to-one correspondence between at least one coordinate position and at least one preset viewpoint position, and at least one coordinate position is used to determine at least one preset viewpoint position. Therefore, the preset viewpoint position can be determined by obtaining the coordinate position, and the preset viewpoint position can be determined by the coordinate position in step S61.
[0077] See also Figure 7 , the coordinate position can be obtained from the coordinate sensor 71, and the coordinate sensor 71 can obtain information such as the coordinate position and sight direction of the human eye. In this embodiment, it is preferred to obtain the coordinate positions of the left eye 72 and the right eye 73 respectively. Since the final image 54 in this embodiment is an image with a 3D effect, based on Figure 4 , three-dimensional imaging requires seeing two parallax images P1 and P2 through the left eye viewpoint and the right eye viewpoint respectively, and forming binocular parallax between the parallax images of the left eye and the right eye, so that the objects seen by the user appear to have a three-dimensional sense.
[0078] Therefore, when the user's eyes move, the coordinate positions of the moving left eye 72 and right eye 73 are obtained through the coordinate sensor 71, and the preset viewpoint positions corresponding to the coordinate positions of the left eye and the right eye are determined respectively. Based on the two preset viewpoint positions, the two parallax images P1 and P2 can be adjusted in real time according to the movement of the user's eyes, and the visual parallax formed between the two parallax images enables the user to always view the ideal imaging with 3D effect.
[0079] In the second embodiment, before step S61, the display method further includes:
[0080] Get at least one initial viewpoint position.
[0081] Among the at least one initial viewpoint position, the initial viewpoint position that satisfies the first preset condition is used to determine as at least one preset viewpoint position. The preset viewpoint position is obtained by screening according to the initial viewpoint position. By setting the first preset condition, the screened initial viewpoint position can match the position change of the user's line of sight, so that when the user observes the image, the occurrence of image distortion can be reduced.
[0082] The first preset condition includes initial viewpoint positions that are continuously arranged within a preset distribution range. The preset distribution range represents the distribution range of the preset viewpoint positions, which can be determined according to an algorithm.
[0083] For example, by counting and classifying the historical sight positions of the user, the distribution pattern and distribution range of the user's sight positions can be determined, and then the preset distribution range can be determined based on the distribution range of the user's sight positions.
[0084] In the third embodiment, the number and arrangement of preset viewpoint positions are associated with the number and arrangement of pixel positions, specifically:
[0085] See also Figure 8 The image generation component generally includes a display panel 81 and a grating 82, and the grating 82 is arranged opposite to the display panel 81. The display panel 81 is used to display images. Figure 9-10 Pixel positions are distributed on the display panel 81, and a sub-pixel is set at a pixel position. The sub-pixel can be composed of lamp beads. The "R", "G" and "B" shown in the figure represent the lamp beads of three colors, namely red, green and blue, respectively.
[0086] A grating 82 covers at least one pixel position on the display panel 81. Fig. 9 As shown, a grating covers 50 pixel positions on the display panel 81; or as shown Fig.10 As shown, a grating covers 8 pixel positions on the display panel.
[0087] The number of preset viewpoint positions and the number of pixel positions covered by the grating may be the same or different. However, in order to facilitate the control of the imaging process, the number of preset viewpoint positions is generally set based on the number of pixel positions covered by the grating, so that the number of preset viewpoint positions is the same as the number of pixel positions covered by the grating.
[0088] In addition, the arrangement of at least two of the at least one preset viewpoint position is the same as the arrangement of at least two of the at least one pixel position. Since the arrangement of the pixel positions is continuous and uniform, the spatial arrangement of the obtained preset viewpoint positions is also continuous and uniform.
[0089] The parallax image adjusted based on the above preset viewpoint position can be arranged in the same arrangement as the pixel position. When the user's line of sight moves from one position to another, the parallax difference felt by the eye will become smaller, and the changes in the viewed image will be smoother, reducing the visual jump. Also, due to the continuous distribution of the preset viewpoint position in space, the user can obtain a clear stereoscopic visual effect in a larger range, thereby expanding the observation area, and can reduce the stereoscopic image distortion caused by slight movements of the user's head, thereby providing a more stable stereoscopic visual experience.
[0090] S62: Acquire an initial image and imaging parameters of each preset viewpoint position in at least one preset viewpoint position.
[0091] The initial image is set according to the imaging requirements. The initial image is generally an image that has not been processed. The image information contained in the initial image is the same as the image information contained in the parallax image. The imaging parameters include but are not limited to the optical parameters of the image generation component, the virtual image distance, the distance between the left and right eye images on the virtual image, and any one or more of the imaging. The optical parameters include but are not limited to FOV, VID, the resolution of the image generation component, and the actual used area of the image generation component, which can be selected according to the actual situation.
[0092] S63 , adjusting the parallax of the initial image according to the imaging parameters of each preset viewpoint position, to obtain a parallax image matching each preset viewpoint position.
[0093] The parallax range of each preset viewpoint position can be calculated according to the imaging parameters of each preset viewpoint position, and the parallax image of each preset viewpoint position can be obtained by adjusting the parallax of the initial image of each preset viewpoint position according to the parallax range.
[0094] The adjustment process of the parallax of the initial image is explained: for example, if the pupil distance of the human eye is 65mm, if the distance between the left and right eye images on the virtual image is also 65mm, and the VID is 1m away, then the distance of the 3D effect of the imaging felt by the user through the imaging component is 1m away; at this time, if the distance of the 3D effect of the imaging felt by the user through the imaging component is 2m away, without changing the real distance between the imaging component and the user, it can be adjusted by changing the distance between the left and right eye images on the virtual image. When the distance between the left and right eye images on the virtual image and the left and right eye images on the virtual image are reduced, the distance of the 3D effect of the imaging felt by the user through the imaging component becomes farther. According to the principle of similar triangles, it is calculated that the distance between the left and right eye images on the virtual image should be 32.5mm, which is the parallax range mentioned in this embodiment. The parallax image of each preset viewpoint position can be obtained by adjusting the parallax of the initial image at each preset viewpoint position according to the parallax range.
[0095] Wherein, a parallax image corresponding to each preset viewpoint position is obtained based on each preset viewpoint position, so that the user's eyes can observe 3D imaging in an ideal state on the imaging component at each viewpoint position before and after the movement.
[0096] S64: Display the parallax image matching each preset viewpoint position on the image generation component.
[0097] For the parallax images of each preset viewpoint position obtained in the preceding steps, there may be multiple preset viewpoint positions. In this embodiment, all the parallax images matching the viewpoint positions are displayed on the image generation component to project them to the corresponding positions on the imaging component. When the imaging component generates multiple parallax images matching the preset viewpoint positions, when the user moves from one preset viewpoint position to another, the user can always observe the 3D effect of the image because there are matching parallax images.
[0098] In addition, it should be noted that the more preset viewpoint positions there are, the more parallax images there are on the imaging component, and the smaller the intervals between the parallax images. When the user moves from one position to another, the 3D effect of the image viewed by the user will change more smoothly, reducing the sense of visual jump. Similarly, due to the continuous distribution of viewpoints in space, the user can obtain clear stereoscopic visual effects in a larger range, thereby expanding the observation area, and can reduce the stereoscopic image distortion caused by slight movements of the user's head, thereby providing a more stable stereoscopic visual experience.
[0099] In one embodiment, see Fig.11 , step S64 specifically includes:
[0100] S641: Determine a target pixel range that matches each preset viewpoint position.
[0101] The target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position that satisfies a second preset condition.
[0102] Specifically, the second preset condition includes the pixel position falling within the imaging range of each preset viewpoint position, and the imaging range is calculated according to each preset viewpoint position and the corresponding imaging parameters. Specifically, the parallax of each preset viewpoint position can be calculated first (the parallax calculation process can refer to the above embodiment), and then the imaging range of each preset viewpoint position is calculated according to the size of the initial image and the parallax of each preset viewpoint position. In some scenarios, it can be understood that the imaging range of each preset viewpoint position is the same as the size of the target pixel range of each preset viewpoint position, but it is not limited to this.
[0103] S642: Display the parallax image that matches each preset viewpoint position within the target pixel range that matches each preset viewpoint position.
[0104] The target pixel range of each preset viewpoint position matches the disparity image of each viewpoint position. For details, see Figure 4 , the preset viewpoint position 41 (that is, the left eye viewpoint position), its target pixel range matches P1, and the preset viewpoint position 42 (that is, the right eye viewpoint position), its target pixel range matches P2.
[0105] For each disparity image at a preset viewpoint position, each target pixel position in the target pixel range can carry the content corresponding to the disparity image at the target pixel position. The content corresponding to the disparity image carried by the target pixel position at the target pixel position can be referred to. Figure 9-10 .
[0106] In this embodiment, at least one preset viewpoint position is first obtained, and a parallax image matching each preset viewpoint position in the at least one preset viewpoint position is generated, and the parallax image of each preset viewpoint position is displayed on the image generation component. Under the projection of the image generation component, the parallax image is projected onto the corresponding imaging component, and the user can perceive a stereoscopic picture with a sense of depth through the parallax image, thereby realizing the 3D effect of imaging. In addition, by setting at least one preset viewpoint position and the parallax image corresponding to the preset viewpoint position, the user is satisfied that there is a corresponding parallax image to match before and after the line of sight moves, so as to ensure the 3D effect of imaging and reduce the jitter of the 3D effect of imaging during the user's movement.
[0107] On the basis of the above embodiments, an exemplary embodiment of the present disclosure provides a panoramic display device, which includes an image generating component. The image generating component displays an image according to the image display method in the above embodiments, and emits image light to an imaging component according to the displayed image.
[0108] See also Figure 8 The image generation component generally includes a display panel 81 and a grating 82, and the grating 82 is arranged opposite to the display panel 81. The display panel 81 is used to display images. Figure 9-10 Pixel positions are distributed on the display panel 81, and a sub-pixel is set at a pixel position. The sub-pixel can be composed of lamp beads. The "R", "G" and "B" shown in the figure represent the lamp beads of three colors, namely red, green and blue, respectively.
[0109] A grating 82 covers at least one pixel position on the display panel 81. Fig. 9 As shown, a grating covers 50 pixel positions on the display panel 81; or as shown Fig.10 As shown, a grating covers 8 pixel positions on the display panel.
[0110] The number of preset viewpoint positions and the number of pixel positions covered by the grating may be the same or different. However, in order to facilitate the control of the imaging process, the number of preset viewpoint positions is generally set based on the number of pixel positions covered by the grating, so that the number of preset viewpoint positions is the same as the number of pixel positions covered by the grating.
[0111] In one embodiment, see Figure 7 The panoramic display device also includes a coordinate sensor 71 and a processor (not shown in the figure).
[0112] The processor is electrically connected to the coordinate sensor 71 and the image generation component 54 respectively. The coordinate sensor 71 is used to collect the coordinate position of the user's eyes, and the processor is used to obtain the coordinate position and generate corresponding control instructions based on the coordinate position and send them to the image generation component 51.
[0113] The control process of the control instruction may refer to the image display method in the above embodiment.
[0114] An exemplary embodiment of the present disclosure provides a vehicle, as shown in the figure, the vehicle includes a panoramic display device and an imaging component as in the above embodiments.
[0115] The vehicle may be in the form of a car, a train, an airplane, etc. The imaging component is preferably an area in the middle and lower part of the windshield where a black coating or film is attached, which is not particularly limited here.
[0116] The panoramic display device generates image light of the image to be displayed and emits it to the imaging component to display a virtual image corresponding to the image to be displayed on the imaging component, and the user can observe the corresponding virtual image at the corresponding position.
[0117] An exemplary embodiment of the present disclosure provides an image display system, using an image generation component, see Fig.12 , the display system includes:
[0118] The determination module 1211 is used to determine at least one preset viewpoint position.
[0119] The first acquisition module 1212 is used to acquire imaging parameters and an initial image of each preset viewpoint position in at least one preset viewpoint position.
[0120] The adjustment module 1213 is used to adjust the parallax of the initial image according to the imaging parameters of each preset viewpoint position, so as to obtain a parallax image matching each preset viewpoint position.
[0121] The display module 1214 is used to display the parallax image matching each preset viewpoint position on the image generation component.
[0122] In one embodiment, before executing the determination module 1211, the display system further executes:
[0123] The second acquisition module is used to acquire at least one coordinate position of the user's eyes; there is a one-to-one correspondence between the at least one coordinate position and at least one preset viewpoint position, and the at least one coordinate position is used to determine as the at least one preset viewpoint position.
[0124] In one embodiment, before executing the determination module 1211, the display system further executes:
[0125] The third acquisition module is used to acquire at least one initial viewpoint position; among the at least one initial viewpoint position, the initial viewpoint position that meets the first preset condition is used to determine as at least one preset viewpoint position.
[0126] In one embodiment, the first preset condition includes initial viewpoint positions that are arranged continuously within a preset distribution range.
[0127] In one embodiment, the display module 1214 includes:
[0128] a determination unit, configured to determine a target pixel range that matches each preset viewpoint position; the target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position that satisfies a second preset condition;
[0129] The display unit is used to display the parallax image matched with each preset viewpoint position within the target pixel range matched with each preset viewpoint position.
[0130] In one embodiment, the second preset condition includes pixel positions falling within the imaging range of each preset viewpoint position; the imaging range is calculated based on each preset viewpoint position and corresponding imaging parameters.
[0131] In one embodiment, the image generation component further comprises at least one grating, each grating covering at least one pixel position;
[0132] The number of preset viewpoint positions is the same as the number of pixel positions covered by the grating, and / or the arrangement of at least two preset viewpoint positions in the at least one preset viewpoint position is the same as the arrangement of at least two pixel positions in the at least one pixel position.
[0133] In one embodiment, the imaging parameters include at least one of the following: optical parameters of an image generating component, a virtual image distance, and a distance between left and right eye images on the virtual image.
[0134] The device and image display method embodiments in the disclosed embodiments are based on the same disclosed concept.
[0135] An exemplary embodiment of the present disclosure provides an electronic device, such as Fig.13 As shown, the electronic device 1300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 1310 (the processor 1310 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 1330 for storing data, and one or more storage media 1320 (such as one or more mass storage devices) for storing application programs 1323 or data 1322. Among them, the memory 1330 and the storage medium 1320 can be short-term storage or permanent storage. The storage medium 1320 stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the above-mentioned image display method.
[0136] Furthermore, the CPU 1310 may be configured to communicate with the storage medium 1320 to execute a series of instruction operations in the storage medium 1320 on the electronic device 1300. The electronic device 1300 may also include one or more power supplies 1360, one or more wired or wireless network interfaces 130, one or more input and output interfaces 1340, and / or one or more operating systems 1321, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.
[0137] The input / output interface 1340 may be used to receive or send data via a network. The specific example of the network may include a wireless network provided by a communication provider of the electronic device 1300. In one example, the input / output interface 1340 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the input / output interface 1340 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0138] It can be understood by those skilled in the art that Fig.13 The structure shown is only for illustration and does not limit the structure of the above electronic device. Fig.13 More or fewer components as shown, or with Fig.13 Different configurations are shown.
[0139] An embodiment of the present disclosure also provides a computer-readable storage medium, which can be set in a server to store at least one instruction, at least one program, a code set or an instruction set related to a method for displaying an image in an embodiment of the method for displaying an image. The at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the above-mentioned method for displaying an image.
[0140] Optionally, in this embodiment, the storage medium may be located in at least one of the multiple network servers of the computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, various media that can store program codes, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.
[0141] It should be noted that the above-mentioned sequence of the embodiments of the present disclosure is for description only and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of this specification are described. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0142] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the image display method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the image display method embodiment.
[0143] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0144] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure should be included in the protection scope of the present disclosure.
Claims
1. A method for displaying an image, characterized in that: Using an image generation component, the display method includes: determining at least one preset viewpoint position; Acquire an initial image and imaging parameters of each preset viewpoint position of the at least one preset viewpoint position; Adjusting the parallax of the initial image according to the imaging parameters of each preset viewpoint position to obtain a parallax image matching each preset viewpoint position; On the image generation component, the parallax image matching each preset viewpoint position is displayed.
2. The display method according to claim 1, characterized in that: Before determining at least one preset viewpoint position, the method further includes: At least one coordinate position of the user's eyes is obtained; the at least one coordinate position has a one-to-one correspondence with the at least one preset viewpoint position, and the at least one coordinate position is used to determine as the at least one preset viewpoint position.
3. The display method according to claim 1, characterized in that: Before determining at least one preset viewpoint position, the method further includes: At least one initial viewpoint position is acquired; among the at least one initial viewpoint position, an initial viewpoint position that satisfies a first preset condition is used to be determined as the at least one preset viewpoint position.
4. The display method according to claim 3, characterized in that: The first preset condition includes initial viewpoint positions that are continuously arranged within a preset distribution range.
5. The display method according to claim 1, characterized in that: The displaying of the parallax image matching each preset viewpoint position on the image generation component includes: Determine a target pixel range that matches each preset viewpoint position; the target pixel range is composed of at least one target pixel position on the image generation component, and each target pixel position in the at least one target pixel position is a pixel position that satisfies a second preset condition; In the target pixel range matched by each preset viewpoint position, the parallax image matched by each preset viewpoint position is displayed.
6. The display method according to claim 5, characterized in that: The second preset condition includes a pixel position falling within an imaging range of each preset viewpoint position; the imaging range is calculated based on each preset viewpoint position and corresponding imaging parameters.
7. The display method according to claim 1, characterized in that: The image generation component further comprises at least one grating, each of the gratings covering at least one pixel position; The number of the preset viewpoint positions is the same as the number of pixel positions covered by the grating, and / or the arrangement of at least two of the at least one preset viewpoint position is the same as the arrangement of at least two of the at least one pixel position.
8. The display method according to claim 1, characterized in that: The imaging parameters include at least one of the following: optical parameters of an image generating component, a virtual image distance, and a distance between left and right eye images on a virtual image.
9. An image display system, using an image generation component, the display system comprising: A determination module, used to determine at least one preset viewpoint position; A first acquisition module, used to acquire imaging parameters and an initial image of each preset viewpoint position in the at least one preset viewpoint position; An adjustment module, configured to adjust the parallax of the initial image according to the imaging parameters of each preset viewpoint position, to obtain a parallax image matching each preset viewpoint position; The display module is used to display the parallax image matching each preset viewpoint position on the image generation component.
10. A panoramic display device, characterized in that: The panoramic display device includes an image generating component, which displays an image according to the image display method described in any one of claims 1 to 8, and emits image light to an imaging component according to the displayed image.
11. The panoramic display device according to claim 10, characterized in that: The image generation component includes a display panel and a grating; The grating is arranged opposite to the display panel, and the display panel is used for displaying images.
12. The panoramic display device according to claim 11, characterized in that: One of the gratings covers at least one pixel position on the display panel.
13. The panoramic display device according to claim 10, characterized in that: The panoramic display device also includes a coordinate sensor and a processor; The processor is electrically connected to the coordinate sensor and the image generation component respectively. The coordinate sensor is used to collect the coordinate position of the user's eyes. The processor is used to obtain the coordinate position and generate corresponding control instructions based on the coordinate position and send them to the image generation component.
14. A carrier, characterized in that: The carrier includes a panoramic display device and an imaging component as described in any one of claims 10-13.
15. A panoramic display device, characterized in that: It comprises a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the display method as described in any one of claims 1-8.
16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by a processor to implement the display method according to any one of claims 1 to 8.
Citation Information
Cited By
Image display method and system, panoramic display device, vehicle, and medium
WO2026065932A1