An image display method, device, apparatus, and computer-readable storage medium
Patent Information
- Application Number
- CN202211504507.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-28
- Publication Date
- 2025-12-19
- Estimated Expiration
- 2042-11-28
AI Technical Summary
Existing glasses-free 3D image display technology, being based on flat panel displays, has a limited viewing angle, which reduces the user's visual experience.
By obtaining the eye position information of the object being observed in the image and the position information of the curved display screen, the position information of the virtual flat display screen is determined, and a pixel mapping relationship is established between the curved display screen and the virtual flat display screen. Based on the mapping relationship, the projection pixel value of the image to be displayed on the curved display screen is determined and displayed.
While ensuring image display quality, it enhances the user's visual experience, achieving a wider viewing angle and better naked-eye 3D display effect.
Smart Images

Figure CN115866233B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of image display, in particular to an image display method, device, equipment and computer readable storage medium. BACKGROUND
[0002] The development of image display technology, especially the emergence of three-dimensional image display technology, brings better visual experience to users, and the advent of naked-eye three-dimensional (3D) image display technology has freed users from the shackles of the past 3D glasses, improving the experience of watching three-dimensional images.
[0003] At present, naked-eye 3D image display technology is based on ordinary platform display, through a light splitting element, for example, a layer of lens film is covered on the plane display screen, so that the image is split when displayed, so that the left and right eyes of a person receive different images to achieve the effect of 3D display. However, since the ordinary display is usually a plane display screen, there is a limitation on the viewing angle, thereby reducing the visual experience of the user. SUMMARY
[0004] Therefore, the embodiments of the present application provide an image display method, which can improve the visual experience of the user while ensuring the display effect of the image to be displayed.
[0005] The technical scheme of the present application is implemented as follows:
[0006] The embodiments of the present application provide an image display method, comprising:
[0007] obtaining first position information of an eye of an image observation object and second position information of a curved display screen;
[0008] determining third position information corresponding to a virtual plane display screen based on the first position information and the second position information;
[0009] determining a mapping relationship between a pixel point of the curved display screen and a reference pixel point of the virtual plane display screen based on the first position information and the third position information;
[0010] determining a projection pixel value corresponding to the image to be displayed on the curved display screen based on the mapping relationship, and displaying the image to be displayed on the curved display screen according to the projection pixel value.
[0011] The embodiments of the present application provide an image display device, comprising:
[0012] The obtaining module is configured to obtain first position information of an eye of an image observation object and second position information of a curved display screen;
[0013] The first determining module is configured to determine third position information corresponding to the virtual flat display screen based on the first position information and the second position information.
[0014] The second determining module is configured to determine a mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen based on the first position information and the third position information.
[0015] The image display module is configured to determine a projection pixel value corresponding to the to-be-displayed image on the curved display screen based on the mapping relationship, and display the to-be-displayed image on the curved display screen according to the projection pixel value.
[0016] An embodiment of the present application provides an image display device, comprising:
[0017] The memory is configured to store executable image display instructions.
[0018] The processor is configured to execute the executable image display instructions stored in the memory, and implement the image display method provided by the embodiment of the present application.
[0019] An embodiment of the present application provides a computer readable storage medium, and the computer storage medium stores computer executable instructions, and the computer executable instructions are configured to execute the steps of the image display method.
[0020] An embodiment of the present application provides an image display method, device, equipment and computer readable storage medium, and the technical scheme is adopted, first, the first position information of the eyes of an image observer and the second position information of a curved display screen are obtained; then, the third position information corresponding to a virtual flat display screen is determined based on the first position information and the second position information; the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen is determined based on the first position information and the third position information; finally, the projection pixel value corresponding to the to-be-displayed image on the curved display screen is determined based on the mapping relationship, so that the to-be-displayed image is displayed on the curved display screen according to the projection pixel value. In this way, the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen is determined through the position information of the eyes of the image observer and the position information of the virtual flat display screen, and the projection pixel value of the to-be-displayed image on the curved display screen is determined according to the mapping relationship, so that the display of the to-be-displayed image on the curved display screen is realized, the display effect of the to-be-displayed image is ensured, and the visual experience of the user is improved. BRIEF DESCRIPTION OF DRAWINGS
[0021] Figure 1 A flowchart of an image display method provided by an embodiment of the present application is shown in the figure;
[0022] Figure 2 A structure diagram of a naked-eye 3D display screen provided by an embodiment of the present application is shown in the figure.
[0023] Figure 3 A relative position diagram of a curved display screen, a virtual plane display screen and an image observer provided by an embodiment of the present application;
[0024] Figure 4 A flow diagram of a naked eye 3D display method based on a curved display screen provided by an embodiment of the present application;
[0025] Figure 5 A relative position diagram of an arc-shaped curved display screen, a virtual plane display screen and an image observer provided by an embodiment of the present application;
[0026] Figure 6 A component structure diagram of an image display device provided by an embodiment of the present application;
[0027] Figure 7 A component structure diagram of an image display device provided by an embodiment of the present application. DETAILED DESCRIPTION
[0028] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application.
[0029] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described below with reference to the drawings, and the described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.
[0030] In the following description, “some embodiments\other embodiments” are described, which describe a subset of all possible embodiments, but it can be understood that “some embodiments\other embodiments” can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.
[0031] In the following description, the terms “first\second\third” are only to distinguish similar objects, and do not represent a specific order of the objects, and it can be understood that “first\second\third” can be interchanged in a specific order or sequence as allowed, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0032] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application, and are not intended to limit the present application.
[0033] Based on the problems in the related art, an image display method is provided in the embodiments of the present application, which can be applied to a control device, which can be a mobile phone, a notebook computer, a desktop computer or the like. As shown in Figure 1 FIG. 1 is a flowchart of an image display method provided in the embodiments of the present application, which includes the following steps:
[0034] S101, obtaining first position information of eyes of an image observation object and second position information of a curved display screen.
[0035] It should be noted that the image observation object can be a user who watches a to-be-displayed image through the curved display screen, and the image observation object can be located opposite to the curved display screen, for example, standing or sitting in front of the curved display screen. The first position information of the eyes of the image observation object can include the positions of the two eyes of the image observation object, the interpupillary distance, the distance from any position on the curved display screen, and the like. The curved display screen can be a naked-eye 3D display screen, and the second position information of the curved display screen can include the position of the curved display screen, the position information of any position on the curved display screen, and the like.
[0036] In some embodiments, an image acquisition device can be arranged on the curved display screen, for example, above the curved display screen. The image acquisition device can acquire an image of the image observation object located opposite to the curved display screen, and analyze and process the image, so as to obtain the first position information of the eyes of the image observation object, and send the first position information to the control device. The position of the curved display screen can be set in advance, so the second position information of the curved display screen can be obtained in advance and saved in a storage area corresponding to the control device.
[0037] S102, determining third position information corresponding to a virtual planar display screen based on the first position information and the second position information.
[0038] In some embodiments, the virtual planar display screen can be a planar display screen assumed to be located between the curved display screen and the image observation object, which can be a virtual planar display screen. After obtaining the position information of the image observation object and the position information of the curved display screen, the position of the virtual planar display screen can be determined. For example, the virtual planar display screen can be arranged at a middle position between the eyes of the image observation object and the curved display screen, or located between the curved display screen and the image observation object and arranged close to the curved display screen. In some embodiments, when the virtual planar display screen is a naked-eye 3D display screen, the display image can be displayed in naked-eye 3D through the planar display screen, and the image observation object located in front of the planar display screen can observe the 3D image.
[0039] S103, determine a mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual planar display screen based on the first position information and the third position information.
[0040] In some embodiments, the pixel point of the curved display screen and the reference pixel point of the virtual planar display screen are both the smallest light-emitting units on the display screen, and the to-be-displayed image can be displayed. After the position information of the virtual planar display screen is determined, the mapping relationship between the pixel point on the curved display screen and the reference pixel point on the virtual planar display screen can be determined according to the position information of the eyes of the image observation object and the position information of the virtual planar display screen. In practice, the pixel point on the curved display screen and the reference pixel point on the virtual planar display screen have a one-to-one correspondence, and the projection pixel value of the image at the pixel point on the curved display screen is the same as the projection pixel value of the image at the corresponding reference pixel point on the virtual planar display screen.
[0041] S104, determine the corresponding projection pixel value of the to-be-displayed image on the curved display screen based on the mapping relationship, and display the to-be-displayed image on the curved display screen according to the projection pixel value.
[0042] It should be noted that the to-be-displayed image can be an image or a video image frame for display, and when the curved display screen is a naked-eye 3D display screen, the to-be-displayed image is displayed by the curved display screen to realize naked-eye 3D display. The corresponding projection pixel value of the to-be-displayed image on the curved display screen can be the pixel value corresponding to the display of the to-be-displayed image on the curved display screen, and each projection pixel value can correspond to a pixel point of the curved display screen.
[0043] In some embodiments, after the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual planar display screen is obtained, the projection pixel value on the curved display screen can be determined according to the mapping relationship. The mapping relationship can represent the corresponding relationship between the reference pixel point on the virtual planar display screen and the pixel point on the curved display screen, and through the corresponding relationship, the projection pixel value at the corresponding pixel point on the curved display screen can be determined according to the projection pixel value at the reference pixel point of the to-be-displayed image on the virtual planar display screen, so as to realize the display of the to-be-displayed image according to each projection pixel value.
[0044] In the embodiments of the present application, first, first position information of an eye of an image observer and second position information of the curved display screen are obtained; then, third position information corresponding to the virtual flat display screen is determined based on the first position information and the second position information; a mapping relationship between a pixel point of the curved display screen and a reference pixel point of the virtual flat display screen is determined based on the first position information and the third position information; finally, a projection pixel value of a to-be-displayed image on the curved display screen is determined based on the mapping relationship, so as to display the to-be-displayed image on the curved display screen according to the projection pixel value. In this way, the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen is determined based on the position information of the eye of the image observer and the position information of the virtual flat display screen, and the projection pixel value of the to-be-displayed image on the curved display screen is determined according to the mapping relationship, so as to realize the display of the to-be-displayed image on the curved display screen, which guarantees the display effect of the to-be-displayed image and improves the visual experience of the user.
[0045] In some embodiments of the present application, the first position information can include left eye position information and right eye position information of the image observer; based on this, the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen is determined based on the first position information and the third position information, that is, step S103 can be implemented by the following steps S1031 to S1033, and each step is described below.
[0046] S1031, based on the left eye position information, the right eye position information and the third position information, a first reference pixel point set corresponding to the left eye on the virtual flat display screen and a second reference pixel point set corresponding to the right eye on the virtual flat display screen are respectively determined.
[0047] In some embodiments, if the virtual flat display screen is a naked-eye 3D display screen, naked-eye 3D display can be performed through the display screen, and based on the position information of the virtual display screen, the position information of the left eye and the position information of the right eye, each pixel point on the virtual display screen that can be observed by the left eye of the image observer, that is, the first reference pixel point set, and each pixel point on the virtual display screen that can be observed by the right eye of the image observer, that is, the second reference pixel point set, can be determined.
[0048] Exemplarily, as Figure 2As shown, when the virtual plane display screen is a naked-eye 3D display screen, a plurality of lenses are arranged on the display screen, and in a case where the position information of the virtual plane display screen is determined, the positions of the lenses can also be determined. In combination with the refractive index of each lens, the left eye position information and the right eye position information, it can be determined that each projection pixel of the to-be-displayed image converges to the left eye or the right eye after refraction through each lens, thereby determining the first reference pixel point set corresponding to the left eye on the virtual plane display screen and the second reference pixel point set corresponding to the right eye on the virtual plane display screen.
[0049] S1032, determine target position information of each first target pixel point corresponding to the left eye and target position information of each second target pixel point corresponding to the right eye on the curved surface display screen.
[0050] In some embodiments, in a case where the position information of the curved surface display screen is known, the position information of each pixel point on the curved surface display screen can also be obtained. Further, according to the left eye position information, the right eye position information and the distance between the eyes and the curved surface display screen, a plurality of first target pixel points corresponding to the left eye and target position information of each first target pixel point on the curved surface display screen, and a plurality of second target pixel points corresponding to the right eye and target position information of each second target pixel point on the curved surface display screen can be determined.
[0051] S1033, determine the mapping relationship between each first reference pixel point and the corresponding first target pixel point based on the position information of each first reference pixel point and the target position information of each first target pixel point; and determine the mapping relationship between each second reference pixel point and the corresponding second target pixel point based on the position information of each second reference pixel point and the target position information of each second target pixel point.
[0052] In some embodiments, there is a mapping relationship between the first reference pixel point corresponding to the left eye and the first target pixel point corresponding to the left eye, and there is a mapping relationship between the second reference pixel point corresponding to the right eye and the second target pixel point corresponding to the right eye. According to the position information of the plurality of first reference pixel points and the position information of the plurality of first target pixel points, the corresponding relationship between each first reference pixel point and the corresponding first target pixel point can be determined, and according to the position information of the plurality of second reference pixel points and the position information of the plurality of second target pixel points, the corresponding relationship between each second reference pixel point and the corresponding second target pixel point can be determined.
[0053] It can be understood that, in the embodiments of the present application, the positions of the reference pixel points corresponding to the left eye and the right eye on the virtual plane display screen and the positions of the target pixel points corresponding to the left eye and the right eye on the curved display screen are determined, and the mapping relationship between the reference pixel points and the corresponding target pixel points is obtained according to the position information of the reference pixel points and the position information of the target pixel points, so that complete and effective mapping between the virtual plane display screen and the curved display screen is realized, thereby providing a basis for naked-eye three-dimensional display of the curved display screen.
[0054] In some embodiments of the present application, the step of "determining the mapping relationship between each first reference pixel point and the corresponding first target pixel point based on the position information of each first reference pixel point and the target position information of each first target pixel point" in step S1033 can be realized by the following steps S201 to S204, and each step is described below.
[0055] S201, obtaining the position information of the ith first reference pixel point, and determining a first connecting line between the ith first reference pixel point and the left eye based on the position information of the ith first reference pixel point and the position information of the left eye.
[0056] It should be noted that, wherein i is a positive integer, if the number of the first reference pixel points on the virtual display screen is N (N is an integer greater than zero), i is greater than zero and less than or equal to N. In some embodiments, according to the position information of the virtual plane display screen, the position information of the ith first reference pixel point can be obtained, and according to the position information of the ith first reference pixel point and the position information of the left eye, the connecting line between the ith first reference pixel point and the left eye, for example, the left eye pupil center, i.e. the first connecting line, can be determined.
[0057] S202, determining the candidate position information of the intersection point of the first connecting line and the curved display screen.
[0058] In some embodiments, the virtual plane display screen can be arranged between the eyes of the image observation object and the curved display screen, and by extending the first connecting line between the ith first reference pixel point and the left eye, the intersection point of the first connecting line and the curved display screen can be obtained, and the position information of the intersection point, i.e. the candidate position information, can be determined. In practice, the candidate position information of the intersection point can be the position coordinates of the intersection point, and after the position coordinates of the ith first reference pixel point, the position coordinates of the left eye, and the distance between the left eye and the virtual plane display screen are obtained, the position coordinates of the intersection point can be determined.
[0059] Exemplarily, as Figure 3As shown in the virtual plane display screen to establish a three-dimensional rectangular coordinate system parallel to the two eyes and in the same horizontal position, the three-dimensional rectangular coordinate system takes the horizontal direction of the virtual plane display screen as the x-axis, the vertical direction as the z-axis, and the direction perpendicular to the virtual plane display screen as the y-axis, if the position coordinates of the i-th first reference pixel point A is (a, 0, 0), the position coordinates of the left eye is (x, h, 0), and the position coordinates of the intersection A' of the i-th first reference pixel point A and the curved surface display screen is (a', b', 0), wherein h is the distance between the eye and the virtual plane display, and b' is the distance between the intersection A' and the virtual plane display screen, then the position coordinates a' and b' of the intersection A' can be determined by the following way:
[0060] First, let the angle between the first line and the virtual plane display screen be θ, as shown in Figure 3 According to the geometric relationship, tanθ = h / (x-a) can be obtained, and according to the inverse tangent, the angle of the included angle can be determined as:
[0061]
[0062] Secondly, the opposite angle of the included angle between the first line and the virtual plane display screen is also θ, according to the geometric relationship, we can get:
[0063] tanθ = b' / (a-a') (2);
[0064] Further, according to the geometric relationship, we have:
[0065]
[0066] Finally, combining the above formulas (1), (2) and (3), the position coordinates a' and b' of the intersection A' can be determined.
[0067] S203, determine that the candidate position information and the target position information of the j-th first target pixel point are the same, and determine that the i-th first reference pixel point and the j-th first target pixel point correspond.
[0068] In some embodiments, j is a positive integer, and if the number of the first target pixel points corresponding to the left eye on the curved display screen is M (M is an integer greater than zero), j is greater than zero and less than or equal to M. After the candidate position information of the intersection point of the ith first reference pixel point and the curved display screen is determined, the candidate position information and each first target pixel point can be compared respectively. If it is determined that the target position information of the jth first target pixel point is the same as the candidate position information, it can be determined that the ith first reference pixel point corresponds to the jth first target pixel point. i and j can be the same or different. In practice, the candidate position information of the intersection point and the target position information of the jth first target pixel point can be the same, that is, the position coordinates of the intersection point and the position coordinates of the jth first target pixel point are the same.
[0069] S204, based on the position information of the ith first reference pixel point and the target position information of the jth first target pixel point, a mapping relationship between the ith first reference pixel point and the jth first target pixel point is established.
[0070] In some embodiments, after it is determined that the ith first reference pixel point and the jth first target pixel point have a corresponding relationship, the mapping relationship between the ith first reference pixel point and the jth first target pixel point can be established based on the respective position information, for example, the position coordinates of the ith first reference pixel point and the position coordinates of the jth first target pixel point are stored correspondingly to establish a mapping table between each first reference pixel point and the corresponding first target pixel point. When it is determined that the to-be-displayed image needs to be displayed through the curved display screen, the corresponding first target pixel point and the projection pixel value of the to-be-displayed image at the first target pixel point can be determined according to the projection pixel value of the to-be-displayed image at the first reference pixel point on the virtual plane display screen and the mapping table.
[0071] In some embodiments, the method in the above steps S201 to S204 is also applicable to the determination of the mapping relationship between the second reference pixel point and the corresponding second target pixel point. In implementation, the first reference pixel points on the virtual display screen can be traversed in sequence to determine the corresponding first target pixel points on the curved display screen, and the second reference pixel points on the virtual display screen can be traversed in sequence to determine the corresponding second target pixel points on the curved display screen, so as to establish a complete mapping relationship between each reference pixel point on the virtual display screen and the corresponding target pixel point on the curved display screen, facilitating subsequent rapid determination of the projection pixel value of the to-be-displayed image on the curved display screen according to the complete mapping relationship, and achieving the purpose of displaying the to-be-displayed image on the curved display screen.
[0072] It can be understood that, in the embodiments of the present application, by determining the intersection of the reference pixel point on the virtual display screen and the eye connecting line and the curved display screen, the target pixel point with the same position information as the position information of the intersection is determined as the pixel point corresponding to the reference pixel point on the virtual display screen, and the mapping relationship between the reference pixel point and the target pixel point is established according to the position information of the reference pixel point and the position information of the corresponding target pixel point, so as to determine the projection pixel value of the to-be-displayed image on the curved display screen according to the mapping relationship, and realize the display of the to-be-displayed image on the curved display screen.
[0073] In some embodiments of the present application, the step of "determining the corresponding projection pixel value of the to-be-displayed image on the curved display screen based on the mapping relationship" in step S104 can be realized by steps S301 to S302, which are described as follows.
[0074] S301, obtaining the first projection pixel value of the to-be-displayed image at each first reference pixel point and the second projection pixel value of the to-be-displayed image at each second reference pixel point.
[0075] In some embodiments, the projection pixel value can be the corresponding image pixel value at the reference pixel point when the virtual planar display screen displays the to-be-displayed image, the first projection pixel value is the image pixel value that can be observed by the left eye of the image observer, and the second projection pixel value is the image pixel value that can be observed by the right eye of the image observer. When the position information of the virtual display screen and the position information of the eyes of the image observer are determined, the first projection pixel value of the to-be-displayed image at each first reference pixel point and the second projection pixel value of the to-be-displayed image at each second reference pixel point on the virtual display screen can be obtained.
[0076] S302, determining each first projection pixel value as the projection pixel value of the corresponding first target pixel point, and determining each second projection pixel value as the projection pixel value of the corresponding second target pixel point.
[0077] In some embodiments, since the reference pixel point and the target pixel point have a mapping relationship, that is, the projection pixel value at the reference pixel point and the projection pixel value at the corresponding target pixel point are the same. Therefore, after obtaining the first projection pixel value of each first reference pixel point and the second projection pixel value of each second reference pixel point, the first projection pixel value of each first reference pixel point can be determined as the projection pixel value of the corresponding first target pixel point, and the second projection pixel value of each second reference pixel point can be determined as the projection pixel value of the corresponding second target pixel point according to the mapping relationship between the reference pixel point and the target pixel point.
[0078] In some embodiments of the present application, the third position information corresponding to the virtual plane display screen is determined based on the first position information and the second position information, i.e., step S102 can be implemented by steps S1021 to S1022, which are described as follows.
[0079] S1021, determining the nearest position on the curved display screen to the eyes of the image observer, and determining the nearest position as the candidate position.
[0080] In some embodiments, the nearest position on the curved display screen to the eyes of the image observer can be any position point on the curved display screen. When determining the nearest position on the curved display screen to the eyes of the image observer, the line connecting the left pupil center and the right pupil center of the image observer can be determined first, and then the nearest position on the curved display screen to the line is determined, and the nearest position is determined as the candidate position.
[0081] S1022, determining the third position corresponding to the virtual plane display screen based on the position of the eyes and the candidate position.
[0082] In some embodiments, the third position is the position of the virtual display screen. After the candidate position on the curved display screen nearest to the eyes is determined, the position of the virtual plane display screen can be determined according to the position of the eyes and the candidate position. In practice, the virtual plane display screen can be located between the eyes of the image observer and the curved display screen, and maintain a certain preset distance from the image observer, so as to ensure that the image observer can see a better naked-eye three-dimensional image when the virtual plane display screen is used to display the to-be-displayed image.
[0083] In some embodiments of the present application, the third position corresponding to the virtual display screen is determined based on the position of the eyes and the candidate position, i.e., step S1022 can be implemented by steps S401 to S402, which are described as follows.
[0084] S401, determining the intermediate position between the position of the eyes and the candidate position.
[0085] In some embodiments, when the intermediate position between the position of the eyes and the candidate position is determined, the line segment passing through the candidate position and perpendicular to the line connecting the left pupil center and the right pupil center of the image observer can be determined after the line connecting the left pupil center and the right pupil center of the image observer is obtained, and the midpoint of the line segment perpendicular to the line is determined as the intermediate position between the position of the eyes and the candidate position.
[0086] S402, determining the intermediate position between the position of the eyes and the candidate position as the third position corresponding to the virtual plane display screen.
[0087] In some embodiments, after the intermediate position between the position of the eye and the candidate position is determined, the intermediate position can be determined as the position of the virtual plane display screen. In practice, the virtual plane display screen is located opposite to the image viewing object. In order to ensure a good viewing effect when the naked eye 3D display is performed by using the virtual plane display screen and the curved display screen, the virtual plane display screen can be arranged opposite to the image viewing object and the curved display screen, for example, the virtual plane display screen can be arranged at the intermediate position between the position of the eye and the candidate position, and perpendicular to the perpendicular segment of the candidate position and the line connecting the centers of the pupils of the two eyes, so as to ensure that the virtual plane display screen is parallel to the image viewing object and the curved display screen.
[0088] In other embodiments, the virtual plane display screen can also be arranged at other positions between the position of the eye and the candidate position, for example, at one third of the position of the eye and the candidate position, at three fourths of the position of the eye and the candidate position, etc. When the position of the virtual plane display screen is determined, as long as the image viewing object can obtain a good naked eye three-dimensional experience effect when viewing the to-be-displayed image through the virtual plane display screen.
[0089] In some embodiments of the present application, after the third position information corresponding to the virtual plane display screen is determined based on the first position information and the second position information, that is, step S102, the following steps S501 to S503 can also be performed, which are described below.
[0090] S501, receiving a control instruction for naked eye three-dimensional image display by using the curved display screen.
[0091] It should be noted that the curved display screen can realize two-dimensional image display and three-dimensional image display. The control instruction can indicate that the naked eye three-dimensional image display by using the curved display screen is currently required. The control instruction can be received by the control device, and the control device can perform the naked eye three-dimensional image display control operation on the curved display screen, so that the curved display screen can perform the naked eye three-dimensional display on the to-be-displayed image.
[0092] In some embodiments, the control instruction for naked eye three-dimensional image display by using the curved display screen can be sent by the user or the image viewing object according to the viewing demand of the user or the image viewing object through the corresponding operation control on the control device. When the operation control is triggered, the control device can receive the control instruction.
[0093] S502, in response to the control instruction, determining the mapping relationship between the pixel points of the curved display screen and the reference pixel points of the virtual plane display screen based on the first position information and the third position information.
[0094] In some embodiments, after receiving the control instruction of displaying the naked-eye three-dimensional image by using the curved display screen, the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual planar display screen is obtained according to the position information of the eyes of the image observation object and the position information of the virtual planar display screen in response to the control instruction. In practice, different image observation objects have different viewing requirements for the to-be-displayed image, and some image observation objects may not have the requirement of viewing the naked-eye three-dimensional image. Therefore, the mapping relationship between the reference pixel point of the virtual planar display screen and the pixel point of the curved display screen does not need to be determined before receiving the control instruction of displaying the naked-eye three-dimensional image by using the curved display screen.
[0095] In some embodiments, the first position information of the eyes of different observation objects may also be different. Therefore, the reference pixels on the virtual planar display screen corresponding to the left eye and the right eye respectively obtained according to the position information of the eyes of the image observation object and the position information of the virtual planar display screen may be different, and the mapping relationship between the reference pixel point of the virtual planar display screen and the pixel point of the curved display screen determined may also be different. If the mapping relationship between the reference pixel point of the virtual planar display screen and the pixel point of the curved display screen is determined based on the position information of the current image observation object, but the current image observation object does not have the requirement of viewing the naked-eye three-dimensional image by using the curved display screen, even if the next image observation object has the requirement of viewing the naked-eye three-dimensional image by using the curved display screen, the projection pixel value on the curved display screen determined by using the mapping relationship cannot guarantee the viewing experience of the naked-eye three-dimensional image of the next image observation object.
[0096] S503, determining a projection pixel value corresponding to the to-be-displayed image on the curved display screen based on the mapping relationship, and displaying the to-be-displayed image on the curved display screen according to the projection pixel value.
[0097] In some embodiments, after the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual planar display screen is obtained, the projection pixel value of the to-be-displayed image at the reference pixel point on the virtual planar display screen can be determined as the projection pixel value at the corresponding pixel point on the curved display screen according to the mapping relationship, so as to realize the display of the to-be-displayed image according to each projection pixel value.
[0098] In the embodiment of the present application, first, the first position information of the eyes of the image observer and the second position information of the curved display screen are obtained; then, the third position information corresponding to the virtual plane display screen is determined based on the first position information and the second position information; the mapping relationship between the pixel points of the curved display screen and the reference pixel points of the virtual plane display screen is determined based on the first position information and the third position information; finally, the projection pixel value of the to-be-displayed image on the curved display screen is determined based on the mapping relationship, so as to display the to-be-displayed image on the curved display screen according to the projection pixel value. In this way, the mapping relationship between the pixel points of the curved display screen and the reference pixel points of the virtual plane display screen is determined through the position information of the eyes of the image observer and the position information of the virtual plane display screen, and the projection pixel value of the to-be-displayed image on the curved display screen is determined according to the mapping relationship, so as to realize the display of the to-be-displayed image on the curved display screen, which guarantees the display effect of the to-be-displayed image and improves the visual experience of the user.
[0099] Next, the implementation process of the application embodiment in the actual application scenario is introduced.
[0100] In some embodiments, as shown in Figure 4 FIG. 1 is a flowchart of a naked-eye 3D display method based on a curved display screen provided by the application embodiment. The method can be implemented through the following steps S601 to S604, and each step is described below.
[0101] S601, obtaining the position information of the human eyes (equivalent to the first position information in other embodiments) and the position information of the curved display screen (equivalent to the first position information in other embodiments).
[0102] In some embodiments, the position information of the human eyes can be the position information of the eyes of a viewer (equivalent to the image observer in other embodiments), including the position of the left eye, the position of the right eye, the interpupillary distance, the distance from the curved display screen, etc. The viewer can observe the naked-eye three-dimensional image through the curved display screen. The position information of the curved display screen includes the current position of the curved display screen, which can be obtained in advance. In practice, a camera with depth information is arranged on the curved display screen. The camera can collect the image of the viewer and analyze and process the collected image, so that the position information of the eyes of the viewer can be obtained in real time.
[0103] S602, determining the position information of the virtual plane display screen based on the position information of the human eyes and the position information of the curved display screen.
[0104] In some embodiments, the virtual flat panel display is a hypothetical flat panel display positioned between the curved display and the observer. Based on the obtained eye position information and the position information of the curved display, the position of the virtual flat panel display can be determined, i.e., the position information of the virtual flat panel display.
[0105] For example, in some embodiments, the virtual flat-panel display screen can be positioned between the observer and the curved display screen, at a midpoint between the two. To determine this midpoint, the closest point on the curved display screen to the observer's eyes can be determined first, and then the midpoint between this closest point and the observer's eyes can be determined; this midpoint is the midpoint between the observer and the curved display screen. Furthermore, the virtual flat-panel display screen can be positioned parallel to both the observer and the curved display screen to ensure the observer can observe a good naked-eye 3D display effect.
[0106] S603. Based on the human eye position information and the position information of the virtual flat screen, determine the correspondence between the pixels of the curved screen and the reference pixels of the virtual flat screen (equivalent to "based on the first position information and the third position information, determine the mapping relationship between the pixels of the curved screen and the reference pixels of the virtual flat screen" in other embodiments).
[0107] In some embodiments, the virtual flat panel display can be a naked-eye 3D flat panel display, through which naked-eye 3D display of images can be realized. When naked-eye 3D display of images is performed using a virtual flat panel display, a first reference pixel on the virtual screen that can be observed by the observer's left eye and a second reference pixel on the virtual flat panel display that can be observed by the observer's right eye can be determined based on the position information of the human eye and the position information of the virtual flat panel display.
[0108] For example, such as Figure 3 As shown, the naked-eye 3D flat panel display has multiple semi-circular lenses. After the first and second reference pixels are refracted by the semi-circular lenses, the light emitted by each reference pixel (either the first or second reference pixel) converges in one direction, either towards the left or right eye. Therefore, once the position information of the virtual flat panel display is determined, the refractive index and position of the semi-circular lenses are known. By combining this information with the observer's left and right eye positions and the position information of the virtual flat panel display, it is possible to determine whether each reference pixel on the naked-eye 3D flat panel display is shining into the observer's left or right eye, thus obtaining the first reference pixel corresponding to the left eye and the second reference pixel corresponding to the right eye.
[0109] In some embodiments, after determining the first reference pixel corresponding to the left eye and the second reference pixel corresponding to the right eye, the first pixel corresponding to the left eye and the second pixel corresponding to the right eye on the curved display screen can be determined, along with the position information of each first pixel and each second pixel. Then, based on the position information of each first pixel and each first reference pixel, the correspondence between the first reference pixel and its corresponding first pixel is determined; and based on the position information of each second pixel and each second reference pixel, the correspondence between the second reference pixel and its corresponding second pixel is determined.
[0110] For example, in some embodiments, when determining the correspondence between a first reference pixel and its corresponding first pixel, firstly, the line connecting the first reference pixel on the virtual flat screen and the left eye (equivalent to the first line in other embodiments) can be determined; then, the position information of the intersection of the line and the curved screen can be determined; subsequently, if the position information of a first pixel corresponding to the left eye is determined to be the same as the position information of the intersection, then the first pixel can be determined to correspond to the first reference pixel; finally, the correspondence between the first reference pixel and its corresponding first pixel can be established based on the position information of the first reference pixel and its corresponding first pixel.
[0111] For example, in some embodiments, the position information of the intersection point of the line connecting the first reference pixel and the left eye with the curved display screen can be the position coordinates of that intersection point. When determining the position coordinates of that intersection point, such as... Figure 5 As shown, if the shape of the virtual flat screen is assumed to be arc-shaped, a three-dimensional rectangular coordinate system is established with the direction parallel to the observer's eye as the x-axis, the direction of the perpendicular line from the virtual flat screen to the leftmost side of the curved screen as the y-axis, and the vertical direction of the virtual flat screen as the z-axis. Assume the coordinates of the observer's left eye are (Lx, Ly, 0), the coordinates of the first reference pixel A on the virtual flat screen are (a, 0, 0), and point C is the center of the arc corresponding to the curved screen in the plane of z = 0, with coordinates (Cx, Cy, 0). R is the radius of the circle. Assume the coordinates of the intersection point A' of point A and the curved screen are (X, Y, 0). According to the geometric relationship, the following formula (4) can be obtained:
[0112] (Xa) / (Lx-a)=Y / Ly (4);
[0113] From the general formula of a circle, we know that:
[0114] (X-Cx) 2 / (Y-Cy) 2 =R 2 (5);
[0115] Solving formula (4), (5) together, the coordinate value corresponding to X, Y can be determined, so that the coordinates of the intersection point A' on the circular arc curved surface display screen are obtained.
[0116] S604, based on the corresponding relationship, the image pixel value corresponding to the pixel point on the curved surface display screen is determined (equivalent to the projection pixel value in other embodiments), and the display of the naked eye three-dimensional image on the curved surface display screen is realized according to the image pixel value.
[0117] In some embodiments, the image pixel value of the pixel point on the curved surface display screen corresponding to the pixel point is the same as the image pixel value of the corresponding reference pixel point on the virtual plane display screen, so that the corresponding image pixel value of each first pixel point on the curved surface display screen is determined according to the corresponding relationship between the first reference pixel point and the corresponding first pixel point; the corresponding image pixel value of each second pixel point on the curved surface display screen is determined according to the corresponding relationship between the second reference pixel point and the corresponding second pixel point, and then the rendering is performed according to each image pixel value, so as to realize the display of the naked eye 3D image on the curved surface display screen.
[0118] It can be understood that in the embodiments of the present application, the position information of the virtual plane display screen located between the curved surface display screen and the observer is determined according to the position information of the human eye and the position information of the curved surface display screen; the corresponding relationship between the reference pixel point on the naked eye 3D plane display screen and the pixel point on the curved surface display screen is determined according to the position information of the human eye and the position information of the virtual plane display screen, and the image pixel value of each pixel point on the curved surface display screen is determined according to the corresponding relationship, so as to realize the naked eye three-dimensional image display on the curved surface display screen. In addition, the mapping method provided by the present application for displaying the naked eye 3D plane display screen to the curved surface display screen can support the naked eye 3D display of any form of curved surface display, and through the naked eye 3D display on the curved surface display screen, a more extensive viewing angle can be provided, and the visual experience of the observer can be improved.
[0119] The present application also provides an image display device, Figure 6 The composition structure schematic diagram of the image display device provided by the embodiments of the present application is shown in Figure 6 As shown in the figure, the image display device 700 comprises:
[0120] The acquisition module 701 is used for obtaining the first position information of the eyes of the image observation object and the second position information of the curved surface display screen;
[0121] The first determination module 702 is used for determining the third position information corresponding to the virtual plane display screen based on the first position information and the second position information;
[0122] The second determining module 703 is configured to determine a mapping relationship between the pixel points of the curved display screen and the reference pixel points of the virtual planar display screen based on the first position information and the third position information.
[0123] The image display module 704 is configured to determine corresponding projection pixel values of a to-be-displayed image on the curved display screen based on the mapping relationship, and display the to-be-displayed image on the curved display screen according to the projection pixel values.
[0124] In some embodiments, the first position information includes left eye position information and right eye position information of the image observation object; and the second determining module 703 includes:
[0125] A first determining sub-module is configured to determine a first reference pixel point set corresponding to the left eye on the virtual planar display screen and a second reference pixel point set corresponding to the right eye on the virtual planar display screen based on the left eye position information, the right eye position information, and the third position information.
[0126] A second determining sub-module is configured to determine target position information of each first target pixel point corresponding to the left eye on the curved display screen and target position information of each second target pixel point corresponding to the right eye.
[0127] A third determining sub-module is configured to determine a mapping relationship between each first reference pixel point and a corresponding first target pixel point based on position information of the each first reference pixel point and target position information of the each first target pixel point, and determine a mapping relationship between each second reference pixel point and a corresponding second target pixel point based on position information of the each second reference pixel point and target position information of the each second target pixel point.
[0128] In some embodiments, the third determining sub-module includes:
[0129] A first determining unit is configured to obtain position information of an ith first reference pixel point, and determine a first connecting line between the ith first reference pixel point and the left eye based on the position information of the ith first reference pixel point and the left eye position information, where i is a positive integer.
[0130] A second determining unit is configured to determine candidate position information of an intersection point of the first connecting line and the curved display screen.
[0131] A third determining unit is configured to determine that the candidate position information is the same as target position information of a jth first target pixel point, and determine that the ith first reference pixel point corresponds to the jth first target pixel point, where j is a positive integer.
[0132] The creating unit is configured to establish a mapping relationship between the i th first reference pixel point and the j th first target pixel point based on position information of the i th first reference pixel point and target position information of the j th first target pixel point.
[0133] In some embodiments, the image display module 704 includes:
[0134] The obtaining sub-module is configured to obtain first projection pixel values of the to-be-displayed image at each first reference pixel point and second projection pixel values of the to-be-displayed image at each second reference pixel point.
[0135] The fourth determining sub-module is configured to determine each first projection pixel value as a projection pixel value of a corresponding first target pixel point, and determine each second projection pixel value as a projection pixel value of a corresponding second target pixel point.
[0136] In some embodiments, the first determining module 702 includes:
[0137] The fifth determining sub-module is configured to determine a nearest position on the curved display screen to an eye of the image observation object as a candidate position.
[0138] The sixth determining sub-module is configured to determine a third position corresponding to a virtual flat display screen based on the position of the eye and the candidate position.
[0139] In some embodiments, the sixth determining sub-module includes:
[0140] The fourth determining unit is configured to determine an intermediate position between the position of the eye and the candidate position.
[0141] The fifth determining unit is configured to determine the intermediate position between the position of the eye and the candidate position as the third position corresponding to the virtual flat display screen.
[0142] In some embodiments, the image display apparatus 700 can further include:
[0143] The receiving module is configured to receive a control instruction for naked-eye three-dimensional image display using the curved display screen.
[0144] The responding module is configured to determine a mapping relationship between pixel points of the curved display screen and reference pixel points of the virtual flat display screen based on the first position information and the third position information in response to the control instruction.
[0145] It should be noted that the description of the image display device in the embodiments of the present application is similar to the description of the above method embodiments, has similar beneficial effects as the method embodiments, and thus will not be described again. For technical details not disclosed in the device embodiments, please refer to the description of the method embodiments of the present application for understanding.
[0146] It should be noted that in the embodiments of the present application, if the image display method described above is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk, and various media that can store program codes. Thus, the embodiments of the present application are not limited to any specific hardware and software combination.
[0147] Correspondingly, the embodiments of the present application provide a computer-readable storage medium, which stores a computer program. The computer program is executed by a processor to implement the image display method provided in the above embodiments.
[0148] The embodiments of the present application also provide an image display device. Figure 7 As shown in the component structure diagram of the image display device provided in the embodiments of the present application, Figure 7 The image display device 800 includes a memory 801, a processor 802, a communication interface 803, and a communication bus 804. The memory 801 is configured to store executable image display instructions. The processor 802 is configured to execute the executable image display instructions stored in the memory to implement the image display method provided in the above embodiments.
[0149] The descriptions of the image display device and the storage medium embodiments above are similar to the descriptions of the above method embodiments, have similar beneficial effects as the method embodiments. For technical details not disclosed in the image display device and the storage medium embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.
[0150] It should be noted that, in the present document, the terms "comprising", "containing", or any other similar term are intended to encompass non-exclusive inclusions, such that a process, method, article, or apparatus that comprises a list of elements does not necessarily include those elements only, but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the phrase "comprising at least one of... " does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.
[0151] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed components can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0152] The units described above as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units; they can be located in one place or distributed on multiple network units; part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0153] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be a unit alone, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software functional unit.
[0154] It can be understood by those of ordinary skill in the art that all or part of the steps of the above method embodiments can be completed by program instruction related hardware, and the foregoing program can be stored in a computer readable storage medium, and the program executes the steps including the above method embodiments when executed; and the foregoing storage medium includes: mobile storage device, ROM, magnetic disc or optical disc and various storage program codes.
[0155] Alternatively, the above-mentioned integrated units of the present application, if realized in the form of software function modules and sold or used as independent products, can also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing a product to perform all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes: mobile storage devices, ROM, magnetic discs or optical discs, and various media that can store program codes.
[0156] The above is only an embodiment of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. An image display method comprising: obtaining first position information of an eye of an image observer and second position information of a curved display screen; determining, based on the first position information and the second position information, a nearest position on the curved display screen to the eye of the image observer, and determining the position as a candidate position; determining, based on the position of the eye and the candidate position, third position information corresponding to a virtual flat display screen; determining, based on the first position information and the third position information, a mapping relationship between a pixel point of the curved display screen and a reference pixel point of the virtual flat display screen; determining, based on the mapping relationship, a corresponding projection pixel value of a to-be-displayed image on the curved display screen, and displaying the to-be-displayed image on the curved display screen according to the projection pixel value.
2. The method of claim 1, wherein the first position information comprises left eye position information and right eye position information of the image observer; and wherein the determining, based on the first position information and the third position information, the mapping relationship between the pixel point of the curved display screen and the reference pixel point of the virtual flat display screen comprises: determining, based on the left eye position information, the right eye position information, and the third position information, a first reference pixel point set corresponding to the left eye on the virtual flat display screen and a second reference pixel point set corresponding to the right eye on the virtual flat display screen, respectively; determining target position information of each first target pixel point corresponding to the left eye on the curved display screen and target position information of each second target pixel point corresponding to the right eye; determining, based on position information of each first reference pixel point and the target position information of each first target pixel point, a mapping relationship between each first reference pixel point and a corresponding first target pixel point; determining, based on position information of each second reference pixel point and the target position information of each second target pixel point, a mapping relationship between each second reference pixel point and a corresponding second target pixel point.
3. The method of claim 2, wherein the determining, based on the position information of each first reference pixel point and the target position information of each first target pixel point, the mapping relationship between each first reference pixel point and a corresponding first target pixel point comprises: obtaining position information of an ith first reference pixel point, and determining, based on the position information of the ith first reference pixel point and the left eye position information, a first connecting line between the ith first reference pixel point and the left eye, wherein i is a positive integer; determining candidate position information of an intersection of the first connecting line and the curved display screen; determining that the candidate position information is the same as target position information of a jth first target pixel point, and determining that the ith first reference pixel point and the jth first target pixel point correspond to each other, wherein j is a positive integer; establishing, based on the position information of the ith first reference pixel point and the target position information of the jth first target pixel point, a mapping relationship between the ith first reference pixel point and the jth first target pixel point. 4. The method of claim 2, wherein the determining the corresponding projection pixel value of the to-be-displayed image on the curved display screen based on the mapping relationship comprises: obtaining a first projection pixel value of the to-be-displayed image at each first reference pixel point and a second projection pixel value of the to-be-displayed image at each second reference pixel point; and determining each first projection pixel value as the projection pixel value of the corresponding first target pixel point and each second projection pixel value as the projection pixel value of the corresponding second target pixel point.
5. The method of claim 1, wherein the determining the third position information corresponding to the virtual flat display screen based on the position of the eye and the candidate position comprises: determining an intermediate position between the position of the eye and the candidate position; and determining the intermediate position between the position of the eye and the candidate position as the third position corresponding to the virtual flat display screen.
6. The method of claim 1, further comprising: receiving a control instruction for displaying a naked-eye three-dimensional image by using the curved display screen; in response to the control instruction, determining the mapping relationship between the pixel points of the curved display screen and the reference pixel points of the virtual flat display screen based on the first position information and the third position information; determining the corresponding projection pixel value of the to-be-displayed image on the curved display screen based on the mapping relationship, and displaying the to-be-displayed image on the curved display screen according to the projection pixel value.
7. An image display apparatus, comprising: an acquisition module configured to obtain first position information of an eye of an image observer and second position information of a curved display screen; a first determination module configured to determine a nearest position on the curved display screen to the eye of the image observer based on the first position information and the second position information, and determine the position as a candidate position; determine third position information corresponding to a virtual flat display screen based on the position of the eye and the candidate position; a second determination module configured to determine a mapping relationship between pixel points of the curved display screen and reference pixel points of the virtual flat display screen based on the first position information and the third position information; and an image display module configured to determine a corresponding projection pixel value of a to-be-displayed image on the curved display screen based on the mapping relationship, and display the to-be-displayed image on the curved display screen according to the projection pixel value.
8. An image display device, comprising: a memory configured to store executable image display instructions; and a processor configured to implement the method of any one of claims 1 to 6 when executing the executable image display instructions stored in the memory.
9. A computer-readable storage medium storing image display instructions, configured to cause a processor to implement the method of any one of claims 1 to 6 when executing the image display instructions.
Citation Information
Patent Citations
Naked eye 3D display method and device for curved display screen
CN107172409A
Distortion removing method and device for transparent A-column curved screen and storage medium
CN113918024A