3D display system and 3D display method

Abstract

The invention provides a 3D display system and a 3D display method, and relates to the technical field of display, the 3D display system comprises a display panel, one side of a transparent substrate of the display panel is fixedly provided with a plurality of cylindrical lenses arranged according to a first oblique angle, and the other side of the transparent substrate is provided with a pixel array; the camera is used for acquiring a user face image; the image processing unit is used for determining the eyebrow position of the user according to the face image; the data processing unit is used for determining a pattern arrangement period and a first interweaving line according to the eyebrow position, the focal length of the camera, the first width of the cylindrical lens and the first oblique angle; determining a pixel unit for displaying a left eye image or a right eye image according to the image arrangement period and the distance between the pixel unit in the pixel array and the first interlacing line; and the control unit is used for controlling the pixel array to display the left eye image and the right eye image according to the multiple pieces of attribute information. Based on the scheme, high-frame-rate naked-eye 3D image display can be realized under the condition that the viewing angle of a user is not limited.

Description

Technical Field

[0001] This application relates to the field of display technologies, and more particularly, to 3D display systems and 3D display methods. Background Art

[0002] The naked-eye three-dimensional (3D) technology is a display technology that can achieve a three-dimensional stereoscopic visual effect without the aid of auxiliary devices. However, when a user views a picture presented based on the naked-eye 3D technology, the user's head usually needs to maintain a specific posture to view the picture with the best 3D effect.

[0003] In view of this, how to achieve the display of a naked-eye 3D picture without restricting the viewing angle of the user is an urgent problem to be solved. Summary of the Invention

[0004] This application provides a 3D display system and a 3D display method, which can achieve the display of a high-frame-rate naked-eye 3D picture without restricting the viewing angle of the user.

[0005] In a first aspect, a 3D display system is provided. The 3D display system includes: a display panel, on a first major surface of a transparent substrate of the display panel, a plurality of lenticular lenses arranged at a first oblique angle are fixed, and a pixel array is provided on a second major surface of the transparent substrate; a camera for acquiring a facial image of the user; an image processing unit for determining the position information of the user's glabella according to the facial image; a data processing unit for determining a layout period and a first interleaved line corresponding to the pixel array according to the glabella position information, the focal length of the camera, the first width of the lenticular lens, and the first oblique angle, and a straight line passing through the glabella of the user and the center of the display panel intersects the first interleaved line; and determining, according to the layout period and the distances between sub-pixel units in the pixel array and the first interleaved line, attribute information corresponding to the sub-pixel units respectively, where the attribute information is used to indicate whether the sub-pixel unit is for displaying a left-eye picture or a right-eye picture; and a control unit for controlling the pixel array to display the left-eye picture and the right-eye picture according to the plurality of attribute information.

[0006] In combination with the first aspect, in some implementation manners of the first aspect, the above-mentioned image processing unit is specifically configured to: determine a first coordinate of the user's left eye and a second coordinate of the user's right eye in a first coordinate system according to the facial image, where the first coordinate system is established based on the camera, the Z-axis of the first coordinate system is perpendicular to the display panel, and the X-axis of the first coordinate system is parallel to the bottom edge of the first major surface; and determine a third coordinate according to the first coordinate and the second coordinate, where the third coordinate is used to represent the glabella position information.

[0007] In combination with the first aspect, in some implementation manners of the first aspect, the above-mentioned image processing unit includes a deep learning model, and the deep learning model is used to extract the first coordinate and the second coordinate from the facial image.

[0008] In combination with the first aspect, in some implementations of the first aspect, the above camera is a monocular camera.

[0009] In combination with the first aspect, in some implementations of the first aspect, the above data processing unit is specifically configured to: determine the layout period according to the third coordinate, the first width, and the focal length.

[0010] In combination with the first aspect, in some implementations of the first aspect, the above data processing unit is specifically configured to: determine the first intersection point according to the third coordinate, the origin of the first coordinate system, and the focal length; determine the first intersection line according to the first intersection point and the first oblique angle, and the first intersection line passes through the first intersection point.

[0011] In combination with the first aspect, in some implementations of the first aspect, the above pixel array includes a first sub-pixel unit, and the above data processing unit is specifically configured to: determine the fifth coordinate of the first reference point in the first intersection line according to the fourth coordinate of the first sub-pixel unit, where the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate; determine the attribute information of the first sub-pixel unit according to the layout period and the first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate.

[0012] In combination with the first aspect, in some implementations of the first aspect, the above left-eye image includes a plurality of partial left-eye images, the above right-eye image includes a plurality of partial right-eye images, the partial left-eye images and the partial right-eye images are alternately arranged along the X-axis of the first coordinate system, the width of one layout period is equal to the sum of the widths of one partial left-eye image and one partial right-eye image along the X-axis direction, and the above data processing unit is specifically configured to: divide the first difference by the width of the layout period to determine the first remainder; when the first remainder is less than half of the width of the layout period and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the right-eye image; or, when the first remainder is greater than half of the width of the layout period and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left-eye image; or, when the first remainder is less than half of the width of the layout period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left-eye image; or, when the first remainder is greater than half of the width of the layout period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the right-eye image.

[0013] Second aspect, a 3D display method is provided, which is applied to a 3D display system. The 3D display system includes a display panel and a camera. A plurality of lenticular lenses arranged at a first oblique angle are fixed on a first major surface of a transparent substrate of the display panel, and a pixel array is disposed on a second major surface of the transparent substrate. The method includes: obtaining a facial image of a user; determining position information of the user's glabella according to the facial image; determining a layout period corresponding to the pixel array and a first interleaving line according to the position information of the glabella, the focal length of the camera, a first width of the lenticular lens, and the first oblique angle, and a straight line passing through the glabella of the user and the center of the display panel intersects with the first interleaving line; determining respective attribute information corresponding to a plurality of sub-pixel units according to the layout period and distances between the plurality of sub-pixel units in the pixel array and the first interleaving line, where the attribute information is used to indicate whether the sub-pixel unit is for displaying a left-eye image or a right-eye image; and controlling the pixel array to display the left-eye image and the right-eye image according to the plurality of attribute information.

[0014] In combination with the second aspect, in some implementation manners of the second aspect, according to the facial image, a first coordinate of the user's left eye in a first coordinate system and a second coordinate of the user's right eye in the first coordinate system are determined. The first coordinate system is established based on the camera, and the Z-axis of the first coordinate system is perpendicular to the display panel; a third coordinate is determined according to the first coordinate and the second coordinate, and the third coordinate is used to represent the position information of the glabella.

[0015] In combination with the second aspect, in some implementation manners of the second aspect, the layout period is determined according to the third coordinate, the first width, and the focal length; a first intersection point is determined according to the third coordinate, the origin of the first coordinate system, and the focal length; and the first interleaving line is determined according to the first intersection point and the first oblique angle, and the first interleaving line passes through the first intersection point.

[0016] In combination with the second aspect, in some implementation manners of the second aspect, the pixel array includes a first sub-pixel unit. A fifth coordinate of a first reference point in the first interleaving line is determined according to a fourth coordinate of the first sub-pixel unit, and the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate; and the attribute information of the first sub-pixel unit is determined according to the layout period and a first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate.

[0017] In combination with the second aspect, in certain implementations of the second aspect, the left-eye image includes multiple partial left-eye images, and the right-eye image includes multiple partial right-eye images. The partial left-eye images and the partial right-eye images are alternately arranged along the X-axis of the first coordinate system. The width of one layout cycle is equal to the sum of the widths of one partial left-eye image and one partial right-eye image along the X-axis direction. Divide the first difference by the width of the layout cycle to determine the first remainder; when the first remainder is less than the width of the layout cycle and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit to indicate that the first sub-pixel unit is used to display the right-eye image; or, when the first remainder is greater than the width of the layout cycle and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit to indicate that the first sub-pixel unit is used to display the left-eye image; or, when the first remainder is less than the width of the layout cycle and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit to indicate that the first sub-pixel unit is used to display the left-eye image; or, when the first remainder is greater than the width of the layout cycle and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit to indicate that the first sub-pixel unit is used to display the right-eye image.

[0018] In a third aspect, a 3D display device is provided, including a processor and a memory. Among them, the processor and the memory are connected. The memory is used to store program codes, and the processor is used to call the program codes to execute the method in any possible implementation manner in the method design of the second aspect described above.

[0019] In a fourth aspect, a computer-readable storage medium is provided, storing a computer program, and the computer program is executed by a processor to implement the method in any possible implementation manner in the method design of the second aspect.

[0020] In a fifth aspect, a computer program product is provided, including instructions, and when the instructions are run by a processor, the computer is caused to execute the method in any possible implementation manner in the method design of the second aspect described above. Description of the Drawings

[0021] Figure 1 is a schematic diagram of the principle of a naked-eye 3D technology;

[0022] Figure 2 is a schematic diagram of the principle based on the refraction of light by lenticular lenses;

[0023] Figure 3 is a schematic diagram of the architecture of a 3D display system 300 proposed in an embodiment of the present application;

[0024] Figure 4It is a schematic structural diagram of a display panel 310 proposed by an embodiment of the present application;

[0025] Figure 5 It is a schematic diagram of an interleaved layout proposed by an embodiment of the present application;

[0026] Figure 6 It is a schematic flowchart of a 3D display method 600 proposed by an embodiment of the present application;

[0027] Figure 7 It is a schematic flowchart of a method 700 for determining the position information of the center of the eyebrows proposed by an embodiment of the present application;

[0028] Figure 8 It is a schematic flowchart of a method 800 for determining the layout period and the first interleaved line proposed by an embodiment of the present application;

[0029] Figure 9 It is a schematic flowchart of a method 900 for determining attribute information proposed by an embodiment of the present application. Detailed implementation manners

[0030] Next, the technical solutions in the present application will be described with reference to the accompanying drawings.

[0031] The embodiments of the present application will present various aspects, embodiments or features around a system including multiple devices, components, modules, etc. It should be understood and clear that each system may include additional devices, components, modules, etc., and / or may not include all the devices, components, modules, etc. discussed in conjunction with the accompanying drawings. In addition, combinations of these solutions can also be used.

[0032] In addition, in the embodiments of the present application, words such as "exemplary" and "for example" are used to represent examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Exactly speaking, the use of the word "exemplary" is intended to present concepts in a specific manner.

[0033] The business scenarios described in the embodiments of the present application are for more clearly explaining the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those of ordinary skill in the art know that with the evolution of technology and the emergence of new business scenarios, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.

[0034] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized.

[0035] In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: including the case where A exists alone, the case where A and B exist simultaneously, and the case where B exists alone, where A and B can be singular or plural. The character " / " generally means that the associated objects before and after are in an "or" relationship. "At least one (item)" or its similar expression means any combination of these items, including any combination of a single item or plural items. For example, at least one (item) of a, b, or c can mean: a, b, c, a - b, a - c, b - c, or a - b - c, where a, b, c can be single or multiple.

[0036] In the description of the embodiments of the present application, the orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", "inner", "outer", "vertical", "horizontal", etc. is defined relative to the orientation or position in which the components in the drawings are schematically placed. It should be understood that these directional terms are relative concepts, which are used for description and clarification relative to, rather than indicating or implying that the device or component referred to must have a specific orientation, or be constructed and operated in a specific orientation. It can change accordingly with the change of the orientation in which the components in the drawings are placed, and thus cannot be understood as a limitation to the present application.

[0037] In the embodiments of the present application, the same reference numeral is used to represent the same component or the same part. For the same parts in the embodiments of the present application, only one of the parts or components may be labeled with a reference numeral in the figure. It should be understood that the reference numeral also applies to other identical parts or components. Additionally, the components in the drawings are not drawn to scale, and the dimensions and sizes of the components shown in the figure are only exemplary and should not be understood as a limitation to the present application.

[0038] The naked-eye 3D technology is a display technology that can achieve three-dimensional stereoscopic visual effects without the aid of auxiliary devices. Its core principle is based on the parallax effect of the human binoculars. Due to the distance between the left and right eyes, there is a slight angular difference when the left and right eyes observe the same object, and the brain fuses the two images to form a stereoscopic perception. This technology started from the exploration of stereoscopic photography in the late 19th century and has now become an important branch of display technology, showing extensive application potential in fields such as advertising, education, and medical care.

[0039] Figure 1 It is a schematic diagram of the principle of the naked-eye 3D technology.

[0040] Reference Figure 1 As shown, the naked-eye 3D is achieved through the cooperation of hardware beam splitting (such as beam splitting based on grating hardware) and software algorithms. According to the distribution of encoded data, it is beam split, and the light used to display the image is controlled to be projected to different positions, so that the corresponding image parts enter the left and right eyes of the target user. Among them, the image received by the left eye is called the left-eye image (or left view), and the image received by the right eye is called the right-eye image (or right view). The implementation paths of the naked-eye 3D technology can be divided into the following three categories: the barrier technology, the lenticular lens technology, and the autostereoscopic display technology.

[0041] Among them, the barrier technology is a common method in the naked-eye 3D technology. By setting a layer of barrier with a specific pattern in front of the display screen, that is, the parallax barrier, this barrier allows the images viewed from different angles to be separated, ensuring that the left and right eyes see different images respectively. When these images are fused by the brain, a 3D effect is generated. The key to the barrier technology lies in the design of the barrier pattern. The barrier pattern usually consists of a series of small stripes or grids, and the arrangement of these stripes or grids determines the separation effect of the images. When the user stands at the designated viewing position, the left and right eyes see different images separated by the barrier pattern respectively, thus generating a sense of stereoscopy. However, the barrier technology also has some limitations. First, the viewing angle is limited, usually ±30°. If the user's position or angle deviates from the optimal viewing area, double images or image distortion may be seen; second, due to the existence of the barrier pattern, the brightness of the screen may be affected to a certain extent. After applying this technology, the brightness loss of the overall picture reaches more than 30%. In addition, the cost of the barrier technology is relatively high, which limits its application in some fields.

[0042] The lenticular lens technology is another common naked-eye 3D technology. Figure 2 It is a schematic diagram of the principle based on the refraction of light by lenticular lenses.

[0043] Reference Figure 2As shown, the lenticular lens technology uses a series of tiny lenses covering the display screen. Each lens is responsible for focusing different parts of the image onto the user's left or right eye, enabling the user to see the 3D effect without wearing glasses. The key to the lenticular lens technology lies in the arrangement and focal length of the lenses as well as the design of the left and right eye image layout (also known as the layout period) of the display screen. By adjusting the arrangement, focal length, and layout period of the lenses, the naked-eye 3D effect can be enhanced. Compared with the parallax barrier technology, the lenticular lens technology provides a wider viewing angle, with a field of view angle up to ±60°, enabling users to view a clear 3D effect within a larger range. However, the lenticular lens technology also has some challenges. First, due to the existence of the lenses, the screen resolution may be affected to a certain extent. Second, the cost of the lenticular lens technology is relatively high, and it requires a more complex manufacturing process. In addition, problems such as image distortion and color distortion may also exist in the lenticular lens technology, and there is still much room for improvement.

[0044] The directional light source technology refers to adding a layer of directional backlight, combined with a fast-response liquid crystal display (LCD) panel and a driving method, to enable 3D content to enter the user's left and right eyes in a sorted manner, swapping images to generate parallax. This technology has high brightness and supports lossless switching, but the device has a larger thickness and higher cost, and is mostly used in specific scenarios.

[0045] In addition, the naked-eye 3D technology also involves layout technology and interleaving technology.

[0046] Among them, the layout technology arranges different images or perspectives on the display screen so that the left and right eyes can see different images. Taking the above-mentioned parallax barrier technology as an example, in the parallax barrier technology, a layer of parallax barrier needs to be set in front of the screen to block part of the light. Correspondingly, the image on the screen is divided into multiple pixels or pixel groups, and each pixel or pixel group corresponds to a specific perspective. The slits or openings of the parallax barrier are precisely designed to ensure that each eye can only see the pixels or pixel groups corresponding to it. Since the image on the screen is divided by the slits, the left and right eyes see different parts of the image, thus generating a sense of stereoscopy.

[0047] Taking the above-mentioned lenticular lens technology as an example, in the lenticular lens technology, a layer of cylindrical lens needs to be covered on the screen to divide the image into sub-images at different angles. Correspondingly, the image on the screen is divided into multiple sub-images, and each sub-image corresponds to a specific perspective. The cylindrical lens refracts each sub-image in different directions to ensure that the left and right eyes can see the sub-images corresponding to them. Since the image pixels under each lens are divided into multiple sub-pixels and refracted in different directions by the lens, the left and right eyes see different sub-pixel combinations through the lens, thus generating a sense of stereoscopy.

[0048] Interleaving in autostereoscopic 3D refers to a specific display technology used to alternately display left and right eye images on an autostereoscopic 3D display device, enabling the viewer's brain to synthesize the images seen by the left and right eyes into a stereoscopic picture with a sense of depth without the need to wear 3D glasses. This technology utilizes the visual persistence effect of the human eye, that is, when images are rapidly switched within a sufficiently short time, the human eye will synthesize multiple images into a continuous picture.

[0049] In the autostereoscopic 3D interleaving technology, since it is necessary to display left and right eye images simultaneously, the resolution of each eye image is usually half of the total resolution of the display. Additionally, to ensure smooth switching between left and right eye images and eliminate the flickering sensation, the autostereoscopic 3D interleaving technology requires a refresh rate of at least 120Hz. In this way, each eye can see images at 60Hz, thus maintaining the smoothness of the picture.

[0050] The autostereoscopic 3D interleaving technology can adopt different alternating methods, such as up-and-down alternation, left-and-right alternation, etc. This method determines the display order of left and right eye images and the viewing experience of the viewer.

[0051] After entering the 21st century, with the continuous progress of display technology and the gradual reduction of costs, autostereoscopic 3D technology has gradually moved towards commercial applications. Currently, autostereoscopic 3D technology has been widely used in multiple fields such as advertising, entertainment, and education.

[0052] For example, in the advertising field, autostereoscopic 3D technology can create more attractive advertising effects. By leveraging the three-dimensionality and immersion of autostereoscopic 3D technology, advertisers can produce more vivid and interesting advertising content to attract consumers' attention. For example, in public places such as shopping malls and subway stations, autostereoscopic 3D advertising screens can display realistic 3D pictures, bringing a brand-new visual experience to consumers.

[0053] In the entertainment field, autostereoscopic 3D technology brings a more real and immersive viewing experience to users. By utilizing the three-dimensionality of autostereoscopic 3D technology, entertainment content such as movies and games can present more realistic scenes and characters, enhancing the user's sense of immersion and substitution. For example, on the 3D screen in a cinema, users can feel the real distance and depth of objects in the movie scene, enhancing the immersion and substitution of movie viewing.

[0054] In the education field, autostereoscopic 3D technology can provide students with more intuitive and vivid teaching content. By leveraging the three-dimensionality of autostereoscopic 3D technology, teachers can produce more vivid and vivid courseware and teaching models to help students better understand and master knowledge points. For example, in biology courses, teachers can use autostereoscopic 3D technology to create realistic cell models to help students better understand the structure and function of cells.

[0055] In the medical field, naked-eye 3D technology also has broad application prospects. By using the stereoscopic sense of naked-eye 3D technology, doctors can observe and analyze patients' medical imaging data more intuitively, improving the accuracy and efficiency of diagnosis. In addition, naked-eye 3D technology can also be used for surgical simulation and training, helping doctors improve surgical skills and safety.

[0056] In the field of industrial design and manufacturing, naked-eye 3D technology can bring more intuitive and efficient design and production processes to enterprises. By using the stereoscopic sense of naked-eye 3D technology, designers can more intuitively observe and analyze the appearance and structure of products, and improve the accuracy and efficiency of design. At the same time, naked-eye 3D technology can also be used for simulation and optimization of production lines, helping enterprises improve production efficiency and reduce costs.

[0057] As naked-eye 3D technology continues to mature and become more popular, its application areas will continue to expand. In addition to advertising, entertainment, education and other fields, naked-eye 3D technology will also gradually be applied to emerging fields such as smart home, virtual reality (VR), augmented reality (AR). These emerging fields will provide a broader application space and market demand for naked-eye 3D technology.

[0058] However, since the current naked-eye 3D technology is still in the research and development stage, when applied to the above-mentioned application scenarios, there are usually problems such as limited viewing angles and poor image quality. In particular, when users watch images presented based on naked-eye 3D technology, the user's head usually needs to maintain a specific posture to be able to watch the best 3D effect. Even though naked-eye 3D display systems with eye tracking functions have been proposed at this stage, these systems often face problems of low frame rate and blurred images when the user's head moves. This is mainly due to the high complexity limitations of the algorithm and the unreasonable interlaced arrangement of the left-eye and right-eye images of the stereoscopic image.

[0059] In view of this, the embodiments of the present application propose a 3D display system and a 3D display method, which dynamically obtains the user's eyebrow position information and dynamically determines the image arrangement period and the position where the left eye image and the right eye image are interlaced based on the eyebrow position information and system hardware parameters. The algorithm complexity of this solution is low, so that clear and high-frame-rate naked-eye 3D image display can be achieved without limiting the user's viewing angle.

[0060] Figure 3 It is a schematic diagram of the architecture of a 3D display system 300 proposed in an embodiment of the present application.

[0061] Figure 4 3 is a schematic diagram of the structure of a display panel 310 proposed in an embodiment of the present application. Figure 4(a) therein is used to show a cross-sectional view of the display panel 310, where the cross-section is obtained by intercepting along the A-A cross-section shown in Figure 4 (b) therein, and Figure 4 (b) therein is used to show a front view of the display panel 310.

[0062] Referring to Figure 3 and Figure 4 shown, the 3D display system 300 includes:

[0063] A display panel 310, on the first major surface 01 of the transparent substrate 311 of the display panel 310, a plurality of lenticular lenses 312 arranged according to a first oblique angle α are fixed, and a pixel array 313 is provided on the second major surface 02 of the transparent substrate 311.

[0064] A camera 320 for acquiring a facial image of a user.

[0065] An image processing unit 330 for determining the position information of the user's eyebrows center according to the facial image.

[0066] A data processing unit 340 for determining the layout period and the first interleaved line corresponding to the pixel array 313 according to the position information of the eyebrows center, the focal length of the camera 320, the first width of the lenticular lenses 312, and the first oblique angle α; and determining the respective attribute information corresponding to the sub-pixel units 314 according to the distances between the layout period and the sub-pixel units 314 in the pixel array 313 and the first interleaved line, where the attribute information is used to indicate whether the sub-pixel unit 314 is for displaying a left-eye image or a right-eye image.

[0067] A control unit 350 for controlling the pixel array 313 to display a left-eye image and a right-eye image according to the plurality of attribute information.

[0068] Wherein, in the front view shown in Figure 4 (b), the viewpoint of the front view is opposite to the first major surface 01, and the above-mentioned first oblique angle α refers to the relatively small included angle, that is, an acute angle, formed between the lenticular lens 312 and the top or bottom edge of the first major surface 01. The above-mentioned sub-pixel unit 314 may correspond to a sub-pixel in a red-green-blue (RGB) pixel, such as an R sub-pixel, a G sub-pixel, or a B sub-pixel. Of course, the above-mentioned sub-pixel unit 314 may also correspond to a pixel composed of other color channels, such as an RGGB pixel, etc.

[0069] Based on the foregoing Figure 1According to the corresponding content, the left-eye image can include multiple partial left-eye images, and the right-eye image can include multiple partial right-eye images. Among them, the partial left-eye images and the partial right-eye images are alternately arranged along the bottom edge of the display panel 310. Then, the layout period is used to represent the sum of the widths of one adjacent partial left-eye image and one adjacent partial right-eye image. It can also be known from this that the layout period is a parameter used to describe the display state of the pixel array 313.

[0070] In naked-eye 3D display, in order to project different images to the left and right eyes respectively to achieve a three-dimensional stereoscopic effect, an interleaving technique is usually adopted. This technique enables the audience to see a realistic 3D effect in the naked-eye state by alternately displaying the left-eye and right-eye images on the display. It can also be known from this that the interleaving line is also a parameter used to describe the display state of the pixel array 313. The interleaving line involved in the embodiments of the present application can be understood as the boundary or dividing line used to distinguish between the left-eye and right-eye images during the alternate display of the left-eye and right-eye images. One layout period can include one interleaving line, and this interleaving line is located at the midline position of the frame corresponding to the layout period. The straight line passing through the user's eyebrows and the center of the display panel intersects the above-mentioned first interleaving line.

[0071] Exemplarily, during the process of the user moving relative to the display panel 310, since the position information of the user's eyebrows is dynamically changing relative to the display panel 310, the data processing unit 340 can dynamically adjust the layout period and the first interleaving line corresponding to the pixel array 313 based on the different position information of the user's eyebrows, so that the interleaving position and the layout period of the left-eye and right-eye images displayed on the display panel 310 are adapted to the current position of the user's eyebrows, enabling the user's left and right eyes to respectively receive appropriate left-eye and right-eye images, and thus synthesizing clear and good 3D effect images in the brain.

[0072] In some possible embodiments, the above-mentioned transparent substrate 311 can be a glass substrate or a substrate made of other materials with transparent properties.

[0073] In some possible embodiments, the operation of the above-mentioned camera 320 to obtain the user's facial image is an operation carried out under the premise of the user's authorization. The camera 320 responds to the user's authorization operation and starts to obtain the user's facial image.

[0074] In some possible embodiments, the above-mentioned camera 320 can be in the same spatial plane as the display panel 310. For example, it is set at the midpoint position of the top edge of the first major surface 01 of the display panel 310.

[0075] In some possible embodiments, the above-mentioned eyebrows position information is used to describe the positional relationship between the user's eyebrows and multiple hardware parts in the display panel 310, and this eyebrows position information can be represented by a coordinate.

[0076] In some possible embodiments, the above-mentioned image processing unit 330 may determine the first coordinate of the user's left eye and the second coordinate of the user's right eye in the first coordinate system based on the facial image. The first coordinate system may be established based on the camera 320. According to the first coordinate and the second coordinate, a third coordinate is determined, and the third coordinate is used to represent the position information of the center of the eyebrows.

[0077] Wherein, the Z-axis of the first coordinate system is perpendicular to the display panel 310; further, the X-axis of the first coordinate system is parallel to the bottom edge of the first large surface 01.

[0078] In some possible embodiments, the abscissa and ordinate of the above-mentioned first coordinate and second coordinate may be added and averaged respectively to determine the abscissa and ordinate of the third coordinate.

[0079] Since the Z-axis of the first coordinate system is perpendicular to the display panel 310, the X-Y plane of the first coordinate system is parallel to the display panel 310.

[0080] Based on the above technical solution, by dynamically obtaining the position information of the center of the user's eyebrows, and based on the position information of the center of the eyebrows and the system hardware parameters, the layout period and the interleaving position of the left-eye image and the right-eye image are dynamically determined, so that at any position in front of the display panel, the left and right eyes of the user can respectively receive appropriate left-eye and right-eye images, thereby synthesizing clear and good 3D-effect images in the brain. This solution only needs to obtain the position information of the center of the user's eyebrows, and the rest of the parameters are system hardware parameters, and the algorithm complexity is relatively low, which can effectively improve the data processing speed, reduce the calculation overhead and hardware cost, so that the display panel can invest more resource overhead in the display operation of higher frame rate images, thereby helping to improve the frame rate of 3D image display.

[0081] In some possible embodiments, the above-mentioned deep learning model applied to the image processing unit 330 may be used to extract the above-mentioned first coordinate and the above-mentioned second coordinate from the facial image; further, the above-mentioned third coordinate may be determined according to the above-mentioned first coordinate and the above-mentioned second coordinate to determine the position information of the center of the eyebrows.

[0082] In some possible embodiments, the above-mentioned deep learning model can be determined in the following way: First, a large amount of facial image data is collected, and it is ensured that these images contain clear facial features. Then, these images are labeled, that is, the coordinate positions of the two eyes or the coordinate position of the center of the eyebrows in each image are manually marked. These labeled data will be used to train the deep learning model. Then, a deep learning model suitable for facial feature point detection is selected. This deep learning model can include convolutional neural networks (CNNs) and their variants, such as hourglass networks, residual neural networks (ResNets), etc., which are models with strong image processing performance. Finally, the labeled facial image data is used to train the model, so that during the training process, the deep learning model learns the method of extracting features from facial images and determining the coordinate positions of the two eyes or the coordinate position of the center of the eyebrows.

[0083] The deployment of the deep learning model enables the camera 320 in the 3D display system 300 to use a monocular camera, eliminating the need to use a binocular camera to track the user's eyes. Compared with binocular cameras, monocular cameras have lower costs, simpler structures, lower power consumption, and no parallax errors introduced by binocular camera hardware, which helps ensure the accurate execution of 3D display-related algorithms.

[0084] Based on the above technical solution, by using a deep learning model to extract features from the user's facial image to obtain the information of the user's eyebrow center position, more accurate eye tracking can be achieved, thereby improving the eye tracking accuracy and user experience of the naked-eye 3D display.

[0085] In some possible embodiments, as shown in (a) of Figure 4 After determining the third coordinate for describing the user's eyebrow center position, the above data processing unit 340 can determine the layout period through the following operations: Determine the layout period according to the third coordinate, the first width, and the focal length.

[0086] The principle of the above operations is as follows:

[0087] Since the layout period of the entire display panel 310 is the same, determining 1 layout period means determining the layout period of the entire display panel 310. Then, the layout period of the entire display panel 310 can be determined by determining the layout period to which the above first interleaved line belongs. Based on the foregoing description, the first interleaved line intersects the straight line passing through the user's eyebrow center and the center of the display panel, so this straight line can carry the information of the above third coordinate. Then, this straight line can be used as the basis for determining the layout period.

[0088] Refer to Figure 4As shown in (a) in [context], in the X-Z plane of the first coordinate system, the X coordinate (also known as the abscissa) and the Z coordinate (also known as the vertical coordinate or depth coordinate) of the center of the display panel are both 0, which is equivalent to the origin of the two-dimensional coordinate system formed by the X-Z plane. Since one image arrangement cycle corresponds to the light rays emitted by the pixels at the two endpoints (A and B) of the picture towards the user's eyebrows (E), passing through the array formed by the lenticular lens 312, the distance between the two incident points (C and D) of these two light rays on the lenticular lens 312 needs to be strictly ensured to be the width of 1 lenticular lens 312, that is, the above-mentioned first width, so as to ensure that the left-eye image and the right-eye image received by the user will not be blurred when synthesized in the brain.

[0089] Based on the above description of the optical paths of the two light rays, it is possible to determine △EAB formed by the eyebrows E, the endpoint A and the endpoint B of the picture corresponding to one image arrangement cycle, and △ECD formed by the eyebrows E, the incident points C and D of the two light rays on the lenticular lens 312. According to the principle of similar triangles, △EAB is similar to △ECD, and the side length relationship between the two satisfies the following formula (1):

[0090] W / △X=Z1 / (Z1+F) (1)

[0091] Wherein, W is used to represent the first width, △X is used to represent the image arrangement cycle, Z1 is used to represent the Z coordinate in the third coordinate, and F is used to represent the thickness of the transparent substrate 311, and the offset existing after the lenticular lens 312 is attached to the transparent substrate 311 can also be included in F.

[0092] From this, it can be known that △X=W×(Z1+F) / Z1. Among them, W and F are system hardware parameters and are known quantities. Z1 can be obtained through the image processing unit 330, so △X can be calculated.

[0093] Based on the above technical solution, by obtaining the third coordinate used to represent the position of the eyebrows, combined with the known system hardware parameters, the image arrangement cycle can be determined. The algorithm complexity is very low, easy to implement, and the calculation overhead is small.

[0094] In some possible embodiments, after determining the third coordinate used to describe the position of the user's eyebrows, the above data processing unit 340 can determine the first interleaved line through the following operations: determine the first intersection point according to the third coordinate, the origin of the first coordinate system, and the focal length; determine the first interleaved line according to the first intersection point and the first oblique angle α, and this first interleaved line passes through the above first intersection point.

[0095] The principle of the above operations is as follows:

[0096] First is the determination of the first intersection point. The first intersection point belongs to the first intersection line. As known from the foregoing description, the first intersection line is the intersection line that intersects with the straight line passing through the center of the user's eyebrows and the center of the display panel. Therefore, after determining the straight line passing through the center of the user's eyebrows and the center of the display panel, and combining with the focal length F, the coordinates of the first intersection point G in the X-Z plane can be determined, denoted as (X2, Z2).

[0097] Among them, the straight line passing through the center of the user's eyebrows and the center of the display panel can be expressed by the following formula (2):

[0098] Z = k×(X - offset) (2)

[0099] Among them, k is the slope of this straight line. This slope can be determined by the third coordinate (X1, Z1). In this example, this slope is less than 0, that is, equal to -Z1 / X1. When the user is in other positions, this slope may be greater than 0; offset is a system hardware parameter, referring to the offset that exists after the cylindrical lens 312 is attached to the transparent substrate 311.

[0100] In addition, the focal length F of the camera 320 is also a system hardware parameter. The magnitude of this focal length F can be equal to the thickness of the transparent substrate 311 and can be used as the Z coordinate of the first intersection point G, that is, Z2 = -F. Then substituting F into the above straight line formula, the X coordinate of the first intersection point G can be determined, that is, X2 = (-F / k) + offset. In summary, the coordinates (X2, Z2) of the first intersection point G can be determined.

[0101] Figure 5 It is a schematic diagram of an interleaved layout proposed in an embodiment of the present application.

[0102] In some possible embodiments, during the process of determining the first intersection line L, a second coordinate system can be established based on the pixel array 313. This second coordinate system is established based on the screen (or the pixel array 313), and the origin is located at the center of the screen (or the pixel array 313). This second coordinate system is a two-dimensional coordinate system, including the X-Y plane, and the X-Y plane is perpendicular to the X-Z plane of the above first coordinate system, so that the abscissa of the second coordinate system is the same as the abscissa of the two-dimensional coordinate system corresponding to the above X-Z plane, that is, the abscissa of the first intersection point G in the X-Z plane is equal to the abscissa of the first intersection point G in the X-Y plane. Therefore, the coordinates of the first intersection point G in the second coordinate system can be determined as (X1, 0).

[0103] Based on the foregoing embodiments, it can be seen that the multiple cylindrical lenses 312 fixed to the transparent substrate 311 are arranged at a first oblique angle α, and the interleaving lines are located at the midline position of the picture width corresponding to each arrangement period. Moreover, based on the example of the above arrangement period calculation, 1 arrangement period corresponds to 1 cylindrical lens 312, that is, the shape of the picture corresponding to the arrangement period is similar to the shape of the cylindrical lens. Therefore, the picture corresponding to the arrangement period is also arranged on the pixel array 313 at the first oblique angle α. From this, it can be known that the interleaving lines are also arranged on the pixel array 313 at the first oblique angle α. Therefore, the above first interleaving line L is parallel to the side of the cylindrical lens 312. Based on this, it can be known that the slope of the first interleaving line L can be determined by the first oblique angle α, that is, tanα.

[0104] Based on the above derivation, it can be seen that the coordinates (Xx, Yy) of any point on the first interleaving line L can have the relationship shown in the following formula (3):

[0105] Xx = X2 + Yy / Flag / tanα (3)

[0106] Wherein, in the second coordinate system, when the slope of the first interleaving line L is positive, Flag = 1, and when the slope of the first interleaving line L is negative, Flag = -1.

[0107] Since the first interleaving line L straddles the Y-axis of the entire second coordinate system, the Y coordinates (i.e., the ordinates corresponding to multiple sub-pixels) used to form multiple points on the first interleaving line L traverse from the maximum Y coordinate to the minimum Y coordinate. By substituting these Y coordinates into the above formula (3) respectively, the X coordinates used to form multiple points on the first interleaving line L can be determined. After determining the coordinates of multiple points in the second coordinate system, it means determining the above first interleaving line L.

[0108] Because the first interleaving line L is determined based on the third coordinate corresponding to the user's eyebrows and the coordinate corresponding to the center of the screen, as the position of the user's eyebrows changes, the position of the first interleaving line L also changes. Since the coordinate corresponding to the center of the screen is also used as the main basis in the process of determining the first interleaving line L, no matter how the position of the first interleaving line L changes, from the perspective of the user watching the display panel 310, the first interleaving line L is always at the center position of the screen, thus ensuring that the interleaved arrangement form of the left-eye picture and the right-eye picture of the display panel 310 can exactly match the user's binoculars at the current position, enabling the user to view a clear and stereoscopic picture with good effect. Moreover, the above method can determine the first interleaving line L by obtaining the third coordinate used to represent the position of the eyebrows and combining the known system hardware parameters. The algorithm complexity is very low, it is easy to implement, and the calculation cost is small.

[0109] Since the above-mentioned second coordinate system is established based on the pixel array 313, the coordinates corresponding to each sub-pixel unit constituting the pixel array 313 can be determined. Since in the fields of computer graphics and image processing, the origin of pixel or sub-pixel coordinates is usually defined as the upper left corner of the image, before determining the attribute information of the first pixel unit, the coordinates of each sub-pixel unit can be converted to the second coordinate system, so as to re-determine the coordinates of each sub-pixel unit. In the embodiment of the present application, the coordinates used to describe the position of the sub-pixel unit can be the coordinates of the reference point of the sub-pixel unit, and the reference point can be located at the center of the sub-pixel unit.

[0110] In some possible embodiments, referring to the above Figure 5 As shown, after determining the above-mentioned first interleaved line L, the data processing unit 340 can also determine the attribute information corresponding to the sub-pixel unit in the pixel array 313, that is, determine whether the sub-pixel unit is used to display the left-eye image or the right-eye image.

[0111] For the convenience of description, the following takes the first sub-pixel unit P1 in the pixel array 313 as an example to describe in detail the determination of the attribute information of the first sub-pixel unit P1.

[0112] In some possible embodiments, the attribute information of the first sub-pixel unit P1 can be determined through the following operations: according to the fourth coordinate of the first sub-pixel unit P1, determine the fifth coordinate of the first reference point B1 in the first interleaved line L, and the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate; according to the layout period and the first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit P1.

[0113] In some possible embodiments, the fourth coordinate of the first sub-pixel unit P1 may be the coordinate in the first coordinate system. At this time, the fourth coordinate can be converted to the second coordinate system, and then based on the converted fourth coordinate, determine the fifth coordinate of the first reference point in the first interleaved line L. The same applies to other sub-pixel units.

[0114] Since the fourth coordinate of the first sub-pixel unit P1 is a known quantity, and the ordinate of the first reference point B1 in the first interleaved line L is the same as the ordinate of the first sub-pixel unit P1, the ordinate of the first reference point B1 is also a known quantity. And in the previous embodiment, the expression of the first interleaved line L, that is, the above formula (3), is proposed. Then, substituting the ordinate of the first reference point B1 into the above formula (3), the abscissa of the first reference point B1 can be obtained, and thus the fifth coordinate of the first reference point B1 is obtained.

[0115] Based on the description of the foregoing embodiments, the layout period refers to the width of the picture frame formed by adjacent partial left views and partial right views. That is, the width of one layout period is equal to the sum of the widths of one partial left-eye view and one partial right-eye view. After obtaining the fifth coordinate, the data processing unit 340 can determine the attribute information corresponding to the first sub-pixel unit P1 through the following operations:

[0116] Divide the first difference by the width of the layout period to determine the first remainder; Refer to Figure 5 as shown, the first remainder is less than half of the width of the layout period, and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate. It can be determined that the attribute information of the first sub-pixel unit P1 is used to indicate that the first sub-pixel unit P1 is for displaying the right-eye view.

[0117] Then, for other sub-pixels, there can also be the following judgment methods in multiple cases:

[0118] Taking the second sub-pixel unit P2 as an example, the difference in abscissa between the second sub-pixel unit P2 and the second reference point B2 with the same ordinate on the first interleaved line L is the second difference. After dividing the second difference by the width of the layout period, the second remainder is determined. Refer to Figure 5 as shown, the second remainder is greater than half of the width of the layout period, and the abscissa of the second sub-pixel unit P2 is less than the abscissa of the second reference point B2. It can be determined that the attribute information of the second sub-pixel unit P2 is used to indicate that the second sub-pixel unit P2 is for displaying the left-eye view.

[0119] Taking the third sub-pixel unit P3 as an example, the difference in abscissa between the third sub-pixel unit P3 and the third reference point B3 with the same ordinate on the first interleaved line L is the third difference. After dividing the third difference by the width of the layout period, the third remainder is determined. Refer to Figure 5 as shown, the third remainder is less than half of the width of the layout period, and the abscissa of the third sub-pixel unit P3 is greater than the abscissa of the third reference point B3. It can be determined that the attribute information of the third sub-pixel unit P3 is used to indicate that the third sub-pixel unit P3 is for displaying the left-eye view.

[0120] Taking the fourth sub-pixel unit P4 as an example, the difference in abscissa between the fourth sub-pixel unit P4 and the fourth reference point B4 with the same ordinate on the first interleaved line L is the fourth difference. After dividing the fourth difference by the width of the layout period, the fourth remainder is determined. Refer to Figure 5 as shown, the fourth remainder is greater than half of the width of the layout period, and the abscissa of the fourth sub-pixel unit P4 is greater than the abscissa of the fourth reference point B4. It can be determined that the attribute information of the fourth sub-pixel unit P4 is used to indicate that the second sub-pixel unit P2 is for displaying the right-eye view.

[0121] Traverse all the sub-pixel units in the pixel array 313 based on the above algorithm, and the attribute information corresponding to each sub-pixel unit can be determined.

[0122] In some possible embodiments, since the algorithm for determining the attribute information of the sub-pixel unit is simple, with small computational overhead and low requirements for computing performance, the data processing unit 340 can determine the attribute information corresponding to multiple sub-pixel units in the pixel array 313 in parallel, thereby increasing the efficiency of determining the interleaved layout form and helping to increase the frame rate of the 3D image.

[0123] Based on the above technical solution, only the horizontal distance between each sub-pixel unit and the first interleaved line needs to be determined, and based on the remainder of the quotient of the horizontal distance and the width of the layout period, it can be determined whether each sub-pixel unit is used to display the left-eye image or the right-eye image, so as to determine the interleaved layout method that matches the user's current eye position. This method has a very low algorithm complexity, is easy to implement, and has small computational overhead.

[0124] In some possible embodiments, the data processing unit 340 can send the attribute information corresponding to each sub-pixel unit to the control unit 340, so that the control unit 340 controls the pixel array 313 to display the left-eye image and the right-eye image with a specific interleaved layout according to the attribute information corresponding to each sub-pixel unit.

[0125] Correspondingly, an embodiment of the present application also proposes a 3D display method, which can be applied to a 3D display system, such as the 3D display system proposed in the embodiment of the present application. The 3D display system includes a display panel and a camera. A plurality of lenticular lenses arranged at a first oblique angle are fixed on the first major surface of the transparent substrate of the display panel, and a pixel array is provided on the second major surface of the transparent substrate.

[0126] Figure 6 It is a schematic flowchart of a 3D display method 600 proposed in an embodiment of the present application.

[0127] Refer to Figure 6 As shown, the above 3D display method 600 includes the following steps:

[0128] S610: Obtain the facial image of the user.

[0129] In some possible embodiments, before S610, an authorization operation of the user can also be obtained, and in response to the authorization operation, S610 and its subsequent process steps can be started.

[0130] S620: Determine the position information of the user's brow center according to the facial image.

[0131] S630: Determine the layout period corresponding to the pixel array and the first interleaved line based on the position information of the center of the eyebrows, the focal length of the camera, the first width of the cylindrical lens, and the first oblique angle. The straight line passing through the center of the user's eyebrows and the center of the display panel intersects the first interleaved line.

[0132] S640: Determine the attribute information corresponding to each sub-pixel unit according to the layout period and the distance between the sub-pixel units in the pixel array and the first interleaved line. The attribute information is used to indicate whether the sub-pixel unit is for displaying the left-eye image or the right-eye image.

[0133] S650: Control the pixel array to display the left-eye image and the right-eye image according to the multiple attribute information.

[0134] Figure 7 It is a schematic flowchart of a method 700 for determining the position information of the center of the eyebrows proposed in an embodiment of the present application.

[0135] Reference Figure 7 As shown, the above method 700 may include the following operations:

[0136] S710: Determine the first coordinate of the user's left eye in the first coordinate system and the second coordinate of the right eye in the first coordinate system according to the facial image. The first coordinate system is established based on the camera. The Z-axis of the first coordinate system is perpendicular to the display panel, and the X-axis of the first coordinate system is parallel to the bottom edge of the first large surface.

[0137] S720: Determine the third coordinate according to the first coordinate and the second coordinate. The third coordinate is used to represent the position information of the center of the eyebrows.

[0138] Figure 8 It is a schematic flowchart of a method 800 for determining the layout period and the first interleaved line proposed in an embodiment of the present application.

[0139] Reference Figure 8 As shown, the above method 800 may include the following operations:

[0140] S810: Determine the layout period according to the third coordinate, the first width, and the focal length.

[0141] S820: Determine the first intersection point according to the third coordinate, the origin of the first coordinate system, and the focal length.

[0142] S830: Determine the first interleaved line according to the first intersection point and the first oblique angle. The first interleaved line passes through the first intersection point.

[0143] Assume that the pixel array includes a first sub-pixel unit. Then, the attribute information of the first sub-pixel unit can be determined by the following method.

[0144] Figure 9It is a schematic flowchart of a method 900 for determining attribute information proposed in an embodiment of the present application. This process is described by taking the determination of the attribute information of the first sub-pixel unit as an example. For other sub-pixel units, the method 900 can also be applied to determine the corresponding attribute information.

[0145] Reference Figure 9 As shown, the method 900 may include the following operations:

[0146] S910: Determine the fifth coordinate of the first reference point in the first interleaved line according to the fourth coordinate of the first sub-pixel unit, where the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate.

[0147] S920: Determine the attribute information of the first sub-pixel unit according to the layout period and the first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate.

[0148] Based on the foregoing embodiments, it can be known that the left-eye image includes multiple partial left-eye images, the right-eye image includes multiple partial right-eye images, the partial left-eye images and the partial right-eye images are alternately arranged along the X-axis of the first coordinate system, and the width of one layout period is equal to the sum of the widths of one partial left-eye image and one partial right-eye image along the X-axis direction. Based on this, the above S920 can be completed through the following operations:

[0149] S921: Divide the first difference by the width of the layout period to determine the first remainder.

[0150] S922: Determine the attribute information of the first sub-pixel unit according to the size relationship between the first remainder and the width of the layout period, and the size relationship between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate. The judgment principle is as follows:

[0151] In the case where the first remainder is less than the width of the layout period and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is for displaying the right-eye image.

[0152] Or, in the case where the first remainder is greater than the width of the layout period and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is for displaying the left-eye image.

[0153] Or, in the case where the first remainder is less than the width of the layout period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is for displaying the left-eye image.

[0154] Alternatively, in a case where the first remainder is greater than the width of the layout period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, determine the attribute information of the first sub-pixel unit to indicate that the first sub-pixel unit is used for displaying the right-eye image.

[0155] Based on the above technical solution, by dynamically obtaining the user's eyebrow center position information and based on the eyebrow center position information and system hardware parameters, the layout period and the interleaving positions of the left-eye image and the right-eye image are dynamically determined, so that at any position in front of the display panel, the left and right eyes can respectively receive appropriate left-eye and right-eye images, thereby synthesizing clear and good 3D-effect images in the brain. This method only needs to obtain the user's eyebrow center position information, and the rest of the parameters are system hardware parameters. Moreover, the algorithm complexity is relatively low, which can effectively improve the data processing speed, reduce the calculation overhead and hardware cost, enabling the display panel to invest more resource overhead in the display operation of higher frame rate images, thus contributing to the improvement of the frame rate of 3D image display.

[0156] An embodiment of the present application also provides a 3D display device, including a processor and a memory. Among them, the processor and the memory are connected. The memory is used for storing program codes, and the processor is used for calling the program codes to execute any one of the 3D display methods provided by the embodiments of the present application.

[0157] In addition, an embodiment of the present application also provides a computer-readable storage medium, on which instructions are stored. When the instructions are executed by a processor, the processor is enabled to implement any one of the 3D display methods provided by the embodiments of the present application.

[0158] In several embodiments provided by the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical or other forms.

[0159] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A 3D display system, characterized in that: The 3D display system comprises: A display panel, wherein a first large surface of a transparent substrate of the display panel is fixed with a plurality of cylindrical lenses arranged at a first oblique angle, and a second large surface of the transparent substrate is provided with a pixel array; A camera, used to obtain a facial image of the user; An image processing unit, used to determine the eyebrow center position information of the user according to the facial image; A data processing unit is used to determine the image arrangement period and the first interlaced line corresponding to the pixel array according to the eyebrow center position information, the focal length of the camera, the first width of the cylindrical lens and the first oblique angle, and a straight line passing through the eyebrow center of the user and the center of the display panel intersects with the first interlaced line; and according to the image arrangement period and the distance between the sub-pixel units in the pixel array and the first interlaced line, respectively, determine the attribute information corresponding to the sub-pixel units respectively, and the attribute information is used to indicate that the sub-pixel unit is used to display the left eye image or the right eye image; A control unit is used to control the pixel array to display the left eye image and the right eye image according to the plurality of attribute information.

2. The 3D display system according to claim 1, characterized in that: The image processing unit is specifically used for: Determine, according to the facial image, a first coordinate of the left eye of the user in a first coordinate system and a second coordinate of the right eye in the first coordinate system, wherein the first coordinate system is established based on the camera, a Z axis of the first coordinate system is perpendicular to the display panel, and an X axis of the first coordinate system is parallel to a bottom edge of the first large surface; A third coordinate is determined according to the first coordinate and the second coordinate, and the third coordinate is used to represent the eyebrow center position information.

3. The 3D display system according to claim 2, characterized in that: The image processing unit includes a deep learning model, which is used to extract the first coordinate and the second coordinate from the facial image.

4. The 3D display system according to claim 3, characterized in that: The camera is a monocular camera.

5. The 3D display system according to any one of claims 2 to 4, characterized in that: The data processing unit is specifically used for: The image arrangement period is determined according to the third coordinate, the first width and the focal length.

6. The 3D display system according to any one of claims 2 to 5, characterized in that: The data processing unit is specifically used for: Determining a first interlacing point according to the third coordinate, the origin of the first coordinate system, and the focal length; The first interweaving line is determined according to the first interweaving point and the first oblique angle, and the first interweaving line passes through the first interweaving point.

7. The 3D display system according to claim 6, characterized in that: The pixel array includes a first sub-pixel unit, and the data processing unit is specifically used for: Determine, according to the fourth coordinate of the first sub-pixel unit, the fifth coordinate of the first reference point in the first interlaced line, wherein the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate; The attribute information of the first sub-pixel unit is determined according to the pattern arrangement period and a first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate.

8. The 3D display system according to claim 7, characterized in that: The left eye image includes a plurality of partial left eye images, the right eye image includes a plurality of partial right eye images, the partial left eye images and the partial right eye images are alternately arranged along the X-axis of the first coordinate system, the width of one arrangement period is equal to the sum of the widths of one partial left eye image and one partial right eye image along the X-axis direction, and the data processing unit is specifically used for: Taking the first difference as a quotient and the width of the arrangement period as a quotient, to determine a first remainder; When the first remainder is smaller than half of the width of the image arrangement period, and the abscissa of the fourth coordinate is smaller than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the right eye image; or, When the first remainder is greater than half of the width of the image arrangement period, and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left eye image; or, When the first remainder is smaller than half of the width of the image arrangement period and the abscissa of the fourth coordinate is larger than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left eye image; or, When the first remainder is greater than half the width of the image arrangement period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, the attribute information of the first sub-pixel unit is determined to indicate that the first sub-pixel unit is used to display the right eye image.

9. A 3D display method, characterized in that: Applied to a 3D display system, the 3D display system includes a display panel and a camera, a first large surface of a transparent substrate of the display panel is fixed with a plurality of cylindrical lenses arranged at a first oblique angle, a second large surface of the transparent substrate is provided with a pixel array, and the 3D display method includes: Get the user's facial image; Determining the eyebrow center position information of the user according to the facial image; Determine, according to the eyebrow center position information, the focal length of the camera, the first width of the cylindrical lens, and the first oblique angle, a pattern arrangement period and a first interlacing line corresponding to the pixel array, wherein a straight line passing through the eyebrow center of the user and the center of the display panel intersects with the first interlacing line; Determine attribute information corresponding to the sub-pixel units respectively according to the pattern arrangement period and the distance between the sub-pixel units in the pixel array and the first interlaced line, wherein the attribute information is used to indicate that the sub-pixel units are used to display a left-eye image or a right-eye image; According to the plurality of attribute information, the pixel array is controlled to display the left eye image and the right eye image.

10. The 3D display method according to claim 9, characterized in that: Determining the eyebrow center position information of the user according to the facial image includes: Determine, according to the facial image, a first coordinate of the left eye of the user in a first coordinate system and a second coordinate of the right eye in the first coordinate system, wherein the first coordinate system is established based on the camera, a Z axis of the first coordinate system is perpendicular to the display panel, and an X axis of the first coordinate system is parallel to a bottom edge of the first large surface; A third coordinate is determined according to the first coordinate and the second coordinate, and the third coordinate is used to represent the eyebrow center position information.

11. The 3D display method according to claim 10, characterized in that: The step of determining the pattern arrangement period and the first interlaced line corresponding to the pixel array according to the information of the center of the eyebrows, the focal length of the camera, the first width of the cylindrical lens, and the first oblique angle comprises: Determining the image arrangement period according to the third coordinate, the first width and the focal length; Determining a first interlacing point according to the third coordinate, the origin of the first coordinate system, and the focal length; The first interweaving line is determined according to the first interweaving point and the first oblique angle, and the first interweaving line passes through the first interweaving point.

12. The 3D display method according to claim 11, characterized in that: The pixel array includes first sub-pixel units, and determining attribute information corresponding to the sub-pixel units respectively according to the pattern arrangement period and the distance between the sub-pixel units in the pixel array and the first interlaced line includes: Determine, according to the fourth coordinate of the first sub-pixel unit, the fifth coordinate of the first reference point in the first interlaced line, wherein the ordinate in the fourth coordinate is the same as the ordinate in the fifth coordinate; The attribute information of the first sub-pixel unit is determined according to the pattern arrangement period and a first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate.

13. The 3D display method according to claim 12, characterized in that: The left eye image includes a plurality of partial left eye images, the right eye image includes a plurality of partial right eye images, the partial left eye images and the partial right eye images are alternately arranged along the X-axis of the first coordinate system, the width of one arrangement period is equal to the sum of the widths of one partial left eye image and one partial right eye image along the X-axis direction, and the determining of the attribute information of the first sub-pixel unit according to the arrangement period and the first difference between the abscissa of the fourth coordinate and the abscissa of the fifth coordinate includes: Taking the first difference as a quotient and the width of the arrangement period as a quotient, to determine a first remainder; When the first remainder is smaller than the width of the image arrangement period, and the abscissa of the fourth coordinate is smaller than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the right eye image; or, When the first remainder is greater than the width of the image arrangement period and the abscissa of the fourth coordinate is less than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left eye image; or, When the first remainder is smaller than the width of the image arrangement period and the abscissa of the fourth coordinate is larger than the abscissa of the fifth coordinate, determining that the attribute information of the first sub-pixel unit is used to indicate that the first sub-pixel unit is used to display the left eye image; or, When the first remainder is greater than the width of the image arrangement period and the abscissa of the fourth coordinate is greater than the abscissa of the fifth coordinate, the attribute information of the first sub-pixel unit is determined to indicate that the first sub-pixel unit is used to display the right eye image.

14. A 3D display device, characterized in that: The device comprises a processor and a memory, wherein the processor and the memory are connected, wherein the memory is used to store program codes, and the processor is used to call the program codes to execute the 3D display method according to any one of claims 9 to 13.

15. A computer-readable storage medium, characterized in that: Instructions are stored thereon, and when the instructions are executed by a processor, the processor implements the 3D display method according to any one of claims 9 to 13.

Images