Light field display data generation method and light field display system

Abstract

The invention discloses a light field display data generation method and a light field display system. According to the light field data display method, specific steps for realizing a light field display function are described from how to better realize naked eye 3D display. According to the light field data display method, the naked eye 3D display effect can be improved.

Description

Technical Field

[0001] The present application relates to the field of naked-eye 3D display technology, and in particular to a light field display data generation method and a light field display system. Background Art

[0002] Currently, naked-eye 3D display technology is still under development, and the effects of most naked-eye 3D displays are difficult to meet expectations, and the effects of naked-eye 3D displays are relatively poor. Summary of the invention

[0003] In view of this, embodiments of the present application provide a light field display data generation method and a light field display system to solve the problem of poor naked eye 3D display effect.

[0004] In a first aspect, an embodiment of the present application provides a method for generating light field display data, comprising the following steps performed by a data generation end:

[0005] Acquire 3D data and render it to obtain rendering data;

[0006] determining target position information of the multi-layer virtual display according to the display adjustment information;

[0007] Constructing light constraints according to the target position information and the rendering data to obtain light constraint data;

[0008] The light constraint data is compressed to obtain light field display data.

[0009] In a second aspect, an embodiment of the present application provides a light field display method, including the following steps performed by a data display end:

[0010] Acquire light field display data, wherein the light field display data is generated by using the light field display data generation method described in the first aspect;

[0011] Decompressing the light field display data to obtain light constraint data;

[0012] Performing light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display;

[0013] Light field display is performed on the multiple layers of the display according to the pixel value of each layer of the display.

[0014] In a third aspect, an embodiment of the present application provides a data generation terminal, including a data generation processing module for performing the steps described in the first aspect, wherein the data generation processing module includes:

[0015] A rendering data acquisition unit, used to acquire 3D data and render it to obtain rendering data;

[0016] A position determination unit, configured to determine target position information of the multi-layer virtual display according to the display adjustment information;

[0017] A data processing unit, configured to construct a light constraint according to the target position information and the rendering data to obtain light constraint data;

[0018] The data compression unit is used to compress the light constraint data to obtain light field display data.

[0019] In a fourth aspect, an embodiment of the present application provides a data display terminal, including a data display processing module for performing the steps described in the second aspect, wherein the data display processing module includes:

[0020] A light field display data acquisition unit, used to acquire light field display data, wherein the light field display data is generated by the light field display data generation method as described in the first aspect;

[0021] A data decompression unit, used for decompressing the light field display data to obtain light constraint data;

[0022] A light field decomposition unit, used to perform light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display;

[0023] The display unit is used to perform light field display on the multiple layers of the display according to the pixel value of each layer of the display.

[0024] In a fifth aspect, an embodiment of the present application provides a light field display system, comprising a data generation end as described in the third aspect and a data display end as described in the fourth aspect.

[0025] In a sixth aspect, an embodiment of the present application further provides a computer device, wherein the computer device stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the steps of the light field display data generating method as described in the first aspect are implemented; or, when the computer-readable instructions are executed by a processor, the steps of the light field display method as described in the second aspect are implemented.

[0026] In an embodiment of the present application, 3D data is first acquired and rendered to obtain rendering data, so as to determine pixel information of the 3D rendering effect of the object to be displayed that the user expects to display, and provide data support for generating accurate light field display data; then, the target position information of the multi-layer virtual display is determined according to the display adjustment information, so as to pre-simulate the spatial position information of the specific presentation of the rendering data of the object to be displayed in the multi-layer virtual display, and accurately determine the distribution relationship of the rendering data of the object to be displayed in space; then, light constraints are constructed according to the target position information and the rendering data to obtain light constraint data, so as to accurately and uniquely determine each pixel information related to the rendering data displayed in a three-dimensional space; finally, the light constraint data is compressed to obtain light field display data. After compressing the light constraint data with a large amount of data, the naked-eye 3D display can be more comprehensively realized using the light field display data with a relatively concise data amount, which can effectively improve the naked-eye 3D display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0028] Figure 1 is a flow chart of a method for generating light field display data in an embodiment of the present application;

[0029] Figure 2 is a flow chart of a light field display method in an embodiment of the present application;

[0030] Figure 3 is a schematic diagram of a light field display system in an embodiment of the present application;

[0031] Figure 4 This is a schematic diagram of a traditional display assembly in an embodiment of the present application;

[0032] Figure 5 This is another conventional display assembly schematic diagram in an embodiment of the present application;

[0033] Figure 6 This is a schematic diagram of a display assembly in an embodiment of the present application;

[0034] Figure 7 This is another schematic diagram of display assembly in an embodiment of the present application;

[0035] Figure 8 is a schematic diagram of a data generation terminal in an embodiment of the present application;

[0036] Fig. 9This is a schematic diagram of a data display terminal in an embodiment of the present application;

[0037] Fig.10 It is a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0039] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0040] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0041] It should be understood that the term "and / or" used in this article is only a description of the same field of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0042] It should be understood that, although the terms first, second, third, etc. may be used to describe preset ranges, etc. in the embodiments of the present application, these preset ranges should not be limited to these terms. These terms are only used to distinguish preset ranges from each other. For example, without departing from the scope of the embodiments of the present application, the first preset range may also be referred to as the second preset range, and similarly, the second preset range may also be referred to as the first preset range.

[0043] The word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0044] Figure 11 is a flow chart of a method for generating light field display data in an embodiment of the present application. The method for generating light field display data can be applied in the data generation stage of 3D naked eye display, and before displaying the 3D naked eye image through a physical display, it can provide effective data support for realizing 3D naked eye display. Figure 1 As shown, the light field display data generation method includes the following steps performed by the data generation end:

[0045] S10: Acquire 3D data and render it to obtain rendering data.

[0046] Naked-eye 3D realizes the 3D display of the object to be displayed in the real world. In one embodiment, the user can first obtain 3D data, which can reflect the spatial information of the object to be displayed in the real world. By using a 3D rendering engine for rendering, the 3D data can be stored in a form suitable for computer processing. The 3D rendering engine can be used to render and quickly process the 3D data in the virtual space constructed by the computer, and obtain space-related information that can express the object to be displayed in the real world in the virtual space. Using this rendering data helps users simulate naked-eye 3D display in the real world on the computer.

[0047] S20: Determine target position information of the multi-layer virtual display according to the display adjustment information.

[0048] Among them, the present application adopts a spatial tensor display realized by a multi-layer display. The display can specifically adopt a liquid crystal screen, and each layer of liquid crystal screens overlaps each other with a certain gap. It should be understood that the present application realizes the naked eye 3D level image display. For the naked eye 2D level image display, the pixel value of each image lacks the consideration of the spatial angle. The present application adopts the form of a tensor to represent the image pixels of the naked eye 3D level, so that each pixel value can meet the light constraints of multiple angles, which can give people a richer and more comprehensive visual effect in the spatial display, thereby achieving a more delicate naked eye 3D display effect.

[0049] In one embodiment, the display adjustment information refers to information for adjusting the display position of the object to be displayed in the real world. It can be understood that the adjustment of the display object in the virtual space of the computer is actually equivalent to the adjustment of the display object in the real world, which has the advantages of flexibility and low cost in the virtual space. When performing actual 3D naked-eye display, the user can adjust the display position of the object to be displayed in the virtual space constructed by the computer through the display adjustment information. Specifically, in the virtual space, the 3D imaging of the object to be displayed is obtained after the light passes through the multi-layer display. In this application, by determining the target position information of the multi-layer virtual display, the 3D imaging of the object to be displayed can also be determined.

[0050] S30: constructing light constraints according to the target position information and the rendering data to obtain light constraint data.

[0051] Among them, the light constraint actually reflects the imaging effect of the object to be displayed, that is, the content of the object to be displayed that the user expects to be displayed. Specifically, it can be to display the color of the pixel value expected by the user at a spatial position of a certain pixel size. It can be understood that the light constraint is how to control the input light to display the color effect expected by the user at a specific position after passing through the multi-layer display. When the number of pixels is large enough, the user will have a naked-eye 3D visual effect. In one embodiment, in order to obtain light constraint data, the light constraint is constructed using the target position information and rendering data, and the imaging effect of the object to be displayed is constrained from the perspective of the spatial position and the corresponding pixel value of the spatial display. It can be understood that in order to control the input light to achieve the display effect expected by the user during imaging display, it is necessary to constrain these input light rays to control the pixel value of the light at the intersection of the light rays, so as to achieve an accurate naked-eye 3D display effect.

[0052] S40: compressing the light constraint data to obtain light field display data.

[0053] Among them, light field display data refers to compressed data in a data compression state after light constraint data is compressed. It can be understood that since 3D naked eye display involves tensor data at the spatial level, the amount of light constraint data is very large. When the data obtained from the virtual space is converted to real-world applications, the light constraint data will be compressed in this application to obtain light field display data, so that when the virtual display is transitioned to the real display, the data can be transmitted and processed more quickly, accurately and without omission, which can improve the efficiency and accuracy of 3D naked eye display.

[0054] In steps S10-S40, the present application determines rendering data representing pixel values ​​of pixel points of the object to be displayed and spatial position information representing the object to be displayed in the virtual space, and generates light constraints using the pixel values ​​and spatial position information of the pixel points in the space, thereby obtaining the naked-eye 3D display effect expected by the user. Finally, by compressing the light constraint data, the efficiency and accuracy of the 3D naked-eye display can be improved, thereby achieving a better naked-eye 3D display effect.

[0055] Furthermore, the display adjustment information includes posture adjustment information and scale adjustment information.

[0056] In one embodiment, the position of the virtual multi-layer display in the present application can be represented by seven dimensions: rotation tensor (including 3 dimensions), translation tensor (including 3 dimensions), and scale scaling. Among them, the posture adjustment information refers to the information of adjusting the posture of the display by rotation tensor and translation tensor, and the scale adjustment information refers to the information of achieving scale adjustment by scale scaling. In the present application, the display of the display object in space is comprehensively considered from the perspectives of rotation, translation, scaling, etc., so that the multi-layer display can be flexibly adjusted in space, so as to better realize light constraints and obtain more accurate light constraint data.

[0057] Further, in step S20, i.e., the step of determining target position information of the multi-layer virtual display according to the display adjustment information, the following steps are specifically included:

[0058] S21: Determine initial position information of the multi-layer virtual display.

[0059] In one embodiment, a virtual display is generated in a virtual space constructed by a computer. The virtual space may include a plurality of spatial points, each of which has its corresponding coordinates. The virtual display occupies a portion of the spatial points, and the coordinates of the boundaries of each layer of virtual displays can be determined by the positions of the spatial points overlapped by the virtual displays, thereby determining the initial position information of these virtual displays in the virtual space. It can be understood that by determining the initial position information of the virtual display, the relative position of the virtual display in the virtual space can be determined by the coordinate system, thereby simulating the spatial relationship of the display in the real world in the real space.

[0060] S22: Acquire initial position information of the multi-layer virtual display according to the initial position information.

[0061] In one embodiment, after obtaining the initial position information of the virtual display, the relative initial posture information in the coordinate system can be determined based on the initial position information, and the translation / rotation of the virtual display in the coordinate system can be determined, so as to make position adjustments such as translation / rotation / scaling of the virtual display based on the initial posture information.

[0062] S23: performing translation and / or rotation adjustment on the multi-layer virtual display according to the initial posture information and the posture adjustment information to obtain first display position information.

[0063] S24: Scale the first display position information according to the scale adjustment information to obtain target position information.

[0064] In one embodiment, in steps S23-S24, the target position information can be specifically determined by posture adjustment (including rotation / translation in 6 dimensions) and proportional scaling of the overall size, and the position of the multi-layer virtual display can be adjusted according to the adjustment requirements of different target position information, so that the multi-layer virtual display can better achieve light constraints and obtain more accurate light constraint data.

[0065] In steps S21-S24, by determining the initial position information of the virtual display, the position of the virtual display is adjusted from seven dimensions including rotation / translation posture adjustment and size scaling adjustment, so that the adjusted virtual display can achieve a better light constraint effect.

[0066] Further, in step S30, that is, constructing light constraints according to the target position information and the rendering data to obtain light constraint data, the following steps are specifically included:

[0067] S31: constructing a light ray passing through each layer of the virtual display according to the target position information, wherein each layer of the virtual display has a pixel point in the light ray.

[0068] Each layer of the virtual display includes multiple pixels and corresponding pixel coordinates. In one embodiment, when constructing the light constraint, the target position information is used as the initial position as a reference, and the generated light will pass through each layer of the virtual display, and each layer has a pixel point in the light, that is, the light only passes through the display once, and its corresponding pixel coordinates can be determined through the intersecting pixel point.

[0069] S32: Determine the pixel value at the intersection of the light rays according to the rendering data to obtain light constraint data.

[0070] The pixel value at the intersection of light rays refers to the pixel value or color value corresponding to the light rays interacting with the pixel points in a space after passing through each layer of virtual display, that is, the pixel value of the pixel point of the final image. It can be understood that the closer the pixel value of the pixel point of the final image is to the 3D display effect expected by the user, the more accurate the light constraint data obtained will be.

[0071] In steps S31-S32, by controlling the color of the light displayed at the intersection of the light rays, the light rays are finally constrained to a desired intersection result after being emitted, thereby making the 3D display more in line with the user's expectations in terms of color display and position display.

[0072] Furthermore, the number of layers of the multi-layer virtual display may be specifically set to 3 layers.

[0073] In one embodiment, the number of layers of the virtual display is at least 2. In one embodiment, when the virtual display is specifically set to 3 layers, the amount of data involved is relatively small, the application cost is low, and a good light constraint effect can be achieved. Therefore, setting the number of layers of the virtual display to 3 is a better solution. Of course, it should be noted that other layers greater than 2 that can achieve the technical effect of this application should also fall within the scope of protection of this application.

[0074] Furthermore, in step S31, i.e., the step of constructing the light rays passing through each layer of the virtual display according to the target position information, the following steps are specifically included:

[0075] S311: Use pixels of the middle display layer of the virtual display as base pixels.

[0076] Among them, base pixel refers to the pixel used as the basic reference. It can be understood that when the number of layers of the virtual display is 3, using the pixels of the middle display layer as the base pixel can more concisely express the data relationship and processing, which can well simplify the data relationship and processing in the context of the huge amount of data in this application. In one embodiment, the pixels of the middle display layer of the virtual display are used as base pixels, which means that the pixels of the middle layer are used as the main body of the data description.

[0077] S312: constructing rays according to the connection lines between the base pixel and the neighboring pixels of the same-position pixels of other display layers, wherein the rays are constructed based on the target position information by raster scanning, and the number of rays is the resolution of the intermediate display layer multiplied by the range of the neighboring pixels.

[0078] Among them, the base pixel and the co-located pixels of other display layers (the first layer and the third layer) refer to the pixels that correspond to the base pixel layer and the first layer or the third layer in terms of the relative position relationship of coordinates. For example, when the base pixel layer and the first layer or the third layer are in an overlapping relationship (with a gap in between), the coordinate relationship of the co-located pixels on its layer is the same as the coordinate relationship of the base pixel on its layer. In other words, when the base pixel layer and other display layers completely overlap (with no gap), the base pixel and its co-located pixel also completely overlap.

[0079] Among them, the neighboring pixels of the same pixel refer to the pixels within the preset neighboring area of ​​the same pixel on its layer. Assuming that the range size of the neighboring pixels is 127*127, the connection between the base pixel and the neighboring pixels of the same pixel in other layers can generate 127*127 rays respectively. At this time, the number of light constraints on each base pixel is 127*127. On this basis, it is assumed that the resolution of the base pixel layer is 1920*1080, and in this application, the light structure adopts the sequential scanning of the grating, so it is not necessary to store the pixel coordinates corresponding to each light ray, and the total number of light constraints will reach 1920*1080*127*127. It can be seen that the data volume of the light constraint will reach at least 1920*1080*127*127 pixel values. In this data volume, the connection lines between the base pixel and the neighboring pixels of the co-located pixels in other layers actually reflect the multi-angle light constraints of the pixels in space. The light constraint can represent the multi-directionality of the pixels from multi-angle spatial directions, allowing users to have the feeling of 3D naked-eye display when viewing the image to be displayed.

[0080] In steps S311-S312, by defining base pixels, co-located pixels, and neighborhood pixels, the user can simplify the light constraint data based on the base pixels, which can effectively improve the data processing efficiency and the efficiency of light construction.

[0081] Furthermore, in step S40, the step of compressing the light constraint data to obtain light field display data specifically includes the following steps:

[0082] S41: Obtain a data compression request.

[0083] S42: Determine a compression algorithm according to the data compression request, wherein the compression algorithm adopts an algorithm for compressing the light field data collected by the light field camera.

[0084] In one embodiment, the compression algorithm used in the present application is a compression algorithm for compressing light field data after the light field camera collects the light field data. It can be understood that the light field data collected by the light field camera has similar data format to the light constraint data of the present application, so the compression algorithm can be used to compress the light constraint data.

[0085] S43: compressing the light constraint data according to the determined compression algorithm to obtain light field display data.

[0086] In steps S41-S43, a compression algorithm is used to compress the light field data after the light field camera collects the light field data. The light constraint data can be compressed by utilizing the similarity between the light field data and the light constraint data of the present application to achieve a better compression effect and reduce the amount of data.

[0087] Figure 2This is a flow chart of a light field display method in an embodiment of the present application. The light field display method is applied to a data display terminal and is a specific application method for realizing light field display in the real world. Figure 2 The following specific steps are shown:

[0088] S50: Acquire light field display data, wherein the light field display data is generated using the light field display data generation method as described above.

[0089] S60: Decompress the light field display data to obtain light constraint data.

[0090] S70: Perform light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display.

[0091] S80: Performing light field display on the multi-layer display according to the pixel value of each layer of the display.

[0092] Steps S50-S80 are steps of applying virtual light constraint data to the actual scene. The light constraint data can be obtained by adopting a decompression algorithm corresponding to the above-mentioned compression algorithm. After that, the light field is decomposed according to the light constraint data using a preset light field decomposition algorithm to determine the pixel value of each layer of display. It can be understood that with the pixel value of each layer of display, the pixel value display of each layer of display can be controlled, so that the displays of different layers are displayed according to the pixel values ​​obtained by light field decomposition. Finally, light is emitted to allow the light to pass through multiple layers of display, and finally the intersection is represented as a pixel point in space, and the pixel value of the pixel point satisfies the light constraint, thereby achieving a 3D naked-eye display effect with delicate pictures, accurate image details, and accurate position.

[0093] Figure 3 Schematic diagram of a light field display system in an embodiment of the present application. Figure 3 As shown in FIG. 1 , the light field display system specifically includes a data generation end and a data display end. The data generation end is the data preparation stage before being put into actual scene application, and the light constraint data is obtained in advance through the virtual space; the data display end is the naked eye 3D display application in the actual scene, and the pixel value of each pixel point of each layer of the multi-layer display is determined by the light constraint data obtained by the data generation end, thereby realizing naked eye 3D display. Specifically, as Figure 3 As shown, the data generation end includes the steps of 3D data rendering → virtual multi-layer display position adjustment → light constraint generation → light constraint compression; the data display end includes the steps of light constraint decompression → light field decomposition → multi-layer display display. In the present application, the light field display data generation method executed by the data generation end and the light field display method executed by the data display end in the above-mentioned embodiment are adopted to form a light field display system, and users can realize naked-eye 3D application display with better display effect according to the system.

[0094] Furthermore, the first layer of display material of the multi-layer display adopts an OLED (Organic Light-Emitting Diode) screen, and the display materials of other layers adopt LCD (Liquid Crystal Display) screens. The light constraint data includes a multiplication relationship, or a combination of an addition relationship and a multiplication relationship. When the light constraint data satisfies the multiplication relationship, the pixel value at the intersection of the light rays of the multi-layer display is the pixel value of the OLED screen multiplied by the pixel value of the other layers of the LCD screen. Each layer of the display includes a polarizer. When the light constraint data satisfies the combination of the addition relationship and the multiplication relationship, the pixel value at the intersection of the light rays of the multi-layer display is the product of the pixel value of the OLED screen plus the pixel value of the other layers of the LCD screen. The OLED screen and the last layer of the LCD screen include polarizers.

[0095] Figure 4 This is a schematic diagram of a traditional display assembly in an embodiment of the present application. Figure 5 This is another schematic diagram of traditional display assembly in an embodiment of the present application. Figure 6 This is a schematic diagram of a display assembly in an embodiment of the present application. Figure 7 This is another schematic diagram of display assembly in an embodiment of the present application.

[0096] Taking a three-layer LCD screen as an example, there are two traditional assembly schemes: one is that the light constraint satisfies the multiplication relationship, I = a*b*c, where I is the final pixel value, a, b, c are the pixel values ​​on LCD1, LCD2, and LCD3 respectively, and its assembly scheme is as follows: Figure 4 As shown; the other is that the light constraint satisfies the additive relationship, I = a + b + c, and its assembly scheme is as follows Figure 5 As shown. The assembly scheme proposed in this aspect also includes two types: one is that the light constraint satisfies the multiplication relationship, I = a*b*c, where a is the pixel value of OLED, b and c are the pixel values ​​of LCD1 and LCD2 respectively. The assembly scheme is as follows: Figure 6 As shown; the other is that the light constraint satisfies the relationship between addition and multiplication: I = a + b * c, and its assembly scheme is as follows Figure 7As shown. It should be noted that OLED is a self-luminous display and does not require a backlight. When multiple layers of OLED are stacked together, the light entering the human eye is not the result of joint modulation of the multiple layers of OLED screens, and does not satisfy the light field 3D model. Therefore, the stacking of multiple layers of OLED displays cannot achieve tensor light field display, and OLED displays are not currently used in light field displays of multiple displays. In the present application, compared to traditional multi-layer liquid crystal displays, the first layer of display material of the display uses an OLED display, and the backlight panel is removed, so that the OLED display can be applied to the light field display of multiple displays, and compared to traditional multi-layer liquid crystal displays, this improvement has higher contrast, faster response time, and better naked-eye 3D display effect.

[0097] In an embodiment of the present application, 3D data is first acquired and rendered to obtain rendering data, so as to determine pixel information of the 3D rendering effect of the object to be displayed that the user expects to display, and provide data support for generating accurate light field display data; then, the target position information of the multi-layer virtual display is determined according to the display adjustment information, so as to pre-simulate the spatial position information of the specific presentation of the rendering data of the object to be displayed in the multi-layer virtual display, and accurately determine the distribution relationship of the rendering data of the object to be displayed in space; then, light constraints are constructed according to the target position information and the rendering data to obtain light constraint data, so as to accurately and uniquely determine each pixel information related to the rendering data displayed in a three-dimensional space; finally, the light constraint data is compressed to obtain light field display data. After compressing the light constraint data with a large amount of data, the naked-eye 3D display can be more comprehensively realized using the light field display data with a relatively concise data amount, which can effectively improve the naked-eye 3D display effect.

[0098] Furthermore, the present application also determines the initial position information of the virtual display, and realizes the position adjustment of the virtual display from seven dimensions of rotation / translation posture adjustment and size scaling adjustment, so that the adjusted virtual display can achieve a better light constraint effect; further, the present application also controls the color of the light displayed at the intersection of the light rays, so that the light rays are finally constrained to a desired intersection result after emission, thereby making the 3D display better meet the user's expectations in color display and position display; by defining base pixels, co-located pixels, and neighboring pixels, the user can simplify the light constraint data based on the base pixels, which can effectively improve the data processing efficiency and the efficiency of light construction; a compression algorithm is used to compress the light field data after the light field camera collects the light field data, and the similarity between the light field data and the light constraint data of the present application can be used to compress the light constraint data to achieve a better compression effect and reduce the amount of data.

[0099] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0100] Figure 8 is a schematic diagram of a data generation terminal in an embodiment of the present application, including a data generation processing module, such as Figure 8 As shown, the data generation processing module includes:

[0101] The rendering data acquisition unit 10 is used to acquire 3D data and perform rendering to obtain rendering data.

[0102] The position determination unit 20 is used to determine target position information of the multi-layer virtual display according to the display adjustment information.

[0103] The data processing unit 30 is used to construct light constraints according to the target position information and the rendering data to obtain light constraint data.

[0104] The data compression unit 40 is used to compress the light constraint data to obtain light field display data.

[0105] Furthermore, the display adjustment information includes posture adjustment information and scale adjustment information.

[0106] Furthermore, the location determination unit 20 is specifically configured to:

[0107] Determine initial position information of the multi-layer virtual display.

[0108] The initial position information of the multi-layer virtual display is obtained according to the initial position information.

[0109] The multi-layer virtual display is translated and / or rotated according to the initial posture information and the posture adjustment information to obtain first display position information.

[0110] The first display position information is scaled according to the scale adjustment information to obtain the target position information.

[0111] Furthermore, the data processing unit 30 is specifically used for:

[0112] A ray passing through each layer of the virtual display is constructed according to the target position information, wherein each layer of the virtual display has a pixel point in the ray.

[0113] The pixel value of the intersection of the light rays is determined according to the rendering data to obtain the light constraint data.

[0114] Furthermore, the number of layers of the multi-layer virtual display is 3 layers.

[0115] Furthermore, the data processing unit 30 is also specifically used for:

[0116] The pixels of the middle display layer of the virtual display are used as base pixels.

[0117] Light rays are constructed based on the connection lines between the base pixel and the neighboring pixels of the same-position pixels of other display layers, wherein the light rays are constructed based on the target position information by raster scanning, and the number of light rays is the resolution of the intermediate display layer multiplied by the range of the neighboring pixels.

[0118] Furthermore, the data compression unit 40 is specifically used for:

[0119] Gets the data compression request.

[0120] A compression algorithm is determined according to the data compression request, wherein the compression algorithm adopts an algorithm for compressing the collected light field data by a light field camera.

[0121] The light constraint data is compressed according to a determined compression algorithm to obtain light field display data.

[0122] Fig. 9 is a schematic diagram of a data display terminal in an embodiment of the present application, including a data display processing module, such as Fig. 9 As shown, the data display processing module includes:

[0123] A light field display data acquisition unit 50, used to acquire light field display data, wherein the light field display data is generated by using the light field display data generation method according to the first aspect;

[0124] A data decompression unit 60, used to decompress the light field display data to obtain light constraint data;

[0125] A light field decomposition unit 70, configured to perform light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display;

[0126] The display unit 80 is used to perform light field display on the multi-layer display according to the pixel value of each layer of the display.

[0127] Furthermore, the data display processing module is also specifically used for: the first layer of display material of the multi-layer display adopts an OLED screen, and the other layers of display materials adopt an LCD screen, and the light constraint data includes a multiplication relationship, or a combination of an addition relationship and a multiplication relationship, wherein when the light constraint data satisfies the multiplication relationship, the pixel value at the intersection of the light rays of the multi-layer display is the pixel value of the OLED screen multiplied by the pixel value of the other layers of the LCD screen, and each layer of the display includes a polarizer, and when the light constraint data satisfies the combination of the addition relationship and the multiplication relationship, the pixel value at the intersection of the light rays of the multi-layer display is the product of the pixel value of the OLED screen plus the pixel value of the other layers of the LCD screen, and the OLED screen and the last layer of the LCD screen include polarizers.

[0128] In an embodiment of the present application, 3D data is first acquired and rendered to obtain rendering data, so as to determine pixel information of the 3D rendering effect of the object to be displayed that the user expects to display, and provide data support for generating accurate light field display data; then, the target position information of the multi-layer virtual display is determined according to the display adjustment information, so as to pre-simulate the spatial position information of the specific presentation of the rendering data of the object to be displayed in the multi-layer virtual display, and accurately determine the distribution relationship of the rendering data of the object to be displayed in space; then, light constraints are constructed according to the target position information and the rendering data to obtain light constraint data, so as to accurately and uniquely determine each pixel information related to the rendering data displayed in a three-dimensional space; finally, the light constraint data is compressed to obtain light field display data. After compressing the light constraint data with a large amount of data, the naked-eye 3D display can be more comprehensively realized using the light field display data with a relatively concise data amount, which can effectively improve the naked-eye 3D display effect.

[0129] Furthermore, the present application also determines the initial position information of the virtual display, and realizes the position adjustment of the virtual display from seven dimensions of rotation / translation posture adjustment and size scaling adjustment, so that the adjusted virtual display can achieve a better light constraint effect; further, the present application also controls the color of the light displayed at the intersection of the light rays, so that the light rays are finally constrained to a desired intersection result after emission, thereby making the 3D display better meet the user's expectations in color display and position display; by defining base pixels, co-located pixels, and neighboring pixels, the user can simplify the light constraint data based on the base pixels, which can effectively improve the data processing efficiency and the efficiency of light construction; a compression algorithm is used to compress the light field data after the light field camera collects the light field data, and the similarity between the light field data and the light constraint data of the present application can be used to compress the light constraint data to achieve a better compression effect and reduce the amount of data.

[0130] The present application also provides a computer device, including a memory, a processor, and computer-readable instructions stored in the memory and executable on the processor. When the processor executes the computer-readable instructions, the processor performs the steps of the operator processing method of the processor in the above embodiment.

[0131] Fig.10 This is a computer device according to an embodiment of the present application. Fig.10 As shown, the computer device 110 includes a processor 111, a memory 112, and a computer readable instruction 113 stored in the memory 112 and executable on the processor 111. When the processor 111 executes the computer readable instruction 113, each step of the operator processing method of the processor is implemented.

[0132] Exemplarily, the computer readable instructions 113 may be divided into one or more modules / units, one or more modules / units are stored in the memory 112, and are executed by the processor 111 to complete the present application. One or more modules / units may be a series of computer readable instruction segments capable of completing a specific function, and the instruction segments are used to describe the execution process of the computer readable instructions 113 in the computer device 110.

[0133] The computer device 110 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The computer device may include, but is not limited to, a processor 111 and a memory 112. Those skilled in the art will appreciate that Fig.10 This is only an example of the computer device 110 and does not constitute a limitation of the computer device 110. The computer device 110 may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the computer device may also include input and output devices, network access devices, buses, etc.

[0134] According to different implementations, the processor 111 may include one or more types of processors in general and / or special processors such as a central processing unit (CPU), a graphics processing unit (GPU), an artificial intelligence processor, etc. These processors may include, but are not limited to, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc., and their number may be determined according to actual needs. The memory 112 may be an internal storage unit of the computer device 110, such as a hard disk or memory of the computer device 110. The memory 112 may also be an external storage device of the computer device 110, such as a plug-in hard disk equipped on the computer device 110, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc. Further, the memory 112 may also include both an internal storage unit of the computer device 110 and an external storage device. The memory 112 is used to store computer-readable instructions and other programs and data required by the computer device. The memory 112 can also be used to temporarily store data that has been output or is to be output.

[0135] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0136] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0137] In the embodiments of the present application, the server can be an independent server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms.

[0138] The present application also provides a computer-readable storage medium, which stores computer-readable instructions. When the computer-readable instructions are executed by a processor, an operator processing method of the processor is implemented.

[0139] The foregoing may be better understood in light of the following terms:

[0140] Clause A1. A method for generating light field display data, comprising the following steps performed by a data generation end:

[0141] Acquire 3D data and render it to obtain rendering data;

[0142] determining target position information of the multi-layer virtual display according to the display adjustment information;

[0143] Constructing light constraints according to the target position information and the rendering data to obtain light constraint data;

[0144] The light constraint data is compressed to obtain light field display data.

[0145] Clause A2. The method according to clause A1, wherein the display adjustment information includes posture adjustment information and scale adjustment information, and the step of determining target position information of the multi-layer virtual display according to the display adjustment information includes:

[0146] Determining initial position information of multiple layers of the virtual display;

[0147] Acquire initial position information of multiple layers of the virtual display according to the initial position information;

[0148] According to the initial posture information and the posture adjustment information, the multiple layers of the virtual display are translated and / or rotated to obtain first display position information;

[0149] The first display position information is scaled according to the scale adjustment information to obtain the target position information.

[0150] Clause A3. The method according to clause A1, wherein constructing a light constraint according to the target position information and the rendering data to obtain light constraint data comprises:

[0151] Constructing a light ray passing through each layer of the virtual display according to the target position information, wherein a pixel point in each layer of the virtual display is in the light ray;

[0152] The pixel value at the intersection of the light rays is determined according to the rendering data to obtain the light constraint data.

[0153] Clause A4. The method according to clause A3, wherein the number of layers of the multi-layer virtual display is 3 layers, and the light rays passing through each layer of the virtual display according to the target position information include:

[0154] Using pixels of the middle display layer of the virtual display as base pixels;

[0155] Light rays are constructed based on the connection lines between the base pixel and neighboring pixels of the same-position pixels of other display layers, wherein the light rays are constructed based on the target position information by a raster scanning method, and the number of the light rays is the resolution of the intermediate display layer multiplied by the range of the neighboring pixels.

[0156] Clause A5. A method according to any one of clauses A1 to A4, wherein compressing the light constraint data to obtain light field display data comprises:

[0157] Get data compression request;

[0158] Determining a compression algorithm according to the data compression request, wherein the compression algorithm adopts an algorithm for compressing the collected light field data by a light field camera;

[0159] The light constraint data is compressed according to the determined compression algorithm to obtain the light field display data.

[0160] Clause B1. A light field display method, comprising the following steps performed by a data display end:

[0161] Acquire light field display data, wherein the light field display data is generated by using the light field display data generation method described in any one of clauses A1 to A5;

[0162] Decompressing the light field display data to obtain light constraint data;

[0163] Performing light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display;

[0164] Light field display is performed on the multiple layers of the display according to the pixel value of each layer of the display.

[0165] Clause B2. The method according to clause B1, further comprising:

[0166] The first layer of display material of the multi-layer display adopts an OLED screen, and the other layers of display material adopt an LCD screen, and the light constraint data includes a multiplication relationship, or a combination of an addition relationship and a multiplication relationship; wherein, when the light constraint data satisfies the multiplication relationship, the pixel value at the intersection of the light rays of the multi-layer display is the pixel value of the OLED screen multiplied by the pixel value of the other layers of the LCD screen, and each layer of the display includes a polarizer;

[0167] When the light constraint data satisfies the combination of the addition relationship and the multiplication relationship, the pixel value at the intersection of the light rays of the multiple layers of the display is the product of the pixel value of the OLED screen and the pixel value of the other layers of the LCD screen, and the OLED screen and the LCD screen of the last layer include polarizers.

[0168] Clause C1. A data generation terminal, comprising a data generation processing module for executing the steps described in any one of clauses A1 to A5, wherein the data generation processing module comprises:

[0169] A rendering data acquisition unit, used to acquire 3D data and render it to obtain rendering data;

[0170] A position determination unit, configured to determine target position information of the multi-layer virtual display according to the display adjustment information;

[0171] A data processing unit, configured to construct a light constraint according to the target position information and the rendering data to obtain light constraint data;

[0172] The data compression unit is used to compress the light constraint data to obtain light field display data.

[0173] Clause D1. A data display terminal, comprising a data display processing module for executing the steps described in any one of clauses B1-B2, wherein the data display processing module comprises:

[0174] A light field display data acquisition unit, used to acquire light field display data, wherein the light field display data is generated by using the light field display data generation method as described in any one of clauses A1 to A5;

[0175] A data decompression unit, used for decompressing the light field display data to obtain light constraint data;

[0176] A light field decomposition unit, used to perform light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display;

[0177] The display unit is used to perform light field display on the multiple layers of the display according to the pixel value of each layer of the display.

[0178] Item E1. A light field display system, comprising a data generation end as described in Item C1 and a data display end as described in Item D1.

[0179] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for generating light field display data, characterized in that: The data generation end includes the following steps: Acquire 3D data and render it to obtain rendering data; determining target position information of the multi-layer virtual display according to the display adjustment information; Constructing light constraints according to the target position information and the rendering data to obtain light constraint data; The light constraint data is compressed to obtain light field display data.

2. The method according to claim 1, characterized in that The display adjustment information includes posture adjustment information and scale adjustment information, and determining target position information of the multi-layer virtual display according to the display adjustment information includes: Determining initial position information of multiple layers of the virtual display; Acquire initial position information of multiple layers of the virtual display according to the initial position information; According to the initial posture information and the posture adjustment information, the multiple layers of the virtual display are translated and / or rotated to obtain first display position information; The first display position information is scaled according to the scale adjustment information to obtain the target position information.

3. The method according to claim 1, characterized in that The step of constructing a light constraint according to the target position information and the rendering data to obtain light constraint data includes: Constructing a light ray passing through each layer of the virtual display according to the target position information, wherein a pixel point in each layer of the virtual display is in the light ray; The pixel value at the intersection of the light rays is determined according to the rendering data to obtain the light constraint data.

4. The method according to claim 3, characterized in that The number of layers of the multi-layer virtual display is 3 layers, and constructing the light rays passing through each layer of the virtual display according to the target position information includes: Using pixels of the middle display layer of the virtual display as base pixels; Light rays are constructed based on the connection lines between the base pixel and neighboring pixels of the same-position pixels of other display layers, wherein the light rays are constructed based on the target position information by a raster scanning method, and the number of the light rays is the resolution of the intermediate display layer multiplied by the range of the neighboring pixels.

5. The method according to any one of claims 1 to 4, characterized in that: The compressing the light constraint data to obtain light field display data includes: Get data compression request; Determining a compression algorithm according to the data compression request, wherein the compression algorithm adopts an algorithm for compressing the collected light field data by a light field camera; The light constraint data is compressed according to the determined compression algorithm to obtain the light field display data.

6. A light field display method, characterized in that: The following steps are performed by the data display end: Acquire light field display data, wherein the light field display data is generated by using the light field display data generating method according to any one of claims 1 to 5; Decompressing the light field display data to obtain light constraint data; Performing light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display; Light field display is performed on the multiple layers of the display according to the pixel value of each layer of the display.

7. The method according to claim 6, characterized in that The method further comprises: The first layer of display material of the multi-layer display adopts an OLED screen, and the other layers of display material adopt an LCD screen, and the light constraint data includes a multiplication relationship, or a combination of an addition relationship and a multiplication relationship; wherein, When the light constraint data satisfies a multiplication relationship, the pixel value at the intersection of the light rays of the multiple layers of the display is the pixel value of the OLED screen multiplied by the pixel value of the other layers of the LCD screen, and each layer of the display includes a polarizer; When the light constraint data satisfies the combination of the addition relationship and the multiplication relationship, the pixel value at the intersection of the light rays of the multiple layers of the display is the product of the pixel value of the OLED screen and the pixel value of the other layers of the LCD screen, and the OLED screen and the LCD screen of the last layer include polarizers.

8. A data generating terminal, characterized in that: A data generation processing module for executing the steps of any one of claims 1 to 5, wherein the data generation processing module comprises: A rendering data acquisition unit, used to acquire 3D data and render it to obtain rendering data; A position determination unit, configured to determine target position information of the multi-layer virtual display according to the display adjustment information; A data processing unit, configured to construct a light constraint according to the target position information and the rendering data to obtain light constraint data; The data compression unit is used to compress the light constraint data to obtain light field display data.

9. A data display terminal, characterized in that: The method comprises a data display processing module for executing the steps of any one of claims 6 to 7, wherein the data display processing module comprises: A light field display data acquisition unit, used to acquire light field display data, wherein the light field display data is generated by the light field display data generation method according to any one of claims 1 to 5; A data decompression unit, used for decompressing the light field display data to obtain light constraint data; A light field decomposition unit, used to perform light field decomposition according to the light constraint data to obtain pixel values ​​of each layer of display; The display unit is used to perform light field display on the multiple layers of the display according to the pixel value of each layer of the display.

10. A light field display system, characterized in that: It comprises the data generating end as claimed in claim 8 and the data display end as claimed in claim 9.

Images